[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:15:18.244239 19888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.108.62:33267
I20260709 12:15:18.245668 19888 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:15:18.246647 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:18.262025 19895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:18.262276 19894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:18.263078 19897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:18.263516 19888 server_base.cc:1061] running on GCE node
I20260709 12:15:19.364974 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:19.365212 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:19.365402 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599319365379 us; error 0 us; skew 500 ppm
I20260709 12:15:19.366225 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:19.372016 19888 webserver.cc:533] Webserver started at http://127.19.108.62:33621/ using document root <none> and password file <none>
I20260709 12:15:19.372826 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:19.373031 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:19.373442 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:19.378978 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/master-0-root/instance:
uuid: "5fa9436edf52451a954c5cbd3a185f5d"
format_stamp: "Formatted at 2026-07-09 12:15:19 on dist-test-slave-0g1j"
I20260709 12:15:19.386061 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:19.390748 19903 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:19.391796 19888 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:19.392122 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/master-0-root
uuid: "5fa9436edf52451a954c5cbd3a185f5d"
format_stamp: "Formatted at 2026-07-09 12:15:19 on dist-test-slave-0g1j"
I20260709 12:15:19.392431 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:19.440582 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:19.442030 19888 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:15:19.442451 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:19.509375 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.62:33267
I20260709 12:15:19.509454 19954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.62:33267 every 8 connection(s)
I20260709 12:15:19.516829 19955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:19.537257 19955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d: Bootstrap starting.
I20260709 12:15:19.542761 19955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:19.544468 19955 log.cc:826] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d: Log is configured to *not* fsync() on all Append() calls
I20260709 12:15:19.548498 19955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d: No bootstrap required, opened a new log
I20260709 12:15:19.567960 19955 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fa9436edf52451a954c5cbd3a185f5d" member_type: VOTER }
I20260709 12:15:19.568441 19955 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:19.568670 19955 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fa9436edf52451a954c5cbd3a185f5d, State: Initialized, Role: FOLLOWER
I20260709 12:15:19.569521 19955 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fa9436edf52451a954c5cbd3a185f5d" member_type: VOTER }
I20260709 12:15:19.569986 19955 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:19.570253 19955 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:19.570552 19955 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:19.574355 19955 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fa9436edf52451a954c5cbd3a185f5d" member_type: VOTER }
I20260709 12:15:19.575032 19955 leader_election.cc:304] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5fa9436edf52451a954c5cbd3a185f5d; no voters: 
I20260709 12:15:19.576618 19955 leader_election.cc:290] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:19.576937 19958 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:19.578876 19958 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 1 LEADER]: Becoming Leader. State: Replica: 5fa9436edf52451a954c5cbd3a185f5d, State: Running, Role: LEADER
I20260709 12:15:19.579728 19958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fa9436edf52451a954c5cbd3a185f5d" member_type: VOTER }
I20260709 12:15:19.580651 19955 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:19.588809 19959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5fa9436edf52451a954c5cbd3a185f5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fa9436edf52451a954c5cbd3a185f5d" member_type: VOTER } }
I20260709 12:15:19.589380 19959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:19.588732 19960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5fa9436edf52451a954c5cbd3a185f5d. Latest consensus state: current_term: 1 leader_uuid: "5fa9436edf52451a954c5cbd3a185f5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fa9436edf52451a954c5cbd3a185f5d" member_type: VOTER } }
I20260709 12:15:19.589856 19960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:19.592317 19966 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:19.603744 19966 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:19.605399 19888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:19.618024 19966 catalog_manager.cc:1383] Generated new cluster ID: ab635d770282474281dd0edcd5bd9f7a
I20260709 12:15:19.618232 19966 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:19.637549 19966 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:19.638924 19966 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:19.651328 19966 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d: Generated new TSK 0
I20260709 12:15:19.652047 19966 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:19.671394 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:19.678678 19977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:19.679736 19978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:19.682552 19980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:19.682902 19888 server_base.cc:1061] running on GCE node
I20260709 12:15:19.683573 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:19.683763 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:19.683924 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599319683904 us; error 0 us; skew 500 ppm
I20260709 12:15:19.684463 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:19.688278 19888 webserver.cc:533] Webserver started at http://127.19.108.1:34955/ using document root <none> and password file <none>
I20260709 12:15:19.688771 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:19.688949 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:19.689203 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:19.690260 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-0-root/instance:
uuid: "ad34594620564711ac3d61ce9f399ae8"
format_stamp: "Formatted at 2026-07-09 12:15:19 on dist-test-slave-0g1j"
I20260709 12:15:19.695489 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:15:19.699864 19985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:19.700615 19888 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:19.700870 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "ad34594620564711ac3d61ce9f399ae8"
format_stamp: "Formatted at 2026-07-09 12:15:19 on dist-test-slave-0g1j"
I20260709 12:15:19.701124 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:19.733716 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:19.734952 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:19.737353 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:19.741546 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:19.741750 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:19.741998 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:19.742151 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:19.833613 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:43933
I20260709 12:15:19.833685 20047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:43933 every 8 connection(s)
I20260709 12:15:19.840243 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:19.851503 20052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:19.852805 20053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:19.859282 19888 server_base.cc:1061] running on GCE node
W20260709 12:15:19.861066 20056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:19.861948 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:19.862192 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:19.862409 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599319862387 us; error 0 us; skew 500 ppm
I20260709 12:15:19.863175 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:19.866683 19888 webserver.cc:533] Webserver started at http://127.19.108.2:39093/ using document root <none> and password file <none>
I20260709 12:15:19.867339 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:19.867578 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:19.867909 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:19.868546 20048 heartbeater.cc:344] Connected to a master server at 127.19.108.62:33267
I20260709 12:15:19.868990 20048 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:19.869398 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-1-root/instance:
uuid: "7efda11f49cb4bc383b03ad8583c85c8"
format_stamp: "Formatted at 2026-07-09 12:15:19 on dist-test-slave-0g1j"
I20260709 12:15:19.870100 20048 heartbeater.cc:507] Master 127.19.108.62:33267 requested a full tablet report, sending...
I20260709 12:15:19.873392 19920 ts_manager.cc:194] Registered new tserver with Master: ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933)
I20260709 12:15:19.875880 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:15:19.876005 19920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56062
I20260709 12:15:19.880934 20060 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:19.881739 19888 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:15:19.881999 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-1-root
uuid: "7efda11f49cb4bc383b03ad8583c85c8"
format_stamp: "Formatted at 2026-07-09 12:15:19 on dist-test-slave-0g1j"
I20260709 12:15:19.882289 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:19.911034 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:19.912240 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:19.913513 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:19.916471 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:19.916672 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:19.916880 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:19.917028 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:20.000093 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.2:37337
I20260709 12:15:20.000231 20122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.2:37337 every 8 connection(s)
I20260709 12:15:20.006459 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:20.014067 20126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:20.023914 20127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:20.025700 20129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:20.025911 20123 heartbeater.cc:344] Connected to a master server at 127.19.108.62:33267
I20260709 12:15:20.026008 19888 server_base.cc:1061] running on GCE node
I20260709 12:15:20.027338 20123 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:20.027978 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:15:20.028045 20123 heartbeater.cc:507] Master 127.19.108.62:33267 requested a full tablet report, sending...
W20260709 12:15:20.028270 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:20.028493 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599320028475 us; error 0 us; skew 500 ppm
I20260709 12:15:20.029235 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:20.029939 19920 ts_manager.cc:194] Registered new tserver with Master: 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:20.031379 19920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56076
I20260709 12:15:20.032099 19888 webserver.cc:533] Webserver started at http://127.19.108.3:37603/ using document root <none> and password file <none>
I20260709 12:15:20.032711 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:20.032945 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:20.033246 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:20.034541 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-2-root/instance:
uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
format_stamp: "Formatted at 2026-07-09 12:15:20 on dist-test-slave-0g1j"
I20260709 12:15:20.039925 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:20.043622 20134 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:20.044349 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:15:20.044668 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-2-root
uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
format_stamp: "Formatted at 2026-07-09 12:15:20 on dist-test-slave-0g1j"
I20260709 12:15:20.045006 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599318085381-19888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:20.076159 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:20.077301 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:20.079224 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:20.082166 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:20.082405 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:20.082721 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:20.082952 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:20.162987 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.3:35551
I20260709 12:15:20.163136 20196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.3:35551 every 8 connection(s)
I20260709 12:15:20.178653 20197 heartbeater.cc:344] Connected to a master server at 127.19.108.62:33267
I20260709 12:15:20.178997 20197 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:20.179699 20197 heartbeater.cc:507] Master 127.19.108.62:33267 requested a full tablet report, sending...
I20260709 12:15:20.181488 19920 ts_manager.cc:194] Registered new tserver with Master: c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:20.182020 19888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014237852s
I20260709 12:15:20.183069 19920 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56092
I20260709 12:15:20.230021 19920 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56102:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:20.233371 19920 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:20.345750 20162 tablet_service.cc:1511] Processing CreateTablet for tablet d87704241ab544af9fbc360cb4e56d76 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:20.347431 20162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87704241ab544af9fbc360cb4e56d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.347327 20013 tablet_service.cc:1511] Processing CreateTablet for tablet d87704241ab544af9fbc360cb4e56d76 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:20.348023 20012 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6572fc47b3416cb913205f2f5497e2 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:20.348637 20013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87704241ab544af9fbc360cb4e56d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.349255 20012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6572fc47b3416cb913205f2f5497e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.354292 20011 tablet_service.cc:1511] Processing CreateTablet for tablet fa7db5656d654408bf0b6c84178ed0a6 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:20.358256 20011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa7db5656d654408bf0b6c84178ed0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.359002 20161 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6572fc47b3416cb913205f2f5497e2 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:20.355516 20160 tablet_service.cc:1511] Processing CreateTablet for tablet fa7db5656d654408bf0b6c84178ed0a6 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:20.360472 20010 tablet_service.cc:1511] Processing CreateTablet for tablet 74d4d276fe1f4f9093c80e4389975c5d (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:20.362031 20159 tablet_service.cc:1511] Processing CreateTablet for tablet 74d4d276fe1f4f9093c80e4389975c5d (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:20.364477 20010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d4d276fe1f4f9093c80e4389975c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.362944 20160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa7db5656d654408bf0b6c84178ed0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.366498 20161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6572fc47b3416cb913205f2f5497e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.368151 20009 tablet_service.cc:1511] Processing CreateTablet for tablet b5bea183de184f9c99eb328fbbde8707 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:20.368927 20159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d4d276fe1f4f9093c80e4389975c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.370021 20009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bea183de184f9c99eb328fbbde8707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.382825 20088 tablet_service.cc:1511] Processing CreateTablet for tablet d87704241ab544af9fbc360cb4e56d76 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:20.381954 20087 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6572fc47b3416cb913205f2f5497e2 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:20.389259 20084 tablet_service.cc:1511] Processing CreateTablet for tablet b5bea183de184f9c99eb328fbbde8707 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:20.390393 20087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6572fc47b3416cb913205f2f5497e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.384945 20086 tablet_service.cc:1511] Processing CreateTablet for tablet fa7db5656d654408bf0b6c84178ed0a6 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:20.391466 20158 tablet_service.cc:1511] Processing CreateTablet for tablet b5bea183de184f9c99eb328fbbde8707 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:20.392387 20085 tablet_service.cc:1511] Processing CreateTablet for tablet 74d4d276fe1f4f9093c80e4389975c5d (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:20.394052 20088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87704241ab544af9fbc360cb4e56d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.394304 20158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bea183de184f9c99eb328fbbde8707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.418661 20086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa7db5656d654408bf0b6c84178ed0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.421924 20008 tablet_service.cc:1511] Processing CreateTablet for tablet 9b274075a20a4f4f84e2178e92a62910 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:20.423889 20008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b274075a20a4f4f84e2178e92a62910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.423947 20084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bea183de184f9c99eb328fbbde8707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.430034 20085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d4d276fe1f4f9093c80e4389975c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.435396 20083 tablet_service.cc:1511] Processing CreateTablet for tablet 9b274075a20a4f4f84e2178e92a62910 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:20.450883 20083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b274075a20a4f4f84e2178e92a62910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.460722 20157 tablet_service.cc:1511] Processing CreateTablet for tablet 9b274075a20a4f4f84e2178e92a62910 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:20.462952 20007 tablet_service.cc:1511] Processing CreateTablet for tablet 7d14337468d94566834825eacb870769 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:20.485308 20157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b274075a20a4f4f84e2178e92a62910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.487455 20082 tablet_service.cc:1511] Processing CreateTablet for tablet 7d14337468d94566834825eacb870769 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:20.491434 20007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d14337468d94566834825eacb870769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.489702 20156 tablet_service.cc:1511] Processing CreateTablet for tablet 7d14337468d94566834825eacb870769 (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:20.495730 20082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d14337468d94566834825eacb870769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.495776 20156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d14337468d94566834825eacb870769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.531805 20216 tablet_bootstrap.cc:492] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747: Bootstrap starting.
I20260709 12:15:20.537751 20215 tablet_bootstrap.cc:492] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8: Bootstrap starting.
I20260709 12:15:20.549156 20012 tablet_service.cc:1511] Processing CreateTablet for tablet cf7dfd58ca434a299fd4b95d9086b1ea (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:20.550891 20012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7dfd58ca434a299fd4b95d9086b1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.556031 20157 tablet_service.cc:1511] Processing CreateTablet for tablet cf7dfd58ca434a299fd4b95d9086b1ea (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:20.557184 20157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7dfd58ca434a299fd4b95d9086b1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.564256 20217 tablet_bootstrap.cc:492] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8: Bootstrap starting.
I20260709 12:15:20.575436 20082 tablet_service.cc:1511] Processing CreateTablet for tablet 25d515fbed834a628c71933fe108e4da (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:20.576514 20082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d515fbed834a628c71933fe108e4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.576251 20007 tablet_service.cc:1511] Processing CreateTablet for tablet 25d515fbed834a628c71933fe108e4da (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:20.577324 20007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d515fbed834a628c71933fe108e4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.578310 20159 tablet_service.cc:1511] Processing CreateTablet for tablet 25d515fbed834a628c71933fe108e4da (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:20.583069 20159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d515fbed834a628c71933fe108e4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.591951 20215 tablet_bootstrap.cc:654] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:20.597292 19968 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:20.601925 20217 tablet_bootstrap.cc:654] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.602486 20216 tablet_bootstrap.cc:654] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.590610 20085 tablet_service.cc:1511] Processing CreateTablet for tablet cf7dfd58ca434a299fd4b95d9086b1ea (DEFAULT_TABLE table=test-workload [id=aefa9d2a7b374920a4d377ed731e28ae]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:20.620515 20085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7dfd58ca434a299fd4b95d9086b1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.622959 20215 tablet_bootstrap.cc:492] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8: No bootstrap required, opened a new log
I20260709 12:15:20.635519 20215 ts_tablet_manager.cc:1403] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.012s
I20260709 12:15:20.637787 20217 tablet_bootstrap.cc:492] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8: No bootstrap required, opened a new log
I20260709 12:15:20.638214 20217 ts_tablet_manager.cc:1403] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8: Time spent bootstrapping tablet: real 0.076s	user 0.005s	sys 0.013s
I20260709 12:15:20.646238 20217 raft_consensus.cc:359] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.647001 20217 raft_consensus.cc:385] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.647359 20217 raft_consensus.cc:740] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.648254 20217 consensus_queue.cc:260] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.651752 20123 heartbeater.cc:499] Master 127.19.108.62:33267 was elected leader, sending a full tablet report...
I20260709 12:15:20.651491 20215 raft_consensus.cc:359] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.652199 20215 raft_consensus.cc:385] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.652459 20215 raft_consensus.cc:740] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.652820 20216 tablet_bootstrap.cc:492] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747: No bootstrap required, opened a new log
I20260709 12:15:20.653218 20216 ts_tablet_manager.cc:1403] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent bootstrapping tablet: real 0.122s	user 0.005s	sys 0.010s
I20260709 12:15:20.653100 20215 consensus_queue.cc:260] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.656090 20217 ts_tablet_manager.cc:1434] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.006s
I20260709 12:15:20.655943 20216 raft_consensus.cc:359] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.656754 20216 raft_consensus.cc:385] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.657086 20217 tablet_bootstrap.cc:492] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8: Bootstrap starting.
I20260709 12:15:20.657099 20216 raft_consensus.cc:740] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.658200 20216 consensus_queue.cc:260] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.664094 20217 tablet_bootstrap.cc:654] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.667455 20216 ts_tablet_manager.cc:1434] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent starting tablet: real 0.014s	user 0.013s	sys 0.001s
I20260709 12:15:20.668135 20197 heartbeater.cc:499] Master 127.19.108.62:33267 was elected leader, sending a full tablet report...
W20260709 12:15:20.671880 20198 tablet.cc:2406] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:20.673285 20216 tablet_bootstrap.cc:492] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747: Bootstrap starting.
I20260709 12:15:20.680691 20216 tablet_bootstrap.cc:654] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.682231 20048 heartbeater.cc:499] Master 127.19.108.62:33267 was elected leader, sending a full tablet report...
I20260709 12:15:20.683130 20215 ts_tablet_manager.cc:1434] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.009s
I20260709 12:15:20.684005 20215 tablet_bootstrap.cc:492] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8: Bootstrap starting.
I20260709 12:15:20.693073 20217 tablet_bootstrap.cc:492] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8: No bootstrap required, opened a new log
I20260709 12:15:20.693564 20217 ts_tablet_manager.cc:1403] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.004s
I20260709 12:15:20.698011 20217 raft_consensus.cc:359] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.698751 20217 raft_consensus.cc:385] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.699116 20217 raft_consensus.cc:740] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.700663 20215 tablet_bootstrap.cc:654] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.700842 20217 consensus_queue.cc:260] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.705288 20217 ts_tablet_manager.cc:1434] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.005s
I20260709 12:15:20.705544 20216 tablet_bootstrap.cc:492] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747: No bootstrap required, opened a new log
I20260709 12:15:20.706894 20217 tablet_bootstrap.cc:492] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8: Bootstrap starting.
I20260709 12:15:20.713251 20216 ts_tablet_manager.cc:1403] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.012s
I20260709 12:15:20.716025 20216 raft_consensus.cc:359] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.716739 20216 raft_consensus.cc:385] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.716881 20217 tablet_bootstrap.cc:654] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.717048 20216 raft_consensus.cc:740] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.719345 20216 consensus_queue.cc:260] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.722472 20216 ts_tablet_manager.cc:1434] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:15:20.723356 20216 tablet_bootstrap.cc:492] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747: Bootstrap starting.
I20260709 12:15:20.727203 20217 tablet_bootstrap.cc:492] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8: No bootstrap required, opened a new log
I20260709 12:15:20.727681 20217 ts_tablet_manager.cc:1403] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 12:15:20.729398 20216 tablet_bootstrap.cc:654] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.730360 20217 raft_consensus.cc:359] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.731191 20217 raft_consensus.cc:385] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.731521 20217 raft_consensus.cc:740] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.732435 20217 consensus_queue.cc:260] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.733503 20215 tablet_bootstrap.cc:492] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8: No bootstrap required, opened a new log
I20260709 12:15:20.733974 20215 ts_tablet_manager.cc:1403] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.003s
I20260709 12:15:20.736704 20215 raft_consensus.cc:359] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.737413 20215 raft_consensus.cc:385] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.737739 20215 raft_consensus.cc:740] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.738440 20215 consensus_queue.cc:260] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.740393 20215 ts_tablet_manager.cc:1434] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:20.740499 20217 ts_tablet_manager.cc:1434] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:15:20.741381 20215 tablet_bootstrap.cc:492] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8: Bootstrap starting.
I20260709 12:15:20.748101 20215 tablet_bootstrap.cc:654] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.753253 20217 tablet_bootstrap.cc:492] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8: Bootstrap starting.
I20260709 12:15:20.754746 20222 raft_consensus.cc:493] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.755218 20222 raft_consensus.cc:515] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.759840 20217 tablet_bootstrap.cc:654] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.759961 20222 leader_election.cc:290] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:20.760486 20215 tablet_bootstrap.cc:492] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8: No bootstrap required, opened a new log
I20260709 12:15:20.761902 20215 ts_tablet_manager.cc:1403] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 12:15:20.764787 20216 tablet_bootstrap.cc:492] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747: No bootstrap required, opened a new log
I20260709 12:15:20.764708 20215 raft_consensus.cc:359] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.765285 20216 ts_tablet_manager.cc:1403] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.010s
I20260709 12:15:20.765478 20215 raft_consensus.cc:385] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.765792 20215 raft_consensus.cc:740] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.766485 20215 consensus_queue.cc:260] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.768168 20216 raft_consensus.cc:359] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.768775 20215 ts_tablet_manager.cc:1434] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:15:20.768909 20216 raft_consensus.cc:385] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.769284 20216 raft_consensus.cc:740] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.769713 20215 tablet_bootstrap.cc:492] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8: Bootstrap starting.
I20260709 12:15:20.770016 20216 consensus_queue.cc:260] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.776365 20216 ts_tablet_manager.cc:1434] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:15:20.777674 20216 tablet_bootstrap.cc:492] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747: Bootstrap starting.
I20260709 12:15:20.784010 20216 tablet_bootstrap.cc:654] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.788988 20215 tablet_bootstrap.cc:654] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.792752 20217 tablet_bootstrap.cc:492] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8: No bootstrap required, opened a new log
I20260709 12:15:20.793210 20217 ts_tablet_manager.cc:1403] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.005s
I20260709 12:15:20.795195 20216 tablet_bootstrap.cc:492] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747: No bootstrap required, opened a new log
I20260709 12:15:20.795680 20216 ts_tablet_manager.cc:1403] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:15:20.795917 20217 raft_consensus.cc:359] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.796589 20217 raft_consensus.cc:385] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.796871 20217 raft_consensus.cc:740] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.797520 20217 consensus_queue.cc:260] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.799413 20216 raft_consensus.cc:359] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.801239 20216 raft_consensus.cc:385] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.801106 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8" is_pre_election: true
I20260709 12:15:20.801668 20216 raft_consensus.cc:740] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.801924 20098 raft_consensus.cc:2468] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 0.
I20260709 12:15:20.802424 20215 tablet_bootstrap.cc:492] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8: No bootstrap required, opened a new log
I20260709 12:15:20.802896 20215 ts_tablet_manager.cc:1403] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.001s
I20260709 12:15:20.802587 20216 consensus_queue.cc:260] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.803369 19989 leader_election.cc:304] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:20.805191 20216 ts_tablet_manager.cc:1434] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:15:20.805421 20222 raft_consensus.cc:2804] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:20.805756 20222 raft_consensus.cc:493] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.806094 20222 raft_consensus.cc:3060] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.806241 20216 tablet_bootstrap.cc:492] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747: Bootstrap starting.
I20260709 12:15:20.806967 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:20.807621 20172 raft_consensus.cc:2468] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 0.
I20260709 12:15:20.812335 20217 ts_tablet_manager.cc:1434] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:15:20.812484 20216 tablet_bootstrap.cc:654] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.813395 20217 tablet_bootstrap.cc:492] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8: Bootstrap starting.
I20260709 12:15:20.819989 20217 tablet_bootstrap.cc:654] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.823535 20216 tablet_bootstrap.cc:492] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747: No bootstrap required, opened a new log
I20260709 12:15:20.823455 20222 raft_consensus.cc:515] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.824016 20216 ts_tablet_manager.cc:1403] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:15:20.825685 20222 leader_election.cc:290] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:20.826572 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:20.828351 20098 raft_consensus.cc:3060] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.826913 20216 raft_consensus.cc:359] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.827579 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:20.831091 20216 raft_consensus.cc:385] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.831229 20172 raft_consensus.cc:3060] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.831408 20216 raft_consensus.cc:740] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.832170 20216 consensus_queue.cc:260] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.833503 20098 raft_consensus.cc:2468] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 1.
I20260709 12:15:20.834537 19989 leader_election.cc:304] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:20.837285 20222 raft_consensus.cc:2804] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:20.837740 20172 raft_consensus.cc:2468] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 1.
I20260709 12:15:20.827706 20215 raft_consensus.cc:359] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.838737 20215 raft_consensus.cc:385] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.839040 20215 raft_consensus.cc:740] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.839776 20215 consensus_queue.cc:260] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.841254 20217 tablet_bootstrap.cc:492] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8: No bootstrap required, opened a new log
I20260709 12:15:20.841724 20217 ts_tablet_manager.cc:1403] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.000s
I20260709 12:15:20.840485 20216 ts_tablet_manager.cc:1434] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:15:20.844882 20217 raft_consensus.cc:359] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.846091 20222 raft_consensus.cc:697] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Becoming Leader. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:20.846611 20216 tablet_bootstrap.cc:492] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747: Bootstrap starting.
I20260709 12:15:20.847270 20222 consensus_queue.cc:237] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.849805 20223 raft_consensus.cc:493] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.850242 20223 raft_consensus.cc:515] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.852679 20223 leader_election.cc:290] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:20.854502 20216 tablet_bootstrap.cc:654] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.846222 20217 raft_consensus.cc:385] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.855990 20217 raft_consensus.cc:740] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.856719 20217 consensus_queue.cc:260] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.859253 20217 ts_tablet_manager.cc:1434] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:15:20.862666 20217 tablet_bootstrap.cc:492] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8: Bootstrap starting.
I20260709 12:15:20.872467 20217 tablet_bootstrap.cc:654] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.877388 20215 ts_tablet_manager.cc:1434] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.004s
I20260709 12:15:20.878374 20215 tablet_bootstrap.cc:492] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8: Bootstrap starting.
I20260709 12:15:20.879119 20216 tablet_bootstrap.cc:492] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747: No bootstrap required, opened a new log
I20260709 12:15:20.879817 20216 ts_tablet_manager.cc:1403] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 12:15:20.882869 20216 raft_consensus.cc:359] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.886557 20216 raft_consensus.cc:385] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.887252 20216 raft_consensus.cc:740] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.888676 20216 consensus_queue.cc:260] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.891999 20216 ts_tablet_manager.cc:1434] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 12:15:20.894340 20216 tablet_bootstrap.cc:492] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747: Bootstrap starting.
I20260709 12:15:20.900799 20216 tablet_bootstrap.cc:654] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.911979 20221 raft_consensus.cc:493] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.912563 20221 raft_consensus.cc:515] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.917184 20221 leader_election.cc:290] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:20.917102 19918 catalog_manager.cc:5697] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad34594620564711ac3d61ce9f399ae8 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "ad34594620564711ac3d61ce9f399ae8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.924948 20217 tablet_bootstrap.cc:492] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8: No bootstrap required, opened a new log
I20260709 12:15:20.925379 20217 ts_tablet_manager.cc:1403] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8: Time spent bootstrapping tablet: real 0.065s	user 0.000s	sys 0.039s
I20260709 12:15:20.928077 20217 raft_consensus.cc:359] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.928761 20217 raft_consensus.cc:385] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.929040 20217 raft_consensus.cc:740] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.929719 20217 consensus_queue.cc:260] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.933071 20217 ts_tablet_manager.cc:1434] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:20.936914 20217 tablet_bootstrap.cc:492] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8: Bootstrap starting.
I20260709 12:15:20.940981 20215 tablet_bootstrap.cc:654] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.944190 20216 tablet_bootstrap.cc:492] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747: No bootstrap required, opened a new log
I20260709 12:15:20.944916 20222 raft_consensus.cc:493] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.945503 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8" is_pre_election: true
I20260709 12:15:20.944612 20216 ts_tablet_manager.cc:1403] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.010s
I20260709 12:15:20.945340 20222 raft_consensus.cc:515] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.946094 20098 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 0.
I20260709 12:15:20.948333 20138 leader_election.cc:304] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:20.948952 20222 leader_election.cc:290] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:20.949298 20223 raft_consensus.cc:2804] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:20.949635 20223 raft_consensus.cc:493] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.949944 20223 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.950249 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8" is_pre_election: true
I20260709 12:15:20.951333 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:20.951910 20172 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 0.
W20260709 12:15:20.952211 19989 leader_election.cc:343] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.954303 19986 leader_election.cc:304] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:20.955825 20222 raft_consensus.cc:2804] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:20.956192 20222 raft_consensus.cc:493] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.956845 20222 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.970479 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:20.971273 20023 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 0.
I20260709 12:15:20.974901 20222 raft_consensus.cc:515] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.976213 20216 raft_consensus.cc:359] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.976948 20216 raft_consensus.cc:385] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.977234 20216 raft_consensus.cc:740] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.979676 20223 raft_consensus.cc:515] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:20.981365 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:20.982493 20223 leader_election.cc:290] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:20.983150 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:20.983528 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:20.984099 20098 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.983662 20172 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.981494 20222 leader_election.cc:290] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:20.985767 20221 raft_consensus.cc:493] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.986950 20221 raft_consensus.cc:515] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
W20260709 12:15:20.986660 20063 leader_election.cc:343] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.987562 20097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:20.989132 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:20.989974 20023 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.984220 20216 consensus_queue.cc:260] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
W20260709 12:15:20.990583 19989 leader_election.cc:343] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.993268 20216 ts_tablet_manager.cc:1434] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 12:15:20.994896 20217 tablet_bootstrap.cc:654] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.994994 20221 leader_election.cc:290] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:20.997175 20022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:20.998745 20216 tablet_bootstrap.cc:492] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747: Bootstrap starting.
I20260709 12:15:21.000253 20172 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 1.
W20260709 12:15:20.999028 20063 leader_election.cc:343] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:21.000509 20098 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 1.
I20260709 12:15:21.002756 20023 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 1.
I20260709 12:15:21.006799 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:21.008533 20170 raft_consensus.cc:2468] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 0.
I20260709 12:15:21.009009 20215 tablet_bootstrap.cc:492] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8: No bootstrap required, opened a new log
I20260709 12:15:21.008873 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:21.007339 19986 leader_election.cc:304] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:21.013206 20215 ts_tablet_manager.cc:1403] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.003s
I20260709 12:15:21.011315 20138 leader_election.cc:304] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:21.015048 20222 raft_consensus.cc:2804] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.014111 20171 raft_consensus.cc:2468] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 0.
I20260709 12:15:21.016296 20061 leader_election.cc:304] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:21.017431 20223 raft_consensus.cc:2804] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.018923 20222 raft_consensus.cc:697] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Becoming Leader. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:21.020826 20061 leader_election.cc:304] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:21.020352 20221 raft_consensus.cc:2804] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.022122 20221 raft_consensus.cc:493] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.022701 20221 raft_consensus.cc:3060] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.026000 20222 consensus_queue.cc:237] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.030918 20215 raft_consensus.cc:359] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.031586 20215 raft_consensus.cc:385] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.031868 20215 raft_consensus.cc:740] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.032526 20215 consensus_queue.cc:260] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.032843 20221 raft_consensus.cc:515] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.034729 20221 leader_election.cc:290] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.035241 20221 raft_consensus.cc:2804] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.035565 20221 raft_consensus.cc:493] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.035605 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:21.037168 20215 ts_tablet_manager.cc:1434] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
W20260709 12:15:21.038249 20063 leader_election.cc:343] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:21.036576 20221 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.039705 20215 tablet_bootstrap.cc:492] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8: Bootstrap starting.
I20260709 12:15:21.040904 20238 raft_consensus.cc:493] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.041394 20238 raft_consensus.cc:515] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.043675 20238 leader_election.cc:290] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.044718 20223 raft_consensus.cc:697] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Becoming Leader. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:21.051308 20223 consensus_queue.cc:237] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.054164 20216 tablet_bootstrap.cc:654] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.063676 20252 raft_consensus.cc:493] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.064168 20252 raft_consensus.cc:515] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.066330 20252 leader_election.cc:290] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:21.066653 20215 tablet_bootstrap.cc:654] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:21.071652 20061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:35551, user_credentials={real_user=slave}} blocked reactor thread for 50885us
I20260709 12:15:21.076918 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8" is_pre_election: true
I20260709 12:15:21.078817 20254 raft_consensus.cc:493] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:21.078945 20137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:43933, user_credentials={real_user=slave}} blocked reactor thread for 64080.9us
I20260709 12:15:21.081743 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
W20260709 12:15:21.081861 20138 leader_election.cc:343] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:21.081893 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:21.082088 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:21.082317 20171 raft_consensus.cc:3060] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.082576 20170 raft_consensus.cc:2468] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 0.
I20260709 12:15:21.082912 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8" is_pre_election: true
W20260709 12:15:21.084815 20137 leader_election.cc:343] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:21.079396 20254 raft_consensus.cc:515] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.085453 19986 leader_election.cc:304] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:21.085549 20137 leader_election.cc:304] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:21.088325 20222 raft_consensus.cc:2804] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.090781 20255 raft_consensus.cc:2749] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:21.091511 20217 tablet_bootstrap.cc:492] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8: No bootstrap required, opened a new log
I20260709 12:15:21.091946 20217 ts_tablet_manager.cc:1403] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent bootstrapping tablet: real 0.155s	user 0.003s	sys 0.016s
I20260709 12:15:21.089564 20222 raft_consensus.cc:493] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.094866 20222 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.095388 20171 raft_consensus.cc:2468] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 1.
I20260709 12:15:21.091233 20252 raft_consensus.cc:493] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.098676 20252 raft_consensus.cc:515] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.103263 20254 leader_election.cc:290] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.103783 20061 leader_election.cc:304] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:21.105417 20022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d14337468d94566834825eacb870769" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:21.106068 20022 raft_consensus.cc:2468] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 0.
I20260709 12:15:21.104214 20252 leader_election.cc:290] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:21.103968 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d14337468d94566834825eacb870769" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:21.102473 20217 raft_consensus.cc:359] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.105212 20097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d14337468d94566834825eacb870769" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8" is_pre_election: true
I20260709 12:15:21.107239 20217 raft_consensus.cc:385] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.107432 20097 raft_consensus.cc:2468] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 0.
I20260709 12:15:21.107549 20217 raft_consensus.cc:740] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.108698 20138 leader_election.cc:304] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:21.109443 20252 raft_consensus.cc:2804] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.109783 20252 raft_consensus.cc:493] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.110105 20252 raft_consensus.cc:3060] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.108804 20221 raft_consensus.cc:515] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.118129 20252 raft_consensus.cc:515] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.120978 20098 raft_consensus.cc:2393] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad34594620564711ac3d61ce9f399ae8 in current term 1: Already voted for candidate 7efda11f49cb4bc383b03ad8583c85c8 in this term.
I20260709 12:15:21.122426 20221 leader_election.cc:290] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.119942 20254 raft_consensus.cc:2804] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.121379 20217 consensus_queue.cc:260] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.119745 20023 raft_consensus.cc:2468] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 0.
I20260709 12:15:21.124591 20022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:21.127527 20021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d14337468d94566834825eacb870769" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:21.128384 20252 leader_election.cc:290] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:21.129475 20215 tablet_bootstrap.cc:492] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8: No bootstrap required, opened a new log
I20260709 12:15:21.129580 20097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d14337468d94566834825eacb870769" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:21.129601 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:21.130111 20097 raft_consensus.cc:3060] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.129930 20215 ts_tablet_manager.cc:1403] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.000s
I20260709 12:15:21.128504 20063 leader_election.cc:304] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:21.128350 20021 raft_consensus.cc:3060] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.126217 20254 raft_consensus.cc:697] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:21.130304 20170 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.128301 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d14337468d94566834825eacb870769" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:21.133038 20254 consensus_queue.cc:237] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.137383 20171 raft_consensus.cc:2393] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7efda11f49cb4bc383b03ad8583c85c8 in current term 1: Already voted for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in this term.
I20260709 12:15:21.137578 20222 raft_consensus.cc:515] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.139545 20022 raft_consensus.cc:2393] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7efda11f49cb4bc383b03ad8583c85c8 in current term 1: Already voted for candidate ad34594620564711ac3d61ce9f399ae8 in this term.
I20260709 12:15:21.140494 20222 leader_election.cc:290] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.138432 20215 raft_consensus.cc:359] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.139545 20217 ts_tablet_manager.cc:1434] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.008s
I20260709 12:15:21.142737 20216 tablet_bootstrap.cc:492] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747: No bootstrap required, opened a new log
I20260709 12:15:21.143185 20216 ts_tablet_manager.cc:1403] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent bootstrapping tablet: real 0.145s	user 0.016s	sys 0.007s
I20260709 12:15:21.141896 20215 raft_consensus.cc:385] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.143530 20096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:21.144049 20215 raft_consensus.cc:740] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.146236 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:21.146720 20217 tablet_bootstrap.cc:492] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8: Bootstrap starting.
I20260709 12:15:21.147586 20216 raft_consensus.cc:359] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.148409 20216 raft_consensus.cc:385] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.148224 19986 leader_election.cc:304] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8; no voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747
I20260709 12:15:21.148798 20216 raft_consensus.cc:740] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.146425 20215 consensus_queue.cc:260] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.150285 20216 consensus_queue.cc:260] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.151178 20170 raft_consensus.cc:2468] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 1.
I20260709 12:15:21.149291 20222 raft_consensus.cc:2749] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:21.153133 20215 ts_tablet_manager.cc:1434] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:15:21.153059 20061 leader_election.cc:304] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:21.155427 20216 ts_tablet_manager.cc:1434] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:15:21.156301 20221 raft_consensus.cc:2804] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.157274 20021 raft_consensus.cc:2468] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 1.
I20260709 12:15:21.158080 20215 tablet_bootstrap.cc:492] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8: Bootstrap starting.
I20260709 12:15:21.158375 20137 leader_election.cc:304] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:21.159128 20252 raft_consensus.cc:493] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.159296 20216 tablet_bootstrap.cc:492] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747: Bootstrap starting.
I20260709 12:15:21.159659 20252 raft_consensus.cc:515] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.161175 20223 raft_consensus.cc:2804] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.162390 20223 raft_consensus.cc:697] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Becoming Leader. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:21.162387 20021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d515fbed834a628c71933fe108e4da" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:21.162755 20096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d515fbed834a628c71933fe108e4da" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8" is_pre_election: true
I20260709 12:15:21.163309 20223 consensus_queue.cc:237] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
W20260709 12:15:21.163738 20137 leader_election.cc:343] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:21.161616 20252 leader_election.cc:290] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:21.157558 20097 raft_consensus.cc:2468] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 1.
W20260709 12:15:21.164234 20138 leader_election.cc:343] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:21.167537 20256 raft_consensus.cc:2764] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:15:21.161504 20217 tablet_bootstrap.cc:654] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.167187 20138 leader_election.cc:304] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:21.170078 20252 raft_consensus.cc:2749] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:21.171020 20221 raft_consensus.cc:697] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:21.172066 20221 consensus_queue.cc:237] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.183898 20216 tablet_bootstrap.cc:654] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.201061 19918 catalog_manager.cc:5697] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.202071 20217 tablet_bootstrap.cc:492] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8: No bootstrap required, opened a new log
I20260709 12:15:21.202487 20217 ts_tablet_manager.cc:1403] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.008s
I20260709 12:15:21.203063 19920 catalog_manager.cc:5697] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 reported cstate change: term changed from 0 to 1, leader changed from <none> to c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:21.208492 20217 raft_consensus.cc:359] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.209208 20217 raft_consensus.cc:385] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.209556 20217 raft_consensus.cc:740] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.210263 20217 consensus_queue.cc:260] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.212404 20217 ts_tablet_manager.cc:1434] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:15:21.213294 20217 tablet_bootstrap.cc:492] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8: Bootstrap starting.
I20260709 12:15:21.218343 20215 tablet_bootstrap.cc:654] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.223479 19919 catalog_manager.cc:5697] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad34594620564711ac3d61ce9f399ae8 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "ad34594620564711ac3d61ce9f399ae8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.231680 20217 tablet_bootstrap.cc:654] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.237340 20216 tablet_bootstrap.cc:492] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747: No bootstrap required, opened a new log
I20260709 12:15:21.237748 20216 ts_tablet_manager.cc:1403] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.009s
I20260709 12:15:21.240180 20216 raft_consensus.cc:359] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.240823 20216 raft_consensus.cc:385] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.241086 20216 raft_consensus.cc:740] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.241709 20216 consensus_queue.cc:260] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.243824 20216 ts_tablet_manager.cc:1434] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 12:15:21.243387 19918 catalog_manager.cc:5697] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 reported cstate change: term changed from 0 to 1, leader changed from <none> to c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:21.244635 20217 tablet_bootstrap.cc:492] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8: No bootstrap required, opened a new log
I20260709 12:15:21.245015 20217 ts_tablet_manager.cc:1403] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.001s
I20260709 12:15:21.247470 20215 tablet_bootstrap.cc:492] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8: No bootstrap required, opened a new log
I20260709 12:15:21.247910 20215 ts_tablet_manager.cc:1403] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.010s
I20260709 12:15:21.248013 20217 raft_consensus.cc:359] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.248667 20217 raft_consensus.cc:385] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.248924 20217 raft_consensus.cc:740] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.249276 20222 consensus_queue.cc:1048] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.249529 20217 consensus_queue.cc:260] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.251011 20215 raft_consensus.cc:359] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.251684 20215 raft_consensus.cc:385] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.251864 20217 ts_tablet_manager.cc:1434] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:21.251977 20215 raft_consensus.cc:740] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.252760 20215 consensus_queue.cc:260] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.255276 20215 ts_tablet_manager.cc:1434] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:15:21.257118 20215 tablet_bootstrap.cc:492] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8: Bootstrap starting.
I20260709 12:15:21.258064 19920 catalog_manager.cc:5697] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.263033 20215 tablet_bootstrap.cc:654] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.275990 20222 consensus_queue.cc:1048] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.290599 20215 tablet_bootstrap.cc:492] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8: No bootstrap required, opened a new log
I20260709 12:15:21.291015 20215 ts_tablet_manager.cc:1403] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.014s
I20260709 12:15:21.293787 20215 raft_consensus.cc:359] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.294374 20215 raft_consensus.cc:385] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.294728 20215 raft_consensus.cc:740] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.295324 20215 consensus_queue.cc:260] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.297345 20215 ts_tablet_manager.cc:1434] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:21.298086 20215 tablet_bootstrap.cc:492] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8: Bootstrap starting.
I20260709 12:15:21.303227 20215 tablet_bootstrap.cc:654] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.317685 20215 tablet_bootstrap.cc:492] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8: No bootstrap required, opened a new log
I20260709 12:15:21.318081 20215 ts_tablet_manager.cc:1403] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:15:21.320356 20215 raft_consensus.cc:359] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.320993 20215 raft_consensus.cc:385] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.321244 20215 raft_consensus.cc:740] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.321797 20215 consensus_queue.cc:260] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.323606 20215 ts_tablet_manager.cc:1434] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:15:21.356323 20256 raft_consensus.cc:493] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.356833 20256 raft_consensus.cc:515] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.358351 20256 leader_election.cc:290] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.359054 20022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7dfd58ca434a299fd4b95d9086b1ea" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:21.359328 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7dfd58ca434a299fd4b95d9086b1ea" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:21.359699 20022 raft_consensus.cc:2468] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 0.
I20260709 12:15:21.359834 20170 raft_consensus.cc:2468] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 0.
I20260709 12:15:21.360687 20063 leader_election.cc:304] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:21.361398 20256 raft_consensus.cc:2804] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.361666 20256 raft_consensus.cc:493] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.361918 20256 raft_consensus.cc:3060] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.365949 20256 raft_consensus.cc:515] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.367926 20256 leader_election.cc:290] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.368103 20022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7dfd58ca434a299fd4b95d9086b1ea" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:21.368664 20022 raft_consensus.cc:3060] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.368880 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7dfd58ca434a299fd4b95d9086b1ea" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:21.369755 20170 raft_consensus.cc:3060] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.372570 20256 raft_consensus.cc:493] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.373059 20256 raft_consensus.cc:515] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.374387 20170 raft_consensus.cc:2468] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 1.
I20260709 12:15:21.375398 20256 leader_election.cc:290] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.375478 20061 leader_election.cc:304] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:21.375618 20021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:21.376454 20256 raft_consensus.cc:2804] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.377132 20256 raft_consensus.cc:697] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:21.377832 20022 raft_consensus.cc:2468] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 1.
I20260709 12:15:21.377871 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:21.378343 20221 raft_consensus.cc:493] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.378774 20221 raft_consensus.cc:515] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.377951 20256 consensus_queue.cc:237] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.378788 20170 raft_consensus.cc:2393] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7efda11f49cb4bc383b03ad8583c85c8 in current term 1: Already voted for candidate ad34594620564711ac3d61ce9f399ae8 in this term.
I20260709 12:15:21.380501 20061 leader_election.cc:304] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8; no voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747
I20260709 12:15:21.381045 20221 leader_election.cc:290] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.381672 20221 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.383073 20022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d515fbed834a628c71933fe108e4da" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8" is_pre_election: true
I20260709 12:15:21.383219 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d515fbed834a628c71933fe108e4da" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:21.384394 20170 raft_consensus.cc:2468] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 0.
I20260709 12:15:21.383769 20022 raft_consensus.cc:2468] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 0.
I20260709 12:15:21.385676 20061 leader_election.cc:304] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:21.386538 20263 raft_consensus.cc:2804] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.386914 20263 raft_consensus.cc:493] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.387247 20263 raft_consensus.cc:3060] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.388209 20221 raft_consensus.cc:2749] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:21.392804 19919 catalog_manager.cc:5697] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.393234 20263 raft_consensus.cc:515] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.395941 20022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d515fbed834a628c71933fe108e4da" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:21.396214 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d515fbed834a628c71933fe108e4da" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:21.396510 20022 raft_consensus.cc:3060] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.396757 20170 raft_consensus.cc:3060] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.400573 20263 leader_election.cc:290] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.403409 20022 raft_consensus.cc:2468] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 1.
I20260709 12:15:21.404090 20170 raft_consensus.cc:2468] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 1.
I20260709 12:15:21.404362 20063 leader_election.cc:304] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:21.405270 20263 raft_consensus.cc:2804] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.405627 20263 raft_consensus.cc:697] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:21.406307 20263 consensus_queue.cc:237] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.413589 19919 catalog_manager.cc:5697] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.567860 20222 raft_consensus.cc:493] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.568286 20222 raft_consensus.cc:515] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.570057 20222 leader_election.cc:290] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.571251 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:21.571251 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8" is_pre_election: true
I20260709 12:15:21.571762 20223 consensus_queue.cc:1048] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.571965 20170 raft_consensus.cc:2468] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 0.
I20260709 12:15:21.571995 20098 raft_consensus.cc:2468] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 0.
I20260709 12:15:21.573207 19986 leader_election.cc:304] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:21.573439 20222 raft_consensus.cc:493] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.573848 20222 raft_consensus.cc:515] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.574273 20238 raft_consensus.cc:2804] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.574612 20238 raft_consensus.cc:493] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.574935 20238 raft_consensus.cc:3060] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.575814 20222 leader_election.cc:290] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.576402 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8" is_pre_election: true
I20260709 12:15:21.577821 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" is_pre_election: true
I20260709 12:15:21.578511 20170 raft_consensus.cc:2393] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad34594620564711ac3d61ce9f399ae8 in current term 1: Already voted for candidate 7efda11f49cb4bc383b03ad8583c85c8 in this term.
I20260709 12:15:21.580854 19986 leader_election.cc:304] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8; no voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747
I20260709 12:15:21.581108 20238 raft_consensus.cc:515] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.582726 20222 raft_consensus.cc:3060] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.583554 20238 leader_election.cc:290] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:21.584139 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:21.584664 20098 raft_consensus.cc:3060] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.584684 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:21.586676 20170 raft_consensus.cc:3060] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.591226 20223 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.592056 20098 raft_consensus.cc:2468] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 1.
I20260709 12:15:21.592530 20170 raft_consensus.cc:2468] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 1.
I20260709 12:15:21.593119 19989 leader_election.cc:304] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:21.593859 20238 raft_consensus.cc:2804] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.594295 20238 raft_consensus.cc:697] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Becoming Leader. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:21.595053 20238 consensus_queue.cc:237] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:21.597144 20222 raft_consensus.cc:2749] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:21.606760 20223 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.615661 20223 consensus_queue.cc:1048] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:21.616803 19968 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:21.625846 20263 consensus_queue.cc:1048] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.633466 20237 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:21.638710 19917 catalog_manager.cc:5697] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad34594620564711ac3d61ce9f399ae8 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "ad34594620564711ac3d61ce9f399ae8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.642148 20238 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:15:21.650679 20263 consensus_queue.cc:1048] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.651149 20256 consensus_queue.cc:1048] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.682511 20263 consensus_queue.cc:1048] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.808561 20221 consensus_queue.cc:1048] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.818466 20254 consensus_queue.cc:1048] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.885355 20172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2"
dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
mode: GRACEFUL
new_leader_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:35782
I20260709 12:15:21.885900 20172 raft_consensus.cc:606] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Received request to transfer leadership to TS ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:21.897923 20097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
mode: GRACEFUL
new_leader_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:41772
I20260709 12:15:21.898366 20097 raft_consensus.cc:606] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Received request to transfer leadership to TS ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:21.903067 20097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
mode: GRACEFUL
new_leader_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:41772
I20260709 12:15:21.903520 20097 raft_consensus.cc:606] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Received request to transfer leadership to TS ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:21.915498 20022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
mode: GRACEFUL
new_leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:35298
I20260709 12:15:21.915943 20022 raft_consensus.cc:606] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Received request to transfer leadership to TS 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:21.920224 20022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
mode: GRACEFUL
new_leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:35298
I20260709 12:15:21.920635 20022 raft_consensus.cc:606] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Received request to transfer leadership to TS 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:21.924816 20172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d14337468d94566834825eacb870769"
dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
mode: GRACEFUL
new_leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:35782
I20260709 12:15:21.925230 20172 raft_consensus.cc:606] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Received request to transfer leadership to TS 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:21.931605 20097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25d515fbed834a628c71933fe108e4da"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
mode: GRACEFUL
new_leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:41772
I20260709 12:15:21.932004 20097 raft_consensus.cc:606] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Received request to transfer leadership to TS c960a4ac9d4f4032a7c7f715eb3e5747
I20260709 12:15:21.993104 20254 consensus_queue.cc:1048] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.999519 20256 raft_consensus.cc:993] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8: : Instructing follower c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:21.999926 20256 raft_consensus.cc:1081] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Signalling peer c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:22.001953 20170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25d515fbed834a628c71933fe108e4da"
dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:35768
I20260709 12:15:22.002993 20170 raft_consensus.cc:493] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:22.003402 20170 raft_consensus.cc:3060] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.008554 20254 consensus_queue.cc:1048] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:22.011554 20170 raft_consensus.cc:515] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.016212 20170 leader_election.cc:290] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 2 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:22.016146 20021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d515fbed834a628c71933fe108e4da" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:22.018222 20097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d515fbed834a628c71933fe108e4da" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:22.019040 20097 raft_consensus.cc:3055] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:22.019495 20097 raft_consensus.cc:740] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:22.020586 20097 consensus_queue.cc:260] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.021718 20097 raft_consensus.cc:3060] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.028395 20097 raft_consensus.cc:2468] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 2.
I20260709 12:15:22.029570 20138 leader_election.cc:304] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:22.031625 20252 raft_consensus.cc:2804] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:22.032075 20252 raft_consensus.cc:697] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 LEADER]: Becoming Leader. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:22.032859 20252 consensus_queue.cc:237] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.044574 19916 catalog_manager.cc:5697] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 reported cstate change: term changed from 1 to 2, leader changed from 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2) to c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:22.050583 20237 consensus_queue.cc:1048] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:22.059645 20287 raft_consensus.cc:993] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8: : Instructing follower 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:22.060070 20287 raft_consensus.cc:1081] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Signalling peer 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:22.062341 20098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:41756
I20260709 12:15:22.068400 20222 consensus_queue.cc:1048] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:22.071221 20223 raft_consensus.cc:993] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747: : Instructing follower ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:22.071704 20252 raft_consensus.cc:1081] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Signalling peer ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:22.073134 20098 raft_consensus.cc:493] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:22.073545 20098 raft_consensus.cc:3060] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.075169 20022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:35280
I20260709 12:15:22.075699 20022 raft_consensus.cc:493] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:22.076061 20022 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.080008 20237 raft_consensus.cc:993] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8: : Instructing follower 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:22.080437 20238 raft_consensus.cc:1081] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Signalling peer 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:22.083596 20097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:41756
I20260709 12:15:22.084151 20098 raft_consensus.cc:515] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.084144 20097 raft_consensus.cc:493] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:22.088277 20097 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.090229 20022 raft_consensus.cc:515] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.092908 20096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:22.093441 20096 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.098906 20021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:22.099462 20021 raft_consensus.cc:3055] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:22.099763 20021 raft_consensus.cc:740] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:22.100476 20021 consensus_queue.cc:260] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.101322 20021 raft_consensus.cc:3060] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.103235 20098 leader_election.cc:290] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 2 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:22.094503 20097 raft_consensus.cc:515] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.106138 20097 leader_election.cc:290] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 2 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:22.106357 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:22.107366 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:22.108018 20171 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.108475 20023 raft_consensus.cc:3055] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:22.108887 20023 raft_consensus.cc:740] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:22.109843 20023 consensus_queue.cc:260] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.107429 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:22.113372 20023 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.116171 20171 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 2.
I20260709 12:15:22.117393 20061 leader_election.cc:304] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:22.118700 20254 raft_consensus.cc:2804] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:22.119207 20254 raft_consensus.cc:697] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:22.120054 20252 raft_consensus.cc:993] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747: : Instructing follower 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:22.119984 20254 consensus_queue.cc:237] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.120481 20255 raft_consensus.cc:1081] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Signalling peer 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:22.122130 20098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d14337468d94566834825eacb870769"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:41758
I20260709 12:15:22.122618 20098 raft_consensus.cc:493] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:22.122982 20098 raft_consensus.cc:3060] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.129071 20098 raft_consensus.cc:515] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.136591 20096 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 2.
I20260709 12:15:22.137727 20020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d14337468d94566834825eacb870769" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:22.138440 20020 raft_consensus.cc:3060] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.140192 20021 raft_consensus.cc:2468] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 2.
I20260709 12:15:22.141059 20098 leader_election.cc:290] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 2 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:22.143472 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:22.143867 20022 leader_election.cc:290] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 2 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:22.144071 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d14337468d94566834825eacb870769" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:22.144081 20170 raft_consensus.cc:3055] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:22.144658 20172 raft_consensus.cc:3055] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:22.145081 20172 raft_consensus.cc:740] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:22.145229 20023 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 2.
I20260709 12:15:22.145880 20172 consensus_queue.cc:260] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.146639 19989 leader_election.cc:304] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:22.147416 20237 raft_consensus.cc:2804] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:22.147879 20237 raft_consensus.cc:697] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Becoming Leader. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:22.148685 20237 consensus_queue.cc:237] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.149195 20020 raft_consensus.cc:2468] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 2.
I20260709 12:15:22.149824 20063 leader_election.cc:304] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: c960a4ac9d4f4032a7c7f715eb3e5747
I20260709 12:15:22.144618 20170 raft_consensus.cc:740] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:22.152524 20170 consensus_queue.cc:260] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.153659 20170 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.154153 20063 leader_election.cc:304] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:22.154943 20254 raft_consensus.cc:2804] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:22.155038 20172 raft_consensus.cc:3060] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.155143 20256 raft_consensus.cc:2804] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:22.156054 20256 raft_consensus.cc:697] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:22.156818 20256 consensus_queue.cc:237] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.157624 19915 catalog_manager.cc:5697] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 reported cstate change: term changed from 1 to 2, leader changed from c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3) to ad34594620564711ac3d61ce9f399ae8 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "ad34594620564711ac3d61ce9f399ae8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.160382 20254 raft_consensus.cc:697] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:22.161157 20254 consensus_queue.cc:237] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.162992 19916 catalog_manager.cc:5697] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 1 to 2, leader changed from ad34594620564711ac3d61ce9f399ae8 (127.19.108.1) to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.161149 20172 raft_consensus.cc:2468] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 2.
I20260709 12:15:22.170378 20170 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 2.
I20260709 12:15:22.177490 19916 catalog_manager.cc:5697] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 1 to 2, leader changed from ad34594620564711ac3d61ce9f399ae8 (127.19.108.1) to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.179167 19916 catalog_manager.cc:5697] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 1 to 2, leader changed from c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3) to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.187705 20254 raft_consensus.cc:993] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8: : Instructing follower ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:22.188936 20256 raft_consensus.cc:1081] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Signalling peer ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:22.190176 20020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:15:22.190587 20020 raft_consensus.cc:493] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:22.190888 20020 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.195056 20020 raft_consensus.cc:515] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.196686 20020 leader_election.cc:290] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 2 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:22.197321 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:22.197693 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:22.197860 20098 raft_consensus.cc:3055] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:22.198246 20170 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.198215 20098 raft_consensus.cc:740] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:22.199173 20098 consensus_queue.cc:260] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.200317 20098 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.202517 20170 raft_consensus.cc:2468] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 2.
I20260709 12:15:22.203420 19986 leader_election.cc:304] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:22.204001 20237 raft_consensus.cc:2804] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:22.204355 20237 raft_consensus.cc:697] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Becoming Leader. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:22.205101 20237 consensus_queue.cc:237] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.206372 20098 raft_consensus.cc:2468] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 2.
I20260709 12:15:22.212271 19916 catalog_manager.cc:5697] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 reported cstate change: term changed from 1 to 2, leader changed from 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2) to ad34594620564711ac3d61ce9f399ae8 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "ad34594620564711ac3d61ce9f399ae8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.262266 20254 raft_consensus.cc:993] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8: : Instructing follower ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:22.262699 20256 raft_consensus.cc:1081] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Signalling peer ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:22.263995 20020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:15:22.264421 20020 raft_consensus.cc:493] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:22.264704 20020 raft_consensus.cc:3060] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.269147 20020 raft_consensus.cc:515] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.270632 20020 leader_election.cc:290] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 2 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:22.271229 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:22.271580 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:22.271710 20098 raft_consensus.cc:3055] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:22.272012 20098 raft_consensus.cc:740] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:22.272047 20170 raft_consensus.cc:3060] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.272791 20098 consensus_queue.cc:260] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.273777 20098 raft_consensus.cc:3060] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.276932 20170 raft_consensus.cc:2468] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 2.
I20260709 12:15:22.277725 19986 leader_election.cc:304] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:22.278304 20237 raft_consensus.cc:2804] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:22.278322 20098 raft_consensus.cc:2468] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 2.
I20260709 12:15:22.278887 20237 raft_consensus.cc:697] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Becoming Leader. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:22.279659 20237 consensus_queue.cc:237] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:22.285540 19916 catalog_manager.cc:5697] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 reported cstate change: term changed from 1 to 2, leader changed from 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2) to ad34594620564711ac3d61ce9f399ae8 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "ad34594620564711ac3d61ce9f399ae8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.531288 20098 raft_consensus.cc:1275] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.532341 20223 consensus_queue.cc:1048] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.538578 20020 raft_consensus.cc:1275] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.539407 20023 raft_consensus.cc:3060] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.540031 20256 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.547355 20023 raft_consensus.cc:1275] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.549242 20223 consensus_queue.cc:1048] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.550316 20170 raft_consensus.cc:1275] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.552771 20256 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:22.602818 20098 raft_consensus.cc:1275] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.603881 20237 consensus_queue.cc:1048] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.610486 20170 raft_consensus.cc:1275] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.611912 20237 consensus_queue.cc:1048] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.626603 20098 raft_consensus.cc:1275] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.627619 20237 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.636006 20170 raft_consensus.cc:1275] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.637538 20237 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.679502 20020 raft_consensus.cc:1275] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.680814 20221 consensus_queue.cc:1048] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.682211 20020 raft_consensus.cc:1275] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.683389 20221 consensus_queue.cc:1048] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.688980 20170 raft_consensus.cc:1275] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.692179 20170 raft_consensus.cc:3060] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:22.692312 20221 consensus_queue.cc:1048] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.701216 20170 raft_consensus.cc:1275] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.702751 20221 consensus_queue.cc:1048] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.705945 20098 raft_consensus.cc:1275] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.709477 20237 consensus_queue.cc:1048] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.718647 20172 raft_consensus.cc:1275] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.719854 20303 consensus_queue.cc:1048] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:24.956866 19888 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:15:24.957576 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:24.975718 20020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
mode: GRACEFUL
new_leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:35308
I20260709 12:15:24.976166 20020 raft_consensus.cc:606] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Received request to transfer leadership to TS c960a4ac9d4f4032a7c7f715eb3e5747
I20260709 12:15:24.984958 20098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
mode: GRACEFUL
new_leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:41786
I20260709 12:15:24.985394 20098 raft_consensus.cc:606] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Received request to transfer leadership to TS c960a4ac9d4f4032a7c7f715eb3e5747
I20260709 12:15:24.986369 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:24.986757 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:25.005548 20303 raft_consensus.cc:993] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8: : Instructing follower c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:25.005911 20314 raft_consensus.cc:1081] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Signalling peer c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:25.007145 20172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2"
dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:35754
I20260709 12:15:25.007556 20172 raft_consensus.cc:493] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.007830 20172 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.011901 20172 raft_consensus.cc:515] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:25.013571 20172 leader_election.cc:290] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 3 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:25.014174 20020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:25.014546 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:25.014870 20020 raft_consensus.cc:3055] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:25.015175 20020 raft_consensus.cc:740] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:25.015237 20098 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.015986 20020 consensus_queue.cc:260] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:25.017134 20020 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.021404 20098 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 3.
I20260709 12:15:25.022405 20138 leader_election.cc:304] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:25.022903 20020 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 3.
I20260709 12:15:25.023007 20223 raft_consensus.cc:2804] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:25.024097 20223 raft_consensus.cc:697] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Becoming Leader. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:25.024806 20223 consensus_queue.cc:237] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:25.030431 19916 catalog_manager.cc:5697] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 reported cstate change: term changed from 2 to 3, leader changed from ad34594620564711ac3d61ce9f399ae8 (127.19.108.1) to c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.084829 20254 raft_consensus.cc:993] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8: : Instructing follower c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:25.085232 20321 raft_consensus.cc:1081] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Signalling peer c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:25.086427 20170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910"
dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:35768
I20260709 12:15:25.086896 20170 raft_consensus.cc:493] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.087188 20170 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.091244 20170 raft_consensus.cc:515] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:25.092722 20170 leader_election.cc:290] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 3 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:25.093344 20020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:25.093611 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:25.093827 20020 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.094135 20098 raft_consensus.cc:3055] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:25.094478 20098 raft_consensus.cc:740] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:25.095157 20098 consensus_queue.cc:260] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:25.095974 20098 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.098106 20020 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 3.
I20260709 12:15:25.098932 20137 leader_election.cc:304] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:25.099494 20223 raft_consensus.cc:2804] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:25.099839 20223 raft_consensus.cc:697] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Becoming Leader. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:25.100113 20098 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 3.
I20260709 12:15:25.100517 20223 consensus_queue.cc:237] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:25.106545 19916 catalog_manager.cc:5697] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 reported cstate change: term changed from 2 to 3, leader changed from 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2) to c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.444263 20098 raft_consensus.cc:1275] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:25.445349 20223 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:25.454668 20020 raft_consensus.cc:1275] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:25.455849 20315 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:25.548775 20098 raft_consensus.cc:1275] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:25.549718 20326 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:25.556720 20020 raft_consensus.cc:1275] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:25.558480 20223 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:25.987522 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:25.992142 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:25.992441 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:26.993168 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:26.998119 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:26.998428 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:27.999193 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:28.003921 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:28.004325 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:29.005249 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:29.009946 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:29.010255 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:30.011121 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.016161 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:30.016623 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:31.017482 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:31.022153 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:31.022490 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:32.023406 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:32.028421 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:32.028808 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:33.029583 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:33.034186 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:33.034533 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:34.035388 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:34.040066 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:34.040402 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:35.064714 19888 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:15:35.069382 20023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
mode: GRACEFUL
new_leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:35298
I20260709 12:15:35.070144 20023 raft_consensus.cc:606] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Received request to transfer leadership to TS 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:35.074985 20170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2"
dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
mode: GRACEFUL
new_leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:35782
I20260709 12:15:35.075366 20170 raft_consensus.cc:606] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Received request to transfer leadership to TS 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:35.079707 20023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
mode: GRACEFUL
new_leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:35298
I20260709 12:15:35.080235 20023 raft_consensus.cc:606] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Received request to transfer leadership to TS 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:35.084400 20023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
mode: GRACEFUL
new_leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:35298
I20260709 12:15:35.084823 20023 raft_consensus.cc:606] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Received request to transfer leadership to TS 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:35.095930 20170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910"
dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
mode: GRACEFUL
new_leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:35782
I20260709 12:15:35.096319 20170 raft_consensus.cc:606] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Received request to transfer leadership to TS 7efda11f49cb4bc383b03ad8583c85c8
I20260709 12:15:35.161353 20314 raft_consensus.cc:993] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8: : Instructing follower 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.161767 20334 raft_consensus.cc:1081] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Signalling peer 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.163064 20098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:41756
I20260709 12:15:35.163465 20098 raft_consensus.cc:493] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.163750 20098 raft_consensus.cc:3060] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.167919 20098 raft_consensus.cc:515] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.169381 20098 leader_election.cc:290] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 2 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:35.170083 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:35.170387 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:35.170688 20023 raft_consensus.cc:3055] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.170807 20170 raft_consensus.cc:3060] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.171006 20023 raft_consensus.cc:740] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:35.171706 20023 consensus_queue.cc:260] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.172703 20023 raft_consensus.cc:3060] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.175442 20170 raft_consensus.cc:2468] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 2.
I20260709 12:15:35.176570 20061 leader_election.cc:304] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:35.177382 20321 raft_consensus.cc:2804] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:35.178220 20321 raft_consensus.cc:697] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:35.178740 20023 raft_consensus.cc:2468] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 2.
I20260709 12:15:35.179028 20321 consensus_queue.cc:237] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.185474 19916 catalog_manager.cc:5697] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 1 to 2, leader changed from ad34594620564711ac3d61ce9f399ae8 (127.19.108.1) to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.202065 20314 raft_consensus.cc:993] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8: : Instructing follower 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.202391 20334 raft_consensus.cc:1081] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Signalling peer 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.203557 20098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:41756
I20260709 12:15:35.203909 20098 raft_consensus.cc:493] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.204142 20098 raft_consensus.cc:3060] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:35.207659 20098 raft_consensus.cc:515] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.208961 20098 leader_election.cc:290] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 3 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:35.209522 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:35.209836 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d4d276fe1f4f9093c80e4389975c5d" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:35.209970 20023 raft_consensus.cc:3055] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:35.210246 20170 raft_consensus.cc:3060] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:35.210248 20023 raft_consensus.cc:740] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:35.210994 20023 consensus_queue.cc:260] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.211802 20023 raft_consensus.cc:3060] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:35.213802 20170 raft_consensus.cc:2468] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 3.
I20260709 12:15:35.214581 20061 leader_election.cc:304] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:35.215291 20321 raft_consensus.cc:2804] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:35.215602 20321 raft_consensus.cc:697] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:35.216213 20023 raft_consensus.cc:2468] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 3.
I20260709 12:15:35.216282 20321 consensus_queue.cc:237] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.222033 19916 catalog_manager.cc:5697] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 2 to 3, leader changed from ad34594620564711ac3d61ce9f399ae8 (127.19.108.1) to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 3 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.278942 20223 raft_consensus.cc:993] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747: : Instructing follower 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.279381 20342 raft_consensus.cc:1081] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Signalling peer 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.280571 20098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:41758
I20260709 12:15:35.280939 20098 raft_consensus.cc:493] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.281154 20098 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:35.285161 20098 raft_consensus.cc:515] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.286338 20098 leader_election.cc:290] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 4 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:35.286940 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:35.287307 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:35.287436 20023 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:35.287840 20170 raft_consensus.cc:3055] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:35.288069 20170 raft_consensus.cc:740] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:35.288600 20170 consensus_queue.cc:260] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.289351 20170 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:35.292099 20023 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 4.
I20260709 12:15:35.293205 20063 leader_election.cc:304] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:35.293838 20321 raft_consensus.cc:2804] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:35.293823 20170 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 4.
I20260709 12:15:35.294339 20321 raft_consensus.cc:697] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:35.295099 20321 consensus_queue.cc:237] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.300407 19916 catalog_manager.cc:5697] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 3 to 4, leader changed from c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3) to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 4 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.408071 20223 raft_consensus.cc:993] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747: : Instructing follower 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.408437 20342 raft_consensus.cc:1081] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Signalling peer 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.409603 20098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:41758
I20260709 12:15:35.409958 20098 raft_consensus.cc:493] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.410167 20098 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:35.413827 20098 raft_consensus.cc:515] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.415066 20098 leader_election.cc:290] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 4 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:35.415654 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:35.416023 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:35.416137 20023 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:35.416438 20170 raft_consensus.cc:3055] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:35.416669 20170 raft_consensus.cc:740] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:35.417161 20170 consensus_queue.cc:260] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.417917 20170 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:35.420264 20023 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 4.
I20260709 12:15:35.421044 20063 leader_election.cc:304] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, ad34594620564711ac3d61ce9f399ae8; no voters: 
I20260709 12:15:35.421600 20321 raft_consensus.cc:2804] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:35.421669 20170 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 4.
I20260709 12:15:35.421926 20321 raft_consensus.cc:697] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:35.422652 20321 consensus_queue.cc:237] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.428023 19916 catalog_manager.cc:5697] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 3 to 4, leader changed from c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3) to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 4 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.487258 20314 raft_consensus.cc:993] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8: : Instructing follower 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.487620 20334 raft_consensus.cc:1081] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Signalling peer 7efda11f49cb4bc383b03ad8583c85c8 to start an election
I20260709 12:15:35.488818 20098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
 from {username='slave'} at 127.0.0.1:41756
I20260709 12:15:35.489168 20098 raft_consensus.cc:493] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.489374 20098 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:35.492936 20098 raft_consensus.cc:515] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.494272 20098 leader_election.cc:290] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 3 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:35.495086 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:35.495154 20023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "7efda11f49cb4bc383b03ad8583c85c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:35.495507 20170 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:35.495621 20023 raft_consensus.cc:3055] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:35.495923 20023 raft_consensus.cc:740] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:35.496479 20023 consensus_queue.cc:260] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.497324 20023 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:35.499320 20170 raft_consensus.cc:2468] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 3.
I20260709 12:15:35.500138 20061 leader_election.cc:304] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7efda11f49cb4bc383b03ad8583c85c8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:35.500833 20321 raft_consensus.cc:2804] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:35.501144 20321 raft_consensus.cc:697] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 LEADER]: Becoming Leader. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:35.501814 20023 raft_consensus.cc:2468] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7efda11f49cb4bc383b03ad8583c85c8 in term 3.
I20260709 12:15:35.501803 20321 consensus_queue.cc:237] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:35.507853 19916 catalog_manager.cc:5697] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 reported cstate change: term changed from 2 to 3, leader changed from ad34594620564711ac3d61ce9f399ae8 (127.19.108.1) to 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2). New cstate: current_term: 3 leader_uuid: "7efda11f49cb4bc383b03ad8583c85c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.625470 20023 raft_consensus.cc:1275] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:35.626494 20321 consensus_queue.cc:1048] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:35.635215 20170 raft_consensus.cc:1275] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:35.636699 20321 consensus_queue.cc:1048] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:35.687676 20023 raft_consensus.cc:1275] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:35.688867 20348 consensus_queue.cc:1048] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:35.696419 20170 raft_consensus.cc:1275] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:35.697850 20321 consensus_queue.cc:1048] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:35.829213 20170 raft_consensus.cc:1275] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:35.830096 20321 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:35.838645 20023 raft_consensus.cc:1275] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:35.839824 20348 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:35.915028 20023 raft_consensus.cc:1275] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:35.915956 20348 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:35.922703 20170 raft_consensus.cc:1275] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:35.924279 20321 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:35.972576 20023 raft_consensus.cc:1275] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:35.973529 20321 consensus_queue.cc:1048] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:35.981940 20170 raft_consensus.cc:1275] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Refusing update from remote peer 7efda11f49cb4bc383b03ad8583c85c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:35.984623 20321 consensus_queue.cc:1048] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:38.253074 19888 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:15:38.253729 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:38.259694 20098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
mode: GRACEFUL
new_leader_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:41786
I20260709 12:15:38.260064 20098 raft_consensus.cc:606] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Received request to transfer leadership to TS ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:38.261935 20098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
mode: GRACEFUL
new_leader_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:41786
I20260709 12:15:38.262276 20098 raft_consensus.cc:606] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Received request to transfer leadership to TS ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:38.263912 20098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
mode: GRACEFUL
new_leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:41786
I20260709 12:15:38.264237 20098 raft_consensus.cc:606] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Received request to transfer leadership to TS c960a4ac9d4f4032a7c7f715eb3e5747
I20260709 12:15:38.265934 20098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
mode: GRACEFUL
new_leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:41786
I20260709 12:15:38.266256 20098 raft_consensus.cc:606] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Received request to transfer leadership to TS c960a4ac9d4f4032a7c7f715eb3e5747
I20260709 12:15:38.267894 20098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6"
dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
mode: GRACEFUL
new_leader_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:41786
I20260709 12:15:38.268213 20098 raft_consensus.cc:606] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 LEADER]: Received request to transfer leadership to TS ad34594620564711ac3d61ce9f399ae8
I20260709 12:15:38.268961 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:38.269274 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:38.305683 20360 raft_consensus.cc:993] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8: : Instructing follower c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:38.306262 20335 raft_consensus.cc:1081] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Signalling peer c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:38.307641 20170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707"
dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:35768
I20260709 12:15:38.308105 20170 raft_consensus.cc:493] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.308362 20170 raft_consensus.cc:3060] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.313007 20170 raft_consensus.cc:515] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.315225 20170 leader_election.cc:290] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 3 election: Requested vote from peers ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933), 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337)
I20260709 12:15:38.316570 20020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:38.317227 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bea183de184f9c99eb328fbbde8707" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:38.317543 20020 raft_consensus.cc:3060] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.317734 20098 raft_consensus.cc:3055] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:38.318130 20098 raft_consensus.cc:740] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:38.318922 20098 consensus_queue.cc:260] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.320010 20098 raft_consensus.cc:3060] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.322754 20020 raft_consensus.cc:2468] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 3.
I20260709 12:15:38.323869 20137 leader_election.cc:304] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:38.324306 20098 raft_consensus.cc:2468] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 3.
I20260709 12:15:38.324985 20342 raft_consensus.cc:2804] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:38.326210 20342 raft_consensus.cc:697] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Becoming Leader. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:38.327216 20342 consensus_queue.cc:237] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.328414 20360 raft_consensus.cc:993] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8: : Instructing follower ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:38.328861 20335 raft_consensus.cc:1081] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 LEADER]: Signalling peer ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:38.330300 20020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:15:38.330765 20020 raft_consensus.cc:493] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.331130 20020 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:38.335323 20020 raft_consensus.cc:515] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.337248 20020 leader_election.cc:290] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 4 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:38.338168 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:38.338397 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa7db5656d654408bf0b6c84178ed0a6" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:38.338698 20098 raft_consensus.cc:3055] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:38.339017 20170 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:38.339054 20098 raft_consensus.cc:740] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:38.339993 20098 consensus_queue.cc:260] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.341352 20098 raft_consensus.cc:3060] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:38.342308 19917 catalog_manager.cc:5697] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 reported cstate change: term changed from 2 to 3, leader changed from 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2) to c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:38.345140 20170 raft_consensus.cc:2468] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 4.
I20260709 12:15:38.346539 19986 leader_election.cc:304] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:38.347044 20098 raft_consensus.cc:2468] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 4.
I20260709 12:15:38.348529 20366 raft_consensus.cc:2804] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:38.349701 20366 raft_consensus.cc:697] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 4 LEADER]: Becoming Leader. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:38.350668 20366 consensus_queue.cc:237] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.359359 19916 catalog_manager.cc:5697] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 reported cstate change: term changed from 3 to 4, leader changed from 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2) to ad34594620564711ac3d61ce9f399ae8 (127.19.108.1). New cstate: current_term: 4 leader_uuid: "ad34594620564711ac3d61ce9f399ae8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.438549 20360 raft_consensus.cc:993] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8: : Instructing follower ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:38.438977 20335 raft_consensus.cc:1081] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Signalling peer ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:38.440369 20020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:15:38.440826 20020 raft_consensus.cc:493] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.441084 20020 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:38.445178 20020 raft_consensus.cc:515] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.446419 20020 leader_election.cc:290] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 5 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:38.447129 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:38.447389 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b274075a20a4f4f84e2178e92a62910" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:38.447633 20098 raft_consensus.cc:3055] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:38.447913 20170 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:38.447940 20098 raft_consensus.cc:740] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:38.448797 20098 consensus_queue.cc:260] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.449878 20098 raft_consensus.cc:3060] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:38.453621 20170 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 5.
I20260709 12:15:38.454500 19986 leader_election.cc:304] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:38.455070 20098 raft_consensus.cc:2468] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 5.
I20260709 12:15:38.455137 20366 raft_consensus.cc:2804] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:38.455528 20366 raft_consensus.cc:697] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 5 LEADER]: Becoming Leader. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:38.456364 20366 consensus_queue.cc:237] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.463037 19916 catalog_manager.cc:5697] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 reported cstate change: term changed from 4 to 5, leader changed from 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2) to ad34594620564711ac3d61ce9f399ae8 (127.19.108.1). New cstate: current_term: 5 leader_uuid: "ad34594620564711ac3d61ce9f399ae8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.497893 20335 raft_consensus.cc:993] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8: : Instructing follower c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:38.498291 20360 raft_consensus.cc:1081] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Signalling peer c960a4ac9d4f4032a7c7f715eb3e5747 to start an election
I20260709 12:15:38.499477 20170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76"
dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
 from {username='slave'} at 127.0.0.1:35768
I20260709 12:15:38.499830 20170 raft_consensus.cc:493] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.500065 20170 raft_consensus.cc:3060] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.503481 20170 raft_consensus.cc:515] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.504693 20170 leader_election.cc:290] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 3 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933)
I20260709 12:15:38.505436 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:38.505555 20020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87704241ab544af9fbc360cb4e56d76" candidate_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
I20260709 12:15:38.505925 20098 raft_consensus.cc:3055] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:38.506000 20020 raft_consensus.cc:3060] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.506258 20098 raft_consensus.cc:740] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:38.506951 20098 consensus_queue.cc:260] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.508023 20098 raft_consensus.cc:3060] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.511507 20020 raft_consensus.cc:2468] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 3.
I20260709 12:15:38.512368 20137 leader_election.cc:304] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:38.512965 20342 raft_consensus.cc:2804] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:38.513370 20098 raft_consensus.cc:2468] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c960a4ac9d4f4032a7c7f715eb3e5747 in term 3.
I20260709 12:15:38.513412 20342 raft_consensus.cc:697] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Becoming Leader. State: Replica: c960a4ac9d4f4032a7c7f715eb3e5747, State: Running, Role: LEADER
I20260709 12:15:38.514408 20342 consensus_queue.cc:237] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.520442 19916 catalog_manager.cc:5697] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 reported cstate change: term changed from 2 to 3, leader changed from 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2) to c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:38.560506 20335 raft_consensus.cc:993] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8: : Instructing follower ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:38.560869 20360 raft_consensus.cc:1081] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Signalling peer ad34594620564711ac3d61ce9f399ae8 to start an election
I20260709 12:15:38.561940 20020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2"
dest_uuid: "ad34594620564711ac3d61ce9f399ae8"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:15:38.562305 20020 raft_consensus.cc:493] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.562603 20020 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:38.566252 20020 raft_consensus.cc:515] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.567446 20020 leader_election.cc:290] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 5 election: Requested vote from peers 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337), c960a4ac9d4f4032a7c7f715eb3e5747 (127.19.108.3:35551)
I20260709 12:15:38.568012 20098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7efda11f49cb4bc383b03ad8583c85c8"
I20260709 12:15:38.568357 20170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6572fc47b3416cb913205f2f5497e2" candidate_uuid: "ad34594620564711ac3d61ce9f399ae8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747"
I20260709 12:15:38.568506 20098 raft_consensus.cc:3055] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:38.568866 20170 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:38.568845 20098 raft_consensus.cc:740] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7efda11f49cb4bc383b03ad8583c85c8, State: Running, Role: LEADER
I20260709 12:15:38.569715 20098 consensus_queue.cc:260] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.570727 20098 raft_consensus.cc:3060] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:38.574425 20170 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 5.
I20260709 12:15:38.575327 19986 leader_election.cc:304] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34594620564711ac3d61ce9f399ae8, c960a4ac9d4f4032a7c7f715eb3e5747; no voters: 
I20260709 12:15:38.575929 20098 raft_consensus.cc:2468] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad34594620564711ac3d61ce9f399ae8 in term 5.
I20260709 12:15:38.575929 20366 raft_consensus.cc:2804] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:38.576596 20366 raft_consensus.cc:697] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 5 LEADER]: Becoming Leader. State: Replica: ad34594620564711ac3d61ce9f399ae8, State: Running, Role: LEADER
I20260709 12:15:38.577502 20366 consensus_queue.cc:237] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } }
I20260709 12:15:38.583144 19916 catalog_manager.cc:5697] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 reported cstate change: term changed from 4 to 5, leader changed from 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2) to ad34594620564711ac3d61ce9f399ae8 (127.19.108.1). New cstate: current_term: 5 leader_uuid: "ad34594620564711ac3d61ce9f399ae8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.783367 20020 raft_consensus.cc:1275] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:38.784395 20342 consensus_queue.cc:1048] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:38.796334 20098 raft_consensus.cc:1275] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:38.801668 20378 consensus_queue.cc:1048] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:38.811216 20098 raft_consensus.cc:1275] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:38.812245 20366 consensus_queue.cc:1048] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:38.820020 20170 raft_consensus.cc:1275] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:38.821218 20366 consensus_queue.cc:1048] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:38.897010 20020 raft_consensus.cc:1275] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:38.897928 20342 consensus_queue.cc:1048] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34594620564711ac3d61ce9f399ae8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:38.905522 20098 raft_consensus.cc:1275] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Refusing update from remote peer c960a4ac9d4f4032a7c7f715eb3e5747: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:38.906955 20379 consensus_queue.cc:1048] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:38.955917 20098 raft_consensus.cc:1275] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 5 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:15:38.956903 20383 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:38.964293 20170 raft_consensus.cc:1275] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 5 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:15:38.966167 20368 consensus_queue.cc:1048] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:38.991324 20170 raft_consensus.cc:1275] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 5 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:15:38.992231 20368 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c960a4ac9d4f4032a7c7f715eb3e5747" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:38.999516 20098 raft_consensus.cc:1275] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 5 FOLLOWER]: Refusing update from remote peer ad34594620564711ac3d61ce9f399ae8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:15:39.000980 20383 consensus_queue.cc:1048] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7efda11f49cb4bc383b03ad8583c85c8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:15:39.164552 19951 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 19891
W20260709 12:15:39.165297 19951 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 19954
W20260709 12:15:39.166162 19951 debug-util.cc:398] Leaking SignalData structure 0x7b08000d16e0 after lost signal to thread 20047
W20260709 12:15:39.166920 19951 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3920 after lost signal to thread 20122
W20260709 12:15:39.167635 19951 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd620 after lost signal to thread 20196
I20260709 12:15:39.270469 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:39.275342 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:39.275695 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:40.276759 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:40.281514 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:40.281926 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:41.282764 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:41.287583 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:41.287932 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:42.288893 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:42.294118 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:42.294446 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:43.295296 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:43.299821 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:43.300143 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:44.300954 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:44.305593 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:44.305904 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:45.306818 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:45.311452 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:45.311796 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:46.312647 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:46.317195 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:46.317538 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:47.318423 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:47.323386 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:47.323753 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:48.352466 19888 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:15:48.353086 19888 tablet_server.cc:179] TabletServer@127.19.108.1:0 shutting down...
I20260709 12:15:48.377704 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:48.378700 19888 tablet_replica.cc:333] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8: stopping tablet replica
I20260709 12:15:48.379637 19888 raft_consensus.cc:2243] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.380364 19888 raft_consensus.cc:2272] T 25d515fbed834a628c71933fe108e4da P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.382771 19888 tablet_replica.cc:333] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8: stopping tablet replica
I20260709 12:15:48.383512 19888 raft_consensus.cc:2243] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.384035 19888 raft_consensus.cc:2272] T cf7dfd58ca434a299fd4b95d9086b1ea P ad34594620564711ac3d61ce9f399ae8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.385782 19888 tablet_replica.cc:333] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8: stopping tablet replica
I20260709 12:15:48.386421 19888 raft_consensus.cc:2243] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.387120 19888 raft_consensus.cc:2272] T 74d4d276fe1f4f9093c80e4389975c5d P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.388840 19888 tablet_replica.cc:333] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8: stopping tablet replica
I20260709 12:15:48.389477 19888 raft_consensus.cc:2243] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.390249 19888 raft_consensus.cc:2272] T b5bea183de184f9c99eb328fbbde8707 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.392673 19888 tablet_replica.cc:333] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8: stopping tablet replica
I20260709 12:15:48.393236 19888 raft_consensus.cc:2243] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.394378 19888 raft_consensus.cc:2272] T fa7db5656d654408bf0b6c84178ed0a6 P ad34594620564711ac3d61ce9f399ae8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.396431 19888 tablet_replica.cc:333] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8: stopping tablet replica
I20260709 12:15:48.397219 19888 raft_consensus.cc:2243] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.398424 19888 raft_consensus.cc:2272] T 9b274075a20a4f4f84e2178e92a62910 P ad34594620564711ac3d61ce9f399ae8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.400689 19888 tablet_replica.cc:333] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8: stopping tablet replica
I20260709 12:15:48.401320 19888 raft_consensus.cc:2243] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.401880 19888 raft_consensus.cc:2272] T d87704241ab544af9fbc360cb4e56d76 P ad34594620564711ac3d61ce9f399ae8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.404295 19888 tablet_replica.cc:333] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8: stopping tablet replica
I20260709 12:15:48.404753 19888 raft_consensus.cc:2243] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.405277 19888 raft_consensus.cc:2272] T 7d14337468d94566834825eacb870769 P ad34594620564711ac3d61ce9f399ae8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.407305 19888 tablet_replica.cc:333] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8: stopping tablet replica
I20260709 12:15:48.407689 19888 raft_consensus.cc:2243] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.408443 19888 raft_consensus.cc:2272] T 0a6572fc47b3416cb913205f2f5497e2 P ad34594620564711ac3d61ce9f399ae8 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:48.492372 20063 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.108.1:43933: connect: Connection refused (error 111)
W20260709 12:15:48.496034 20063 consensus_peers.cc:597] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 -> Peer ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933): Couldn't send request to peer ad34594620564711ac3d61ce9f399ae8. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:43933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.496767 19888 tablet_server.cc:196] TabletServer@127.19.108.1:0 shutdown complete.
I20260709 12:15:48.516049 19888 tablet_server.cc:179] TabletServer@127.19.108.2:0 shutting down...
W20260709 12:15:48.517910 20137 consensus_peers.cc:597] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 -> Peer ad34594620564711ac3d61ce9f399ae8 (127.19.108.1:43933): Couldn't send request to peer ad34594620564711ac3d61ce9f399ae8. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:43933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.543190 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:48.543875 19888 tablet_replica.cc:333] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8: stopping tablet replica
I20260709 12:15:48.544436 19888 raft_consensus.cc:2243] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.544873 19888 raft_consensus.cc:2272] T b5bea183de184f9c99eb328fbbde8707 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.546604 19888 tablet_replica.cc:333] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8: stopping tablet replica
I20260709 12:15:48.547137 19888 raft_consensus.cc:2243] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.547613 19888 raft_consensus.cc:2272] T 9b274075a20a4f4f84e2178e92a62910 P 7efda11f49cb4bc383b03ad8583c85c8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.549117 19888 tablet_replica.cc:333] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8: stopping tablet replica
I20260709 12:15:48.549552 19888 raft_consensus.cc:2243] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.550045 19888 raft_consensus.cc:2272] T 25d515fbed834a628c71933fe108e4da P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.551528 19888 tablet_replica.cc:333] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8: stopping tablet replica
I20260709 12:15:48.552138 19888 raft_consensus.cc:2243] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.553118 19888 raft_consensus.cc:2272] T cf7dfd58ca434a299fd4b95d9086b1ea P 7efda11f49cb4bc383b03ad8583c85c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.554967 19888 tablet_replica.cc:333] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8: stopping tablet replica
I20260709 12:15:48.555450 19888 raft_consensus.cc:2243] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.555867 19888 raft_consensus.cc:2272] T d87704241ab544af9fbc360cb4e56d76 P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.557374 19888 tablet_replica.cc:333] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8: stopping tablet replica
I20260709 12:15:48.557817 19888 raft_consensus.cc:2243] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.558230 19888 raft_consensus.cc:2272] T fa7db5656d654408bf0b6c84178ed0a6 P 7efda11f49cb4bc383b03ad8583c85c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.559746 19888 tablet_replica.cc:333] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8: stopping tablet replica
I20260709 12:15:48.560170 19888 raft_consensus.cc:2243] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.560585 19888 raft_consensus.cc:2272] T 0a6572fc47b3416cb913205f2f5497e2 P 7efda11f49cb4bc383b03ad8583c85c8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.561966 19888 tablet_replica.cc:333] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8: stopping tablet replica
I20260709 12:15:48.562363 19888 raft_consensus.cc:2243] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.563110 19888 raft_consensus.cc:2272] T 7d14337468d94566834825eacb870769 P 7efda11f49cb4bc383b03ad8583c85c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.564566 19888 tablet_replica.cc:333] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8: stopping tablet replica
I20260709 12:15:48.564940 19888 raft_consensus.cc:2243] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.565635 19888 raft_consensus.cc:2272] T 74d4d276fe1f4f9093c80e4389975c5d P 7efda11f49cb4bc383b03ad8583c85c8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:48.578193 20138 connection.cc:573] client connection to 127.19.108.2:37337 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:15:48.578615 20138 consensus_peers.cc:597] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 -> Peer 7efda11f49cb4bc383b03ad8583c85c8 (127.19.108.2:37337): Couldn't send request to peer 7efda11f49cb4bc383b03ad8583c85c8. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.591898 19888 tablet_server.cc:196] TabletServer@127.19.108.2:0 shutdown complete.
I20260709 12:15:48.608579 19888 tablet_server.cc:179] TabletServer@127.19.108.3:0 shutting down...
I20260709 12:15:48.630513 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:48.631184 19888 tablet_replica.cc:333] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747: stopping tablet replica
I20260709 12:15:48.631963 19888 raft_consensus.cc:2243] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.632526 19888 raft_consensus.cc:2272] T cf7dfd58ca434a299fd4b95d9086b1ea P c960a4ac9d4f4032a7c7f715eb3e5747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.634125 19888 tablet_replica.cc:333] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747: stopping tablet replica
I20260709 12:15:48.634560 19888 raft_consensus.cc:2243] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.635375 19888 raft_consensus.cc:2272] T 25d515fbed834a628c71933fe108e4da P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.636891 19888 tablet_replica.cc:333] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747: stopping tablet replica
I20260709 12:15:48.637302 19888 raft_consensus.cc:2243] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.637938 19888 raft_consensus.cc:2272] T b5bea183de184f9c99eb328fbbde8707 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.639428 19888 tablet_replica.cc:333] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747: stopping tablet replica
I20260709 12:15:48.639837 19888 raft_consensus.cc:2243] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.640228 19888 raft_consensus.cc:2272] T fa7db5656d654408bf0b6c84178ed0a6 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.641616 19888 tablet_replica.cc:333] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747: stopping tablet replica
I20260709 12:15:48.642006 19888 raft_consensus.cc:2243] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.642656 19888 raft_consensus.cc:2272] T d87704241ab544af9fbc360cb4e56d76 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.644228 19888 tablet_replica.cc:333] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747: stopping tablet replica
I20260709 12:15:48.644625 19888 raft_consensus.cc:2243] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.645002 19888 raft_consensus.cc:2272] T 74d4d276fe1f4f9093c80e4389975c5d P c960a4ac9d4f4032a7c7f715eb3e5747 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.646432 19888 tablet_replica.cc:333] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747: stopping tablet replica
I20260709 12:15:48.646836 19888 raft_consensus.cc:2243] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.647249 19888 raft_consensus.cc:2272] T 9b274075a20a4f4f84e2178e92a62910 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.648705 19888 tablet_replica.cc:333] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747: stopping tablet replica
I20260709 12:15:48.649077 19888 raft_consensus.cc:2243] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.649391 19888 raft_consensus.cc:2272] T 7d14337468d94566834825eacb870769 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.650776 19888 tablet_replica.cc:333] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747: stopping tablet replica
I20260709 12:15:48.651214 19888 raft_consensus.cc:2243] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:48.651602 19888 raft_consensus.cc:2272] T 0a6572fc47b3416cb913205f2f5497e2 P c960a4ac9d4f4032a7c7f715eb3e5747 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.676184 19888 tablet_server.cc:196] TabletServer@127.19.108.3:0 shutdown complete.
I20260709 12:15:48.692514 19888 master.cc:562] Master@127.19.108.62:33267 shutting down...
I20260709 12:15:48.820534 19888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:48.821096 19888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:48.821377 19888 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5fa9436edf52451a954c5cbd3a185f5d: stopping tablet replica
I20260709 12:15:48.855705 19888 master.cc:584] Master@127.19.108.62:33267 shutdown complete.
7efda11f49cb4bc383b03ad8583c85c8  4
ad34594620564711ac3d61ce9f399ae8  4
c960a4ac9d4f4032a7c7f715eb3e5747  1
7efda11f49cb4bc383b03ad8583c85c8  3
ad34594620564711ac3d61ce9f399ae8  3
c960a4ac9d4f4032a7c7f715eb3e5747  3
7efda11f49cb4bc383b03ad8583c85c8  8
ad34594620564711ac3d61ce9f399ae8  0
c960a4ac9d4f4032a7c7f715eb3e5747  1
7efda11f49cb4bc383b03ad8583c85c8  3
ad34594620564711ac3d61ce9f399ae8  3
c960a4ac9d4f4032a7c7f715eb3e5747  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30649 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:15:48.891191 19888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.108.62:40419
I20260709 12:15:48.892194 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:48.897089 20401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:48.897136 20402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:48.897948 20404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:48.899463 19888 server_base.cc:1061] running on GCE node
I20260709 12:15:48.900285 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:48.900461 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:48.900594 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599348900581 us; error 0 us; skew 500 ppm
I20260709 12:15:48.901016 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:48.903209 19888 webserver.cc:533] Webserver started at http://127.19.108.62:37015/ using document root <none> and password file <none>
I20260709 12:15:48.903632 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:48.903772 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:48.903960 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:48.904923 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/master-0-root/instance:
uuid: "c198b4a5dcc646c0970285e060212f86"
format_stamp: "Formatted at 2026-07-09 12:15:48 on dist-test-slave-0g1j"
I20260709 12:15:48.908802 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:15:48.911593 20409 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:48.912220 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:15:48.912451 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/master-0-root
uuid: "c198b4a5dcc646c0970285e060212f86"
format_stamp: "Formatted at 2026-07-09 12:15:48 on dist-test-slave-0g1j"
I20260709 12:15:48.912699 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:48.945384 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:48.946410 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:48.980366 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.62:40419
I20260709 12:15:48.980455 20460 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.62:40419 every 8 connection(s)
I20260709 12:15:48.983856 20461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:48.992547 20461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86: Bootstrap starting.
I20260709 12:15:48.996820 20461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.000399 20461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86: No bootstrap required, opened a new log
I20260709 12:15:49.002303 20461 raft_consensus.cc:359] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c198b4a5dcc646c0970285e060212f86" member_type: VOTER }
I20260709 12:15:49.002696 20461 raft_consensus.cc:385] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.002925 20461 raft_consensus.cc:740] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c198b4a5dcc646c0970285e060212f86, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.003433 20461 consensus_queue.cc:260] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c198b4a5dcc646c0970285e060212f86" member_type: VOTER }
I20260709 12:15:49.003865 20461 raft_consensus.cc:399] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:49.004065 20461 raft_consensus.cc:493] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:49.004299 20461 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.007750 20461 raft_consensus.cc:515] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c198b4a5dcc646c0970285e060212f86" member_type: VOTER }
I20260709 12:15:49.008199 20461 leader_election.cc:304] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c198b4a5dcc646c0970285e060212f86; no voters: 
I20260709 12:15:49.009140 20461 leader_election.cc:290] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:49.009457 20464 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.010520 20464 raft_consensus.cc:697] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 1 LEADER]: Becoming Leader. State: Replica: c198b4a5dcc646c0970285e060212f86, State: Running, Role: LEADER
I20260709 12:15:49.011154 20464 consensus_queue.cc:237] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c198b4a5dcc646c0970285e060212f86" member_type: VOTER }
I20260709 12:15:49.011730 20461 sys_catalog.cc:565] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:49.015770 20466 sys_catalog.cc:455] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c198b4a5dcc646c0970285e060212f86. Latest consensus state: current_term: 1 leader_uuid: "c198b4a5dcc646c0970285e060212f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c198b4a5dcc646c0970285e060212f86" member_type: VOTER } }
I20260709 12:15:49.016278 20466 sys_catalog.cc:458] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:49.016295 20465 sys_catalog.cc:455] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c198b4a5dcc646c0970285e060212f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c198b4a5dcc646c0970285e060212f86" member_type: VOTER } }
I20260709 12:15:49.017078 20465 sys_catalog.cc:458] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:49.018118 20471 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:49.023993 20471 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:49.024984 19888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:49.031592 20471 catalog_manager.cc:1383] Generated new cluster ID: 04a7760a9f59457bae930b097da6828e
I20260709 12:15:49.031802 20471 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:49.048234 20471 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:49.049260 20471 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:49.059792 20471 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86: Generated new TSK 0
I20260709 12:15:49.060248 20471 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:49.090639 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:49.095835 20482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:49.096769 20483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:49.097937 20485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:49.098541 19888 server_base.cc:1061] running on GCE node
I20260709 12:15:49.099362 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:49.099562 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:49.099725 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599349099706 us; error 0 us; skew 500 ppm
I20260709 12:15:49.100203 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:49.102152 19888 webserver.cc:533] Webserver started at http://127.19.108.1:32995/ using document root <none> and password file <none>
I20260709 12:15:49.102607 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:49.102777 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:49.103052 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:49.104003 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-0-root/instance:
uuid: "d8ac51280a96483496b0b04242053dd8"
format_stamp: "Formatted at 2026-07-09 12:15:49 on dist-test-slave-0g1j"
I20260709 12:15:49.107805 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:15:49.110558 20490 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.111189 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:15:49.111439 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "d8ac51280a96483496b0b04242053dd8"
format_stamp: "Formatted at 2026-07-09 12:15:49 on dist-test-slave-0g1j"
I20260709 12:15:49.111689 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:49.132115 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:49.133147 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:49.134426 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:49.136438 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:49.136649 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.136852 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:49.137009 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.172608 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:41927
I20260709 12:15:49.172690 20552 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:41927 every 8 connection(s)
I20260709 12:15:49.176980 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:49.182895 20557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:49.183732 20558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:49.185635 20560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:49.185822 19888 server_base.cc:1061] running on GCE node
I20260709 12:15:49.187053 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:49.187232 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:49.187378 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599349187364 us; error 0 us; skew 500 ppm
I20260709 12:15:49.187852 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:49.190362 19888 webserver.cc:533] Webserver started at http://127.19.108.2:46747/ using document root <none> and password file <none>
I20260709 12:15:49.190826 20553 heartbeater.cc:344] Connected to a master server at 127.19.108.62:40419
I20260709 12:15:49.190917 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:49.191159 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:49.191180 20553 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:49.191476 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:49.191879 20553 heartbeater.cc:507] Master 127.19.108.62:40419 requested a full tablet report, sending...
I20260709 12:15:49.192576 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-1-root/instance:
uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
format_stamp: "Formatted at 2026-07-09 12:15:49 on dist-test-slave-0g1j"
I20260709 12:15:49.193776 20426 ts_manager.cc:194] Registered new tserver with Master: d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927)
I20260709 12:15:49.195356 20426 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33182
I20260709 12:15:49.196971 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:15:49.200026 20565 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.200670 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:15:49.200915 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-1-root
uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
format_stamp: "Formatted at 2026-07-09 12:15:49 on dist-test-slave-0g1j"
I20260709 12:15:49.201165 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:49.211340 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:49.212348 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:49.213776 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:49.215888 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:49.216076 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.216298 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:49.216444 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.251168 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.2:38071
I20260709 12:15:49.251268 20627 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.2:38071 every 8 connection(s)
I20260709 12:15:49.255486 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:49.260896 20631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:49.261629 20632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:49.264211 20634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:49.264844 19888 server_base.cc:1061] running on GCE node
I20260709 12:15:49.265687 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:49.265908 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:49.265990 20628 heartbeater.cc:344] Connected to a master server at 127.19.108.62:40419
I20260709 12:15:49.266112 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599349266093 us; error 0 us; skew 500 ppm
I20260709 12:15:49.266376 20628 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:49.266875 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:49.267199 20628 heartbeater.cc:507] Master 127.19.108.62:40419 requested a full tablet report, sending...
I20260709 12:15:49.269114 19888 webserver.cc:533] Webserver started at http://127.19.108.3:42787/ using document root <none> and password file <none>
I20260709 12:15:49.269245 20426 ts_manager.cc:194] Registered new tserver with Master: a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:49.269744 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:49.269987 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:49.270288 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:49.270875 20426 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33192
I20260709 12:15:49.271710 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-2-root/instance:
uuid: "b950009a7cf4486187570819f25f6474"
format_stamp: "Formatted at 2026-07-09 12:15:49 on dist-test-slave-0g1j"
I20260709 12:15:49.275946 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:15:49.278816 20639 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.279479 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:15:49.279734 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-2-root
uuid: "b950009a7cf4486187570819f25f6474"
format_stamp: "Formatted at 2026-07-09 12:15:49 on dist-test-slave-0g1j"
I20260709 12:15:49.279975 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599318085381-19888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:49.291049 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:49.292021 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:49.293299 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:49.295249 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:49.295432 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.295642 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:49.295791 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.331451 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.3:36847
I20260709 12:15:49.331565 20701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.3:36847 every 8 connection(s)
I20260709 12:15:49.349900 20702 heartbeater.cc:344] Connected to a master server at 127.19.108.62:40419
I20260709 12:15:49.350291 20702 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:49.351187 20702 heartbeater.cc:507] Master 127.19.108.62:40419 requested a full tablet report, sending...
I20260709 12:15:49.353331 20426 ts_manager.cc:194] Registered new tserver with Master: b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:49.353447 19888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017951005s
I20260709 12:15:49.354965 20426 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33196
I20260709 12:15:49.378510 20426 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33200:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:49.381157 20426 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:49.442119 20667 tablet_service.cc:1511] Processing CreateTablet for tablet c4ccf36d717743f9b82872dd920685a5 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:49.443532 20667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ccf36d717743f9b82872dd920685a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.447993 20666 tablet_service.cc:1511] Processing CreateTablet for tablet ca8ff187d428401e9f52e19406130c9a (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:49.449303 20666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8ff187d428401e9f52e19406130c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.464289 20665 tablet_service.cc:1511] Processing CreateTablet for tablet cafb06f36d144072868f8cfd58e82063 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:49.465548 20665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cafb06f36d144072868f8cfd58e82063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.467574 20593 tablet_service.cc:1511] Processing CreateTablet for tablet c4ccf36d717743f9b82872dd920685a5 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:49.468758 20593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ccf36d717743f9b82872dd920685a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.470295 20664 tablet_service.cc:1511] Processing CreateTablet for tablet 4e024997893f4294810835b3579fb30c (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:49.471517 20664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e024997893f4294810835b3579fb30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.471942 20592 tablet_service.cc:1511] Processing CreateTablet for tablet ca8ff187d428401e9f52e19406130c9a (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:49.473106 20592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8ff187d428401e9f52e19406130c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.473860 20662 tablet_service.cc:1511] Processing CreateTablet for tablet 1d7236493a9d4e67a13c5dce09813e26 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:49.475085 20662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7236493a9d4e67a13c5dce09813e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.475792 20590 tablet_service.cc:1511] Processing CreateTablet for tablet 4e024997893f4294810835b3579fb30c (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:49.475991 20589 tablet_service.cc:1511] Processing CreateTablet for tablet efa1c61a851e4f639ee2ff7078ec05ef (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:49.477042 20590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e024997893f4294810835b3579fb30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.478143 20588 tablet_service.cc:1511] Processing CreateTablet for tablet 1d7236493a9d4e67a13c5dce09813e26 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:49.479926 20663 tablet_service.cc:1511] Processing CreateTablet for tablet efa1c61a851e4f639ee2ff7078ec05ef (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:49.481165 20663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa1c61a851e4f639ee2ff7078ec05ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.481402 20591 tablet_service.cc:1511] Processing CreateTablet for tablet cafb06f36d144072868f8cfd58e82063 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:49.483510 20588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7236493a9d4e67a13c5dce09813e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.486790 20717 tablet_bootstrap.cc:492] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474: Bootstrap starting.
I20260709 12:15:49.487426 20591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cafb06f36d144072868f8cfd58e82063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.490301 20589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa1c61a851e4f639ee2ff7078ec05ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.493871 20717 tablet_bootstrap.cc:654] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.503371 20587 tablet_service.cc:1511] Processing CreateTablet for tablet ef96fc5bcd4648a4a1a282ba98170940 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:49.504679 20587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef96fc5bcd4648a4a1a282ba98170940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.510152 20667 tablet_service.cc:1511] Processing CreateTablet for tablet ef96fc5bcd4648a4a1a282ba98170940 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:49.511344 20667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef96fc5bcd4648a4a1a282ba98170940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.518875 20586 tablet_service.cc:1511] Processing CreateTablet for tablet 211a1162451a4dd2ad38ab6682fb9cd4 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:49.520056 20586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211a1162451a4dd2ad38ab6682fb9cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.526770 20666 tablet_service.cc:1511] Processing CreateTablet for tablet 211a1162451a4dd2ad38ab6682fb9cd4 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:49.532655 20518 tablet_service.cc:1511] Processing CreateTablet for tablet c4ccf36d717743f9b82872dd920685a5 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:49.533826 20518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ccf36d717743f9b82872dd920685a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.540310 20717 tablet_bootstrap.cc:492] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:49.540738 20717 ts_tablet_manager.cc:1403] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.016s
I20260709 12:15:49.541972 20666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211a1162451a4dd2ad38ab6682fb9cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.527376 20585 tablet_service.cc:1511] Processing CreateTablet for tablet 8cbc8a590c2940acbd3e153ea19cea7e (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:49.543828 20585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cbc8a590c2940acbd3e153ea19cea7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.543743 20717 raft_consensus.cc:359] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:49.544454 20717 raft_consensus.cc:385] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.544745 20717 raft_consensus.cc:740] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.545428 20717 consensus_queue.cc:260] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:49.545951 20517 tablet_service.cc:1511] Processing CreateTablet for tablet ca8ff187d428401e9f52e19406130c9a (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:49.547188 20517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8ff187d428401e9f52e19406130c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.553539 20593 tablet_service.cc:1511] Processing CreateTablet for tablet 442cb4a9acdc487a933f3ed94c8df563 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:49.554620 20593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442cb4a9acdc487a933f3ed94c8df563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.555176 20664 tablet_service.cc:1511] Processing CreateTablet for tablet 442cb4a9acdc487a933f3ed94c8df563 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:49.557529 20664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442cb4a9acdc487a933f3ed94c8df563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.558390 20667 tablet_service.cc:1511] Processing CreateTablet for tablet 8cbc8a590c2940acbd3e153ea19cea7e (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:49.559549 20667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cbc8a590c2940acbd3e153ea19cea7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.569288 20516 tablet_service.cc:1511] Processing CreateTablet for tablet cafb06f36d144072868f8cfd58e82063 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:49.570463 20516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cafb06f36d144072868f8cfd58e82063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.570808 20512 tablet_service.cc:1511] Processing CreateTablet for tablet ef96fc5bcd4648a4a1a282ba98170940 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:49.572017 20512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef96fc5bcd4648a4a1a282ba98170940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.571938 20515 tablet_service.cc:1511] Processing CreateTablet for tablet 4e024997893f4294810835b3579fb30c (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:49.573170 20515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e024997893f4294810835b3579fb30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.577479 20514 tablet_service.cc:1511] Processing CreateTablet for tablet efa1c61a851e4f639ee2ff7078ec05ef (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:49.578696 20514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa1c61a851e4f639ee2ff7078ec05ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.584422 20510 tablet_service.cc:1511] Processing CreateTablet for tablet 8cbc8a590c2940acbd3e153ea19cea7e (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:49.585721 20510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cbc8a590c2940acbd3e153ea19cea7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.575948 20511 tablet_service.cc:1511] Processing CreateTablet for tablet 211a1162451a4dd2ad38ab6682fb9cd4 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:49.587538 20719 tablet_bootstrap.cc:492] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:49.575951 20513 tablet_service.cc:1511] Processing CreateTablet for tablet 1d7236493a9d4e67a13c5dce09813e26 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:49.587728 20511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211a1162451a4dd2ad38ab6682fb9cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.590827 20509 tablet_service.cc:1511] Processing CreateTablet for tablet 442cb4a9acdc487a933f3ed94c8df563 (DEFAULT_TABLE table=test-workload [id=0c7de7ee923042a7bb7ed04d0088ecf6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:49.599233 20513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7236493a9d4e67a13c5dce09813e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.611156 20509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442cb4a9acdc487a933f3ed94c8df563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:49.622001 20702 heartbeater.cc:499] Master 127.19.108.62:40419 was elected leader, sending a full tablet report...
I20260709 12:15:49.628348 20719 tablet_bootstrap.cc:654] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.638814 20717 ts_tablet_manager.cc:1434] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.009s
I20260709 12:15:49.639961 20717 tablet_bootstrap.cc:492] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474: Bootstrap starting.
I20260709 12:15:49.643884 20721 tablet_bootstrap.cc:492] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:49.645861 20717 tablet_bootstrap.cc:654] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.649789 20721 tablet_bootstrap.cc:654] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.650354 20717 tablet_bootstrap.cc:492] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:49.650712 20717 ts_tablet_manager.cc:1403] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:15:49.652891 20717 raft_consensus.cc:359] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.653496 20717 raft_consensus.cc:385] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.653776 20717 raft_consensus.cc:740] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.654502 20717 consensus_queue.cc:260] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.655928 20721 tablet_bootstrap.cc:492] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:49.655952 20719 tablet_bootstrap.cc:492] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:49.656268 20717 ts_tablet_manager.cc:1434] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:15:49.656461 20721 ts_tablet_manager.cc:1403] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 12:15:49.656620 20719 ts_tablet_manager.cc:1403] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.000s
I20260709 12:15:49.657164 20717 tablet_bootstrap.cc:492] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474: Bootstrap starting.
I20260709 12:15:49.659198 20721 raft_consensus.cc:359] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.659399 20719 raft_consensus.cc:359] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.659895 20721 raft_consensus.cc:385] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.660202 20719 raft_consensus.cc:385] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.660200 20721 raft_consensus.cc:740] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.660671 20719 raft_consensus.cc:740] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.661417 20721 consensus_queue.cc:260] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.661576 20719 consensus_queue.cc:260] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.663385 20717 tablet_bootstrap.cc:654] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.669883 20628 heartbeater.cc:499] Master 127.19.108.62:40419 was elected leader, sending a full tablet report...
I20260709 12:15:49.670498 20553 heartbeater.cc:499] Master 127.19.108.62:40419 was elected leader, sending a full tablet report...
I20260709 12:15:49.671458 20721 ts_tablet_manager.cc:1434] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:15:49.672353 20721 tablet_bootstrap.cc:492] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:49.678223 20721 tablet_bootstrap.cc:654] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.678874 20719 ts_tablet_manager.cc:1434] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 12:15:49.679808 20719 tablet_bootstrap.cc:492] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:49.683244 20717 tablet_bootstrap.cc:492] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:49.683666 20717 ts_tablet_manager.cc:1403] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.012s
I20260709 12:15:49.686291 20717 raft_consensus.cc:359] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.686973 20717 raft_consensus.cc:385] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.687260 20717 raft_consensus.cc:740] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.688141 20717 consensus_queue.cc:260] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.691862 20717 ts_tablet_manager.cc:1434] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:15:49.692721 20717 tablet_bootstrap.cc:492] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474: Bootstrap starting.
I20260709 12:15:49.697412 20719 tablet_bootstrap.cc:654] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.698351 20717 tablet_bootstrap.cc:654] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.702579 20721 tablet_bootstrap.cc:492] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:49.703001 20721 ts_tablet_manager.cc:1403] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.007s
I20260709 12:15:49.705608 20721 raft_consensus.cc:359] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:49.706211 20721 raft_consensus.cc:385] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.706444 20721 raft_consensus.cc:740] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.707248 20721 consensus_queue.cc:260] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:49.709458 20721 ts_tablet_manager.cc:1434] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:15:49.710287 20721 tablet_bootstrap.cc:492] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:49.711126 20719 tablet_bootstrap.cc:492] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:49.711158 20717 tablet_bootstrap.cc:492] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:49.711647 20717 ts_tablet_manager.cc:1403] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 12:15:49.711617 20719 ts_tablet_manager.cc:1403] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 12:15:49.714367 20717 raft_consensus.cc:359] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.715070 20717 raft_consensus.cc:385] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.714725 20719 raft_consensus.cc:359] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.715370 20717 raft_consensus.cc:740] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.715529 20719 raft_consensus.cc:385] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.715900 20719 raft_consensus.cc:740] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.716189 20721 tablet_bootstrap.cc:654] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.716246 20717 consensus_queue.cc:260] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.716755 20719 consensus_queue.cc:260] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.723007 20717 ts_tablet_manager.cc:1434] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:15:49.723954 20717 tablet_bootstrap.cc:492] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474: Bootstrap starting.
I20260709 12:15:49.727721 20719 ts_tablet_manager.cc:1434] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:15:49.728662 20719 tablet_bootstrap.cc:492] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:49.729780 20717 tablet_bootstrap.cc:654] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.735759 20725 raft_consensus.cc:493] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.736238 20725 raft_consensus.cc:515] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.738801 20725 leader_election.cc:290] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:49.741734 20719 tablet_bootstrap.cc:654] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.747094 20721 tablet_bootstrap.cc:492] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:49.747534 20721 ts_tablet_manager.cc:1403] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.015s
I20260709 12:15:49.750248 20721 raft_consensus.cc:359] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.752482 20721 raft_consensus.cc:385] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.752812 20721 raft_consensus.cc:740] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.754180 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8" is_pre_election: true
I20260709 12:15:49.754603 20717 tablet_bootstrap.cc:492] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:49.754683 20719 tablet_bootstrap.cc:492] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:49.755118 20717 ts_tablet_manager.cc:1403] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.005s
I20260709 12:15:49.755231 20719 ts_tablet_manager.cc:1403] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
W20260709 12:15:49.755759 20568 leader_election.cc:343] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.756883 20721 consensus_queue.cc:260] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.757835 20717 raft_consensus.cc:359] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.758409 20717 raft_consensus.cc:385] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.758684 20717 raft_consensus.cc:740] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.759232 20721 ts_tablet_manager.cc:1434] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:15:49.759522 20717 consensus_queue.cc:260] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.760227 20721 tablet_bootstrap.cc:492] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:49.760378 20719 raft_consensus.cc:359] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.761015 20719 raft_consensus.cc:385] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.761289 20719 raft_consensus.cc:740] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.762053 20719 consensus_queue.cc:260] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.766013 20719 ts_tablet_manager.cc:1434] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:15:49.766651 20721 tablet_bootstrap.cc:654] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.766901 20719 tablet_bootstrap.cc:492] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:49.767341 20717 ts_tablet_manager.cc:1434] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 12:15:49.773409 20719 tablet_bootstrap.cc:654] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.773878 20717 tablet_bootstrap.cc:492] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474: Bootstrap starting.
I20260709 12:15:49.773730 20677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474" is_pre_election: true
I20260709 12:15:49.774341 20677 raft_consensus.cc:2468] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 0.
I20260709 12:15:49.775681 20567 leader_election.cc:304] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: d8ac51280a96483496b0b04242053dd8
I20260709 12:15:49.776464 20725 raft_consensus.cc:2804] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.776834 20725 raft_consensus.cc:493] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.777174 20725 raft_consensus.cc:3060] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.779937 20717 tablet_bootstrap.cc:654] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.786018 20725 raft_consensus.cc:515] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.788735 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8"
W20260709 12:15:49.790089 20568 leader_election.cc:343] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.791129 20720 raft_consensus.cc:493] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.791591 20720 raft_consensus.cc:515] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.792085 20677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:49.792656 20677 raft_consensus.cc:3060] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.797540 20720 leader_election.cc:290] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:49.800063 20717 tablet_bootstrap.cc:492] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:49.800524 20717 ts_tablet_manager.cc:1403] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 12:15:49.801147 20677 raft_consensus.cc:2468] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 1.
I20260709 12:15:49.801903 20725 leader_election.cc:290] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:49.802429 20725 raft_consensus.cc:493] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.802969 20725 raft_consensus.cc:515] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.805519 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8" is_pre_election: true
W20260709 12:15:49.806821 20568 leader_election.cc:343] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.806629 20717 raft_consensus.cc:359] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.807334 20717 raft_consensus.cc:385] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.807633 20717 raft_consensus.cc:740] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.808185 20725 leader_election.cc:290] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:49.809561 20721 tablet_bootstrap.cc:492] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:49.809990 20721 ts_tablet_manager.cc:1403] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.024s
I20260709 12:15:49.811136 20719 tablet_bootstrap.cc:492] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:49.811628 20719 ts_tablet_manager.cc:1403] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 12:15:49.812578 20567 leader_election.cc:304] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: d8ac51280a96483496b0b04242053dd8
I20260709 12:15:49.812719 20721 raft_consensus.cc:359] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.813525 20721 raft_consensus.cc:385] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.813740 20720 raft_consensus.cc:493] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.813905 20721 raft_consensus.cc:740] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.814231 20720 raft_consensus.cc:515] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.815433 20677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474" is_pre_election: true
I20260709 12:15:49.814680 20719 raft_consensus.cc:359] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:49.814668 20721 consensus_queue.cc:260] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.815982 20677 raft_consensus.cc:2468] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 0.
I20260709 12:15:49.816424 20720 leader_election.cc:290] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:49.815959 20719 raft_consensus.cc:385] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.817018 20719 raft_consensus.cc:740] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.817350 20567 leader_election.cc:304] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: d8ac51280a96483496b0b04242053dd8
I20260709 12:15:49.817946 20721 ts_tablet_manager.cc:1434] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:49.817725 20719 consensus_queue.cc:260] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:49.818377 20725 raft_consensus.cc:2804] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.818856 20721 tablet_bootstrap.cc:492] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:49.819779 20738 raft_consensus.cc:2804] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.820788 20738 raft_consensus.cc:493] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.821633 20738 raft_consensus.cc:3060] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.824855 20721 tablet_bootstrap.cc:654] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.818925 20717 consensus_queue.cc:260] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.826577 20717 ts_tablet_manager.cc:1434] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:15:49.828692 20717 tablet_bootstrap.cc:492] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474: Bootstrap starting.
I20260709 12:15:49.832679 20738 raft_consensus.cc:515] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.839337 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8" is_pre_election: true
I20260709 12:15:49.839905 20528 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 0.
I20260709 12:15:49.841491 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8" is_pre_election: true
I20260709 12:15:49.842027 20528 raft_consensus.cc:2468] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 0.
I20260709 12:15:49.842057 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:49.843155 20603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" is_pre_election: true
W20260709 12:15:49.843695 20568 leader_election.cc:343] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:49.844439 20643 leader_election.cc:343] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.844501 20602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" is_pre_election: true
I20260709 12:15:49.845151 20602 raft_consensus.cc:2468] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 0.
I20260709 12:15:49.845779 20719 ts_tablet_manager.cc:1434] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.004s
I20260709 12:15:49.846067 20643 leader_election.cc:304] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:15:49.846451 20642 leader_election.cc:304] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9
I20260709 12:15:49.846956 20719 tablet_bootstrap.cc:492] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:49.847096 20720 raft_consensus.cc:2804] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.847481 20720 raft_consensus.cc:493] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.847527 20725 raft_consensus.cc:697] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Becoming Leader. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:15:49.848340 20726 raft_consensus.cc:493] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.848382 20725 consensus_queue.cc:237] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.848868 20726 raft_consensus.cc:515] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.850219 20738 leader_election.cc:290] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:49.852347 20721 tablet_bootstrap.cc:492] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:49.852854 20721 ts_tablet_manager.cc:1403] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.016s
I20260709 12:15:49.855830 20743 raft_consensus.cc:2804] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.855615 20721 raft_consensus.cc:359] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.856240 20743 raft_consensus.cc:493] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.856426 20721 raft_consensus.cc:385] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.856901 20721 raft_consensus.cc:740] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.857654 20721 consensus_queue.cc:260] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.857980 20677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:49.858609 20677 raft_consensus.cc:3060] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.858281 20726 leader_election.cc:290] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:49.864955 20677 raft_consensus.cc:2468] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 1.
I20260709 12:15:49.847901 20720 raft_consensus.cc:3060] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.865962 20567 leader_election.cc:304] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: d8ac51280a96483496b0b04242053dd8
I20260709 12:15:49.866657 20743 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.867061 20738 raft_consensus.cc:2804] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.867496 20738 raft_consensus.cc:697] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Becoming Leader. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:15:49.868244 20738 consensus_queue.cc:237] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.870966 20717 tablet_bootstrap.cc:654] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.871156 20719 tablet_bootstrap.cc:654] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.880048 20743 raft_consensus.cc:515] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.883396 20748 raft_consensus.cc:493] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.883846 20748 raft_consensus.cc:515] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:49.886559 20602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccf36d717743f9b82872dd920685a5" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" is_pre_election: true
I20260709 12:15:49.887193 20602 raft_consensus.cc:2468] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 0.
I20260709 12:15:49.888383 20643 leader_election.cc:304] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:15:49.889467 20743 leader_election.cc:290] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:49.890017 20743 raft_consensus.cc:2804] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.890360 20743 raft_consensus.cc:493] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.890666 20743 raft_consensus.cc:3060] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.895375 20720 raft_consensus.cc:515] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.901046 20720 leader_election.cc:290] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:49.903069 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:49.903642 20527 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.907531 20425 catalog_manager.cc:5697] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.910463 20527 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:49.911919 20642 leader_election.cc:304] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:49.913041 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:49.913611 20527 raft_consensus.cc:3060] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.921875 20752 raft_consensus.cc:2804] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.922382 20752 raft_consensus.cc:697] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:49.922927 20719 tablet_bootstrap.cc:492] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:49.923377 20719 ts_tablet_manager.cc:1403] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.012s
I20260709 12:15:49.923206 20752 consensus_queue.cc:237] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.923501 20426 catalog_manager.cc:5697] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.927872 20602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:49.928282 20719 raft_consensus.cc:359] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.928941 20719 raft_consensus.cc:385] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.929219 20719 raft_consensus.cc:740] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.929543 20603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:49.930143 20603 raft_consensus.cc:3060] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.931218 20677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474" is_pre_election: true
I20260709 12:15:49.931792 20677 raft_consensus.cc:2468] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 0.
I20260709 12:15:49.932336 20721 ts_tablet_manager.cc:1434] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.079s	user 0.042s	sys 0.035s
I20260709 12:15:49.932124 20719 consensus_queue.cc:260] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.932830 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" is_pre_election: true
I20260709 12:15:49.933476 20721 tablet_bootstrap.cc:492] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:49.934459 20719 ts_tablet_manager.cc:1434] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:15:49.935360 20719 tablet_bootstrap.cc:492] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:49.936684 20602 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:49.937353 20494 leader_election.cc:343] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.940106 20721 tablet_bootstrap.cc:654] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.940980 20492 leader_election.cc:304] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9
I20260709 12:15:49.941920 20747 raft_consensus.cc:2804] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:49.942270 20747 raft_consensus.cc:493] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.942584 20747 raft_consensus.cc:3060] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.945536 20743 raft_consensus.cc:515] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:49.948817 20602 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:49.948957 20747 raft_consensus.cc:515] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.950721 20603 raft_consensus.cc:2468] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:49.951532 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:49.951740 20721 tablet_bootstrap.cc:492] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:49.951890 20643 leader_election.cc:304] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:15:49.952347 20721 ts_tablet_manager.cc:1403] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 12:15:49.953433 20720 raft_consensus.cc:2804] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.953864 20720 raft_consensus.cc:697] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
W20260709 12:15:49.953969 20494 leader_election.cc:343] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:49.955338 20721 raft_consensus.cc:359] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.956178 20721 raft_consensus.cc:385] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.956453 20748 leader_election.cc:290] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927)
I20260709 12:15:49.956588 20721 raft_consensus.cc:740] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.956960 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccf36d717743f9b82872dd920685a5" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8" is_pre_election: true
I20260709 12:15:49.954653 20720 consensus_queue.cc:237] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.957590 20528 raft_consensus.cc:2468] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 0.
I20260709 12:15:49.958580 20743 leader_election.cc:290] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927)
I20260709 12:15:49.958223 20721 consensus_queue.cc:260] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.960021 20719 tablet_bootstrap.cc:654] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.960067 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccf36d717743f9b82872dd920685a5" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:49.960628 20528 raft_consensus.cc:3060] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.961828 20717 tablet_bootstrap.cc:492] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:49.962280 20717 ts_tablet_manager.cc:1403] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.008s
I20260709 12:15:49.962929 20721 ts_tablet_manager.cc:1434] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:15:49.964123 20677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:49.964529 20677 raft_consensus.cc:3060] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.965024 20717 raft_consensus.cc:359] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.965687 20717 raft_consensus.cc:385] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.965968 20717 raft_consensus.cc:740] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.967029 20747 leader_election.cc:290] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:49.967213 20528 raft_consensus.cc:2468] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:49.968492 20721 tablet_bootstrap.cc:492] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:49.968366 20642 leader_election.cc:304] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:49.969143 20743 raft_consensus.cc:2804] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.969588 20743 raft_consensus.cc:697] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:49.970218 20719 tablet_bootstrap.cc:492] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:49.970752 20719 ts_tablet_manager.cc:1403] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:15:49.970499 20743 consensus_queue.cc:237] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:49.969543 20677 raft_consensus.cc:2468] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 1.
I20260709 12:15:49.971194 20602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccf36d717743f9b82872dd920685a5" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:49.971743 20602 raft_consensus.cc:3060] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.972052 20492 leader_election.cc:304] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9
I20260709 12:15:49.973073 20747 raft_consensus.cc:2804] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:49.973676 20747 raft_consensus.cc:697] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:15:49.973889 20719 raft_consensus.cc:359] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.974666 20719 raft_consensus.cc:385] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:49.974453 20747 consensus_queue.cc:237] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.975049 20719 raft_consensus.cc:740] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.975310 20721 tablet_bootstrap.cc:654] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.975930 20719 consensus_queue.cc:260] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.977878 20602 raft_consensus.cc:2468] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:49.966657 20717 consensus_queue.cc:260] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:49.983374 20717 ts_tablet_manager.cc:1434] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 12:15:49.984263 20717 tablet_bootstrap.cc:492] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474: Bootstrap starting.
I20260709 12:15:49.986398 20719 ts_tablet_manager.cc:1434] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:15:49.990007 20527 raft_consensus.cc:2468] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:49.994609 20717 tablet_bootstrap.cc:654] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:49.995659 20719 tablet_bootstrap.cc:492] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:50.002210 20719 tablet_bootstrap.cc:654] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.004710 20721 tablet_bootstrap.cc:492] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:50.005168 20721 ts_tablet_manager.cc:1403] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.008s
I20260709 12:15:50.004429 20424 catalog_manager.cc:5697] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.005426 20717 tablet_bootstrap.cc:492] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:50.005901 20717 ts_tablet_manager.cc:1403] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 12:15:50.008576 20426 catalog_manager.cc:5697] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 0 to 1, leader changed from <none> to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:50.007798 20721 raft_consensus.cc:359] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.010638 20721 raft_consensus.cc:385] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.010946 20721 raft_consensus.cc:740] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.011722 20721 consensus_queue.cc:260] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.014312 20721 ts_tablet_manager.cc:1434] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:50.014329 20717 raft_consensus.cc:359] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.016209 20717 raft_consensus.cc:385] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.016575 20717 raft_consensus.cc:740] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.017477 20717 consensus_queue.cc:260] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.018473 20721 tablet_bootstrap.cc:492] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:50.019356 20717 ts_tablet_manager.cc:1434] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:15:50.020288 20717 tablet_bootstrap.cc:492] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474: Bootstrap starting.
W20260709 12:15:50.021212 20474 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:50.024731 20721 tablet_bootstrap.cc:654] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.025238 20717 tablet_bootstrap.cc:654] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.017478 20719 tablet_bootstrap.cc:492] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:50.027226 20719 ts_tablet_manager.cc:1403] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.007s
I20260709 12:15:50.030072 20719 raft_consensus.cc:359] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.031395 20719 raft_consensus.cc:385] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.031723 20719 raft_consensus.cc:740] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.031728 20424 catalog_manager.cc:5697] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 0 to 1, leader changed from <none> to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:50.033056 20721 tablet_bootstrap.cc:492] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:50.032706 20719 consensus_queue.cc:260] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.033475 20721 ts_tablet_manager.cc:1403] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:15:50.033447 20424 catalog_manager.cc:5697] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 0 to 1, leader changed from <none> to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.034914 20719 ts_tablet_manager.cc:1434] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:15:50.035732 20719 tablet_bootstrap.cc:492] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:50.035981 20721 raft_consensus.cc:359] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.036587 20721 raft_consensus.cc:385] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.036844 20721 raft_consensus.cc:740] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.037456 20721 consensus_queue.cc:260] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.041857 20719 tablet_bootstrap.cc:654] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.042145 20721 ts_tablet_manager.cc:1434] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:15:50.043064 20721 tablet_bootstrap.cc:492] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:50.048120 20721 tablet_bootstrap.cc:654] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.051007 20717 tablet_bootstrap.cc:492] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:50.051460 20717 ts_tablet_manager.cc:1403] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.009s
I20260709 12:15:50.053926 20717 raft_consensus.cc:359] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.054685 20717 raft_consensus.cc:385] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.055019 20717 raft_consensus.cc:740] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.055866 20717 consensus_queue.cc:260] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.058156 20717 ts_tablet_manager.cc:1434] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:50.059103 20717 tablet_bootstrap.cc:492] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474: Bootstrap starting.
I20260709 12:15:50.065016 20721 tablet_bootstrap.cc:492] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:50.065407 20717 tablet_bootstrap.cc:654] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.065407 20721 ts_tablet_manager.cc:1403] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 12:15:50.068048 20719 tablet_bootstrap.cc:492] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:50.068455 20719 ts_tablet_manager.cc:1403] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.013s
I20260709 12:15:50.068931 20721 raft_consensus.cc:359] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.069600 20721 raft_consensus.cc:385] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.069903 20721 raft_consensus.cc:740] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.070655 20721 consensus_queue.cc:260] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.070927 20719 raft_consensus.cc:359] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.071588 20719 raft_consensus.cc:385] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.071856 20719 raft_consensus.cc:740] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.072751 20721 ts_tablet_manager.cc:1434] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:50.072484 20719 consensus_queue.cc:260] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.074419 20719 ts_tablet_manager.cc:1434] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:50.075294 20719 tablet_bootstrap.cc:492] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:50.080580 20719 tablet_bootstrap.cc:654] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.084880 20721 tablet_bootstrap.cc:492] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8: Bootstrap starting.
I20260709 12:15:50.086139 20717 tablet_bootstrap.cc:492] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474: No bootstrap required, opened a new log
I20260709 12:15:50.086452 20717 ts_tablet_manager.cc:1403] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.011s
I20260709 12:15:50.088176 20717 raft_consensus.cc:359] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.088600 20717 raft_consensus.cc:385] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.088789 20717 raft_consensus.cc:740] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.089267 20717 consensus_queue.cc:260] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.090420 20717 ts_tablet_manager.cc:1434] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.002s
I20260709 12:15:50.090399 20721 tablet_bootstrap.cc:654] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.093446 20719 tablet_bootstrap.cc:492] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:50.093883 20719 ts_tablet_manager.cc:1403] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 12:15:50.095921 20721 tablet_bootstrap.cc:492] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8: No bootstrap required, opened a new log
I20260709 12:15:50.096237 20721 ts_tablet_manager.cc:1403] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:15:50.096100 20719 raft_consensus.cc:359] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.096756 20719 raft_consensus.cc:385] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.097023 20719 raft_consensus.cc:740] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.097680 20719 consensus_queue.cc:260] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.098435 20721 raft_consensus.cc:359] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.099092 20721 raft_consensus.cc:385] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.099344 20721 raft_consensus.cc:740] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.099429 20719 ts_tablet_manager.cc:1434] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:15:50.100279 20719 tablet_bootstrap.cc:492] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Bootstrap starting.
I20260709 12:15:50.100095 20721 consensus_queue.cc:260] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.104079 20721 ts_tablet_manager.cc:1434] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:15:50.106030 20719 tablet_bootstrap.cc:654] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.111151 20719 tablet_bootstrap.cc:492] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: No bootstrap required, opened a new log
I20260709 12:15:50.111444 20719 ts_tablet_manager.cc:1403] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 12:15:50.113147 20719 raft_consensus.cc:359] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.113579 20719 raft_consensus.cc:385] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.113772 20719 raft_consensus.cc:740] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.114264 20719 consensus_queue.cc:260] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.115684 20719 ts_tablet_manager.cc:1434] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:15:50.205029 20747 raft_consensus.cc:493] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.205418 20747 raft_consensus.cc:515] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.206862 20747 leader_election.cc:290] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.207525 20602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbc8a590c2940acbd3e153ea19cea7e" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" is_pre_election: true
I20260709 12:15:50.207872 20677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbc8a590c2940acbd3e153ea19cea7e" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474" is_pre_election: true
I20260709 12:15:50.208027 20602 raft_consensus.cc:2468] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 0.
I20260709 12:15:50.208371 20677 raft_consensus.cc:2468] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 0.
I20260709 12:15:50.208884 20494 leader_election.cc:304] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.209589 20747 raft_consensus.cc:2804] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:50.209847 20747 raft_consensus.cc:493] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.210062 20747 raft_consensus.cc:3060] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.213850 20726 raft_consensus.cc:493] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.214264 20726 raft_consensus.cc:515] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.214746 20747 raft_consensus.cc:515] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.215878 20726 leader_election.cc:290] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.216317 20747 leader_election.cc:290] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.216934 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbc8a590c2940acbd3e153ea19cea7e" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:50.216846 20602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" is_pre_election: true
I20260709 12:15:50.217581 20601 raft_consensus.cc:3060] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.217581 20677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474" is_pre_election: true
I20260709 12:15:50.218397 20677 raft_consensus.cc:2393] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8ac51280a96483496b0b04242053dd8 in current term 1: Already voted for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in this term.
I20260709 12:15:50.218572 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbc8a590c2940acbd3e153ea19cea7e" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:50.219147 20676 raft_consensus.cc:3060] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.219309 20492 leader_election.cc:304] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8ac51280a96483496b0b04242053dd8; no voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474
I20260709 12:15:50.220378 20747 raft_consensus.cc:3060] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.223590 20676 raft_consensus.cc:2468] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 1.
I20260709 12:15:50.224006 20601 raft_consensus.cc:2468] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 1.
I20260709 12:15:50.224396 20492 leader_election.cc:304] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.225056 20726 raft_consensus.cc:2804] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:50.225914 20726 raft_consensus.cc:697] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:15:50.226071 20747 raft_consensus.cc:2749] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:50.226624 20726 consensus_queue.cc:237] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.232610 20426 catalog_manager.cc:5697] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.238353 20726 raft_consensus.cc:493] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.238710 20726 raft_consensus.cc:515] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.240166 20726 leader_election.cc:290] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.240823 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" is_pre_election: true
I20260709 12:15:50.240979 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474" is_pre_election: true
I20260709 12:15:50.241590 20676 raft_consensus.cc:2393] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8ac51280a96483496b0b04242053dd8 in current term 1: Already voted for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in this term.
I20260709 12:15:50.242364 20492 leader_election.cc:304] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8ac51280a96483496b0b04242053dd8; no voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474
I20260709 12:15:50.242906 20726 raft_consensus.cc:3060] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.243721 20720 raft_consensus.cc:493] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.244061 20720 raft_consensus.cc:515] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.245474 20720 leader_election.cc:290] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:50.246255 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8" is_pre_election: true
I20260709 12:15:50.246506 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" is_pre_election: true
I20260709 12:15:50.246834 20527 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 0.
I20260709 12:15:50.247083 20601 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 0.
I20260709 12:15:50.247852 20642 leader_election.cc:304] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.248334 20726 raft_consensus.cc:2749] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:50.248574 20720 raft_consensus.cc:2804] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:50.248921 20720 raft_consensus.cc:493] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.249166 20720 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.253100 20720 raft_consensus.cc:515] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.254453 20720 leader_election.cc:290] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:50.255230 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:50.255271 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:50.255700 20601 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.255741 20527 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.259815 20601 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:50.259977 20527 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:50.260639 20643 leader_election.cc:304] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:15:50.263294 20720 raft_consensus.cc:2804] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:50.263948 20725 raft_consensus.cc:493] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.263749 20720 raft_consensus.cc:697] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:50.264294 20725 raft_consensus.cc:515] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.264811 20720 consensus_queue.cc:237] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.265839 20725 leader_election.cc:290] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.266433 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8" is_pre_election: true
I20260709 12:15:50.267563 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474" is_pre_election: true
I20260709 12:15:50.268250 20676 raft_consensus.cc:2393] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in current term 1: Already voted for candidate d8ac51280a96483496b0b04242053dd8 in this term.
I20260709 12:15:50.269250 20567 leader_election.cc:304] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9; no voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8
I20260709 12:15:50.269855 20725 raft_consensus.cc:3060] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.270807 20738 consensus_queue.cc:1048] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.272970 20426 catalog_manager.cc:5697] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 0 to 1, leader changed from <none> to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:50.275796 20725 raft_consensus.cc:2749] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:50.282743 20738 consensus_queue.cc:1048] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.283846 20740 consensus_queue.cc:1048] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:50.297166 20725 consensus_queue.cc:1048] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.322266 20725 raft_consensus.cc:493] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.322642 20725 raft_consensus.cc:515] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.324435 20725 leader_election.cc:290] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.324976 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442cb4a9acdc487a933f3ed94c8df563" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8" is_pre_election: true
I20260709 12:15:50.325317 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442cb4a9acdc487a933f3ed94c8df563" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474" is_pre_election: true
I20260709 12:15:50.325605 20527 raft_consensus.cc:2468] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 0.
I20260709 12:15:50.325911 20676 raft_consensus.cc:2468] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 0.
I20260709 12:15:50.326546 20568 leader_election.cc:304] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.327162 20725 raft_consensus.cc:2804] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:50.327453 20725 raft_consensus.cc:493] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.327670 20725 raft_consensus.cc:3060] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.331763 20725 raft_consensus.cc:515] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.333222 20725 leader_election.cc:290] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.333782 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442cb4a9acdc487a933f3ed94c8df563" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:50.334076 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442cb4a9acdc487a933f3ed94c8df563" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:50.334328 20527 raft_consensus.cc:3060] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.334595 20676 raft_consensus.cc:3060] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.336606 20720 raft_consensus.cc:493] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.336977 20720 raft_consensus.cc:515] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.338660 20720 leader_election.cc:290] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:50.339468 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8" is_pre_election: true
I20260709 12:15:50.340055 20528 raft_consensus.cc:2468] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 0.
I20260709 12:15:50.340138 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" is_pre_election: true
I20260709 12:15:50.340682 20601 raft_consensus.cc:2468] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 0.
I20260709 12:15:50.340708 20527 raft_consensus.cc:2468] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 1.
I20260709 12:15:50.340708 20676 raft_consensus.cc:2468] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 1.
I20260709 12:15:50.341254 20642 leader_election.cc:304] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.341876 20568 leader_election.cc:304] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.342370 20720 raft_consensus.cc:2804] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:50.342655 20725 raft_consensus.cc:2804] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:50.342701 20720 raft_consensus.cc:493] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.343271 20720 raft_consensus.cc:3060] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.343293 20725 raft_consensus.cc:697] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Becoming Leader. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:15:50.344233 20725 consensus_queue.cc:237] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.348137 20720 raft_consensus.cc:515] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.350687 20720 leader_election.cc:290] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:50.350658 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:50.350908 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:50.351542 20527 raft_consensus.cc:3060] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.351614 20601 raft_consensus.cc:3060] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.352339 20426 catalog_manager.cc:5697] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.355311 20720 consensus_queue.cc:1048] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.357678 20527 raft_consensus.cc:2468] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:50.358741 20642 leader_election.cc:304] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.359602 20720 raft_consensus.cc:2804] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:50.360642 20720 raft_consensus.cc:697] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:50.360735 20601 raft_consensus.cc:2468] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 1.
I20260709 12:15:50.361419 20720 consensus_queue.cc:237] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.369468 20720 consensus_queue.cc:1048] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.369325 20426 catalog_manager.cc:5697] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 0 to 1, leader changed from <none> to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:50.421089 20726 consensus_queue.cc:1048] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.424396 20720 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.432009 20747 consensus_queue.cc:1048] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.443125 20752 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.465122 20720 consensus_queue.cc:1048] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.473793 20720 consensus_queue.cc:1048] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.548923 20676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4ccf36d717743f9b82872dd920685a5"
dest_uuid: "b950009a7cf4486187570819f25f6474"
mode: GRACEFUL
new_leader_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:56554
I20260709 12:15:50.549417 20676 raft_consensus.cc:606] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Received request to transfer leadership to TS d8ac51280a96483496b0b04242053dd8
I20260709 12:15:50.553445 20676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a"
dest_uuid: "b950009a7cf4486187570819f25f6474"
mode: GRACEFUL
new_leader_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:56554
I20260709 12:15:50.553894 20676 raft_consensus.cc:606] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Received request to transfer leadership to TS d8ac51280a96483496b0b04242053dd8
I20260709 12:15:50.560308 20676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e024997893f4294810835b3579fb30c"
dest_uuid: "b950009a7cf4486187570819f25f6474"
mode: GRACEFUL
new_leader_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:56554
I20260709 12:15:50.560735 20676 raft_consensus.cc:606] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Received request to transfer leadership to TS d8ac51280a96483496b0b04242053dd8
I20260709 12:15:50.571133 20601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
mode: GRACEFUL
new_leader_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:57430
I20260709 12:15:50.571522 20601 raft_consensus.cc:606] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Received request to transfer leadership to TS d8ac51280a96483496b0b04242053dd8
I20260709 12:15:50.575278 20676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26"
dest_uuid: "b950009a7cf4486187570819f25f6474"
mode: GRACEFUL
new_leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:56554
I20260709 12:15:50.575652 20676 raft_consensus.cc:606] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Received request to transfer leadership to TS a60f0d02c3fb45a3b666a0ac4ff9e8b9
I20260709 12:15:50.581319 20676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4"
dest_uuid: "b950009a7cf4486187570819f25f6474"
mode: GRACEFUL
new_leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:56554
I20260709 12:15:50.581684 20676 raft_consensus.cc:606] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Received request to transfer leadership to TS a60f0d02c3fb45a3b666a0ac4ff9e8b9
I20260709 12:15:50.592455 20528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cbc8a590c2940acbd3e153ea19cea7e"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
mode: GRACEFUL
new_leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:36566
I20260709 12:15:50.592896 20528 raft_consensus.cc:606] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Received request to transfer leadership to TS a60f0d02c3fb45a3b666a0ac4ff9e8b9
I20260709 12:15:50.596956 20601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "442cb4a9acdc487a933f3ed94c8df563"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
mode: GRACEFUL
new_leader_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:57430
I20260709 12:15:50.597491 20601 raft_consensus.cc:606] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Received request to transfer leadership to TS b950009a7cf4486187570819f25f6474
I20260709 12:15:50.665412 20720 consensus_queue.cc:1048] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.670572 20752 raft_consensus.cc:993] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474: : Instructing follower a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:15:50.670987 20748 raft_consensus.cc:1081] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Signalling peer a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:15:50.673565 20602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:57408
I20260709 12:15:50.674078 20602 raft_consensus.cc:493] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:50.674340 20602 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.675032 20748 consensus_queue.cc:1048] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.680765 20602 raft_consensus.cc:515] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.681823 20601 raft_consensus.cc:1240] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Rejecting Update request from peer b950009a7cf4486187570819f25f6474 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:50.684201 20602 leader_election.cc:290] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 2 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.684927 20748 consensus_queue.cc:1059] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.685163 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:50.685655 20748 raft_consensus.cc:3055] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:50.685966 20748 raft_consensus.cc:740] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:50.686383 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:50.686921 20528 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.686725 20748 consensus_queue.cc:260] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.687876 20748 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.691193 20528 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 2.
I20260709 12:15:50.693519 20568 leader_election.cc:304] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.694281 20725 raft_consensus.cc:2804] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:50.694741 20725 raft_consensus.cc:697] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Becoming Leader. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:15:50.695524 20725 consensus_queue.cc:237] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.697376 20676 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 2.
I20260709 12:15:50.701633 20424 catalog_manager.cc:5697] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 reported cstate change: term changed from 1 to 2, leader changed from b950009a7cf4486187570819f25f6474 (127.19.108.3) to a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.730545 20747 consensus_queue.cc:1048] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.740096 20798 consensus_queue.cc:1048] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.746953 20771 raft_consensus.cc:993] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8: : Instructing follower a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:15:50.747306 20798 raft_consensus.cc:1081] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Signalling peer a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:15:50.748553 20602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cbc8a590c2940acbd3e153ea19cea7e"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:57424
I20260709 12:15:50.748944 20602 raft_consensus.cc:493] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:50.749200 20602 raft_consensus.cc:3060] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.753551 20602 raft_consensus.cc:515] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.755378 20602 leader_election.cc:290] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 2 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.755889 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbc8a590c2940acbd3e153ea19cea7e" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:50.756438 20528 raft_consensus.cc:3055] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:50.756328 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cbc8a590c2940acbd3e153ea19cea7e" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:50.756796 20528 raft_consensus.cc:740] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:15:50.756978 20676 raft_consensus.cc:3060] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.757577 20528 consensus_queue.cc:260] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.758728 20528 raft_consensus.cc:3060] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.762969 20676 raft_consensus.cc:2468] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 2.
I20260709 12:15:50.763908 20567 leader_election.cc:304] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:15:50.764632 20740 raft_consensus.cc:2804] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:50.764628 20528 raft_consensus.cc:2468] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 2.
I20260709 12:15:50.765127 20740 raft_consensus.cc:697] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Becoming Leader. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:15:50.765883 20740 consensus_queue.cc:237] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.769214 20740 consensus_queue.cc:1048] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.772236 20426 catalog_manager.cc:5697] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 reported cstate change: term changed from 1 to 2, leader changed from d8ac51280a96483496b0b04242053dd8 (127.19.108.1) to a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.774500 20748 consensus_queue.cc:1048] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.781692 20755 raft_consensus.cc:993] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474: : Instructing follower a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:15:50.782078 20755 raft_consensus.cc:1081] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Signalling peer a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:15:50.784065 20601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:57408
I20260709 12:15:50.784566 20601 raft_consensus.cc:493] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:50.784924 20601 raft_consensus.cc:3060] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.785284 20738 consensus_queue.cc:1048] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.793152 20748 consensus_queue.cc:1048] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:50.795856 20601 raft_consensus.cc:515] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.797992 20601 leader_election.cc:290] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 2 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.798569 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:50.802294 20677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:50.802978 20677 raft_consensus.cc:3055] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:50.803380 20677 raft_consensus.cc:740] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:50.804095 20677 consensus_queue.cc:260] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.804914 20677 raft_consensus.cc:3060] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.809176 20738 raft_consensus.cc:993] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: : Instructing follower b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:15:50.809563 20738 raft_consensus.cc:1081] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Signalling peer b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:15:50.811189 20675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "442cb4a9acdc487a933f3ed94c8df563"
dest_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:56534
I20260709 12:15:50.811694 20675 raft_consensus.cc:493] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:50.812012 20675 raft_consensus.cc:3060] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.812984 20677 raft_consensus.cc:2468] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 2.
I20260709 12:15:50.815539 20567 leader_election.cc:304] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: d8ac51280a96483496b0b04242053dd8
I20260709 12:15:50.816112 20740 raft_consensus.cc:2804] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:50.816617 20740 raft_consensus.cc:697] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Becoming Leader. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:15:50.817281 20740 consensus_queue.cc:237] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.819213 20675 raft_consensus.cc:515] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.821692 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442cb4a9acdc487a933f3ed94c8df563" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:50.822041 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442cb4a9acdc487a933f3ed94c8df563" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:50.822201 20528 raft_consensus.cc:3060] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.822547 20601 raft_consensus.cc:3055] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:50.822949 20601 raft_consensus.cc:740] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:15:50.823621 20675 leader_election.cc:290] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 2 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:50.823719 20601 consensus_queue.cc:260] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.824780 20601 raft_consensus.cc:3060] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.824201 20423 catalog_manager.cc:5697] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 reported cstate change: term changed from 1 to 2, leader changed from b950009a7cf4486187570819f25f6474 (127.19.108.3) to a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.828135 20528 raft_consensus.cc:2468] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 2.
I20260709 12:15:50.829062 20642 leader_election.cc:304] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.829741 20748 raft_consensus.cc:2804] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:50.830086 20748 raft_consensus.cc:697] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 2 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:50.830667 20601 raft_consensus.cc:2468] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 2.
I20260709 12:15:50.830715 20748 consensus_queue.cc:237] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.837448 20423 catalog_manager.cc:5697] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 1 to 2, leader changed from a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2) to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:50.889994 20738 raft_consensus.cc:993] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9: : Instructing follower d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:15:50.890347 20740 raft_consensus.cc:1081] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Signalling peer d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:15:50.891536 20528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:36536
I20260709 12:15:50.891932 20528 raft_consensus.cc:493] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:50.892180 20528 raft_consensus.cc:3060] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.896140 20528 raft_consensus.cc:515] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.897572 20528 leader_election.cc:290] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.898207 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:50.898720 20601 raft_consensus.cc:3055] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:50.898746 20675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1c61a851e4f639ee2ff7078ec05ef" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:50.899128 20601 raft_consensus.cc:740] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:15:50.899375 20675 raft_consensus.cc:3060] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.899923 20601 consensus_queue.cc:260] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.900995 20601 raft_consensus.cc:3060] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.901224 20743 raft_consensus.cc:993] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474: : Instructing follower d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:15:50.901629 20748 raft_consensus.cc:1081] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Signalling peer d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:15:50.903216 20528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e024997893f4294810835b3579fb30c"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:36550
I20260709 12:15:50.903746 20528 raft_consensus.cc:493] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:50.904404 20528 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.905082 20675 raft_consensus.cc:2468] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:15:50.906329 20492 leader_election.cc:304] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.906529 20601 raft_consensus.cc:2468] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:15:50.907186 20771 raft_consensus.cc:2804] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:50.907632 20771 raft_consensus.cc:697] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:15:50.908383 20771 consensus_queue.cc:237] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.910936 20528 raft_consensus.cc:515] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.912570 20528 leader_election.cc:290] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.913436 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:50.913622 20675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:50.914036 20601 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.914175 20675 raft_consensus.cc:3055] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:50.914575 20675 raft_consensus.cc:740] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:50.915329 20675 consensus_queue.cc:260] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.916447 20675 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.916471 20423 catalog_manager.cc:5697] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 1 to 2, leader changed from a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2) to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.918310 20601 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:15:50.919140 20494 leader_election.cc:304] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.919709 20771 raft_consensus.cc:2804] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:50.920058 20771 raft_consensus.cc:697] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:15:50.920720 20771 consensus_queue.cc:237] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.922219 20675 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:15:50.928311 20423 catalog_manager.cc:5697] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 1 to 2, leader changed from b950009a7cf4486187570819f25f6474 (127.19.108.3) to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.965018 20743 raft_consensus.cc:993] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474: : Instructing follower d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:15:50.965369 20748 raft_consensus.cc:1081] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Signalling peer d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:15:50.966552 20528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4ccf36d717743f9b82872dd920685a5"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:36550
I20260709 12:15:50.966957 20528 raft_consensus.cc:493] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:50.967206 20528 raft_consensus.cc:3060] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.971062 20528 raft_consensus.cc:515] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:50.972492 20528 leader_election.cc:290] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Requested vote from peers b950009a7cf4486187570819f25f6474 (127.19.108.3:36847), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:50.973032 20675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccf36d717743f9b82872dd920685a5" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:50.973331 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ccf36d717743f9b82872dd920685a5" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:50.973563 20675 raft_consensus.cc:3055] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:50.973778 20601 raft_consensus.cc:3060] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.973868 20675 raft_consensus.cc:740] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:50.974529 20675 consensus_queue.cc:260] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:50.975378 20675 raft_consensus.cc:3060] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.977897 20601 raft_consensus.cc:2468] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:15:50.978703 20494 leader_election.cc:304] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.979421 20771 raft_consensus.cc:2804] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:50.979561 20675 raft_consensus.cc:2468] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:15:50.979954 20771 raft_consensus.cc:697] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:15:50.980731 20771 consensus_queue.cc:237] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } }
I20260709 12:15:50.981763 20743 raft_consensus.cc:993] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474: : Instructing follower d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:15:50.982147 20748 raft_consensus.cc:1081] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Signalling peer d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:15:50.983512 20528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:36550
I20260709 12:15:50.983983 20528 raft_consensus.cc:493] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:50.984261 20528 raft_consensus.cc:3060] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.987262 20423 catalog_manager.cc:5697] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 1 to 2, leader changed from b950009a7cf4486187570819f25f6474 (127.19.108.3) to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:50.989730 20528 raft_consensus.cc:515] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.991231 20528 leader_election.cc:290] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:15:50.992110 20675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:15:50.992164 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:50.992528 20675 raft_consensus.cc:3055] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:50.992712 20601 raft_consensus.cc:3060] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.992836 20675 raft_consensus.cc:740] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:50.993626 20675 consensus_queue.cc:260] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:50.994697 20675 raft_consensus.cc:3060] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:50.997531 20601 raft_consensus.cc:2468] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:15:50.998349 20494 leader_election.cc:304] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:15:50.999055 20771 raft_consensus.cc:2804] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:50.999032 20675 raft_consensus.cc:2468] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:15:50.999521 20771 raft_consensus.cc:697] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:15:51.000312 20771 consensus_queue.cc:237] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:51.005478 20423 catalog_manager.cc:5697] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 1 to 2, leader changed from b950009a7cf4486187570819f25f6474 (127.19.108.3) to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:51.170055 20675 raft_consensus.cc:1275] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.170732 20528 raft_consensus.cc:1275] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.171301 20740 consensus_queue.cc:1048] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.171931 20738 consensus_queue.cc:1048] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.226895 20675 raft_consensus.cc:1275] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.228112 20804 consensus_queue.cc:1048] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.234400 20528 raft_consensus.cc:1275] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.236440 20804 consensus_queue.cc:1048] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.239513 20676 raft_consensus.cc:1275] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.240880 20740 consensus_queue.cc:1048] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.247654 20528 raft_consensus.cc:3060] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.252732 20528 raft_consensus.cc:1275] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.253670 20804 consensus_queue.cc:1048] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.306645 20528 raft_consensus.cc:1275] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.307756 20748 consensus_queue.cc:1048] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.310638 20601 raft_consensus.cc:1275] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.311844 20748 consensus_queue.cc:1048] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.331059 20601 raft_consensus.cc:1275] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.332012 20726 consensus_queue.cc:1048] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.339054 20676 raft_consensus.cc:1275] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.340406 20798 consensus_queue.cc:1048] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.368513 20601 raft_consensus.cc:1275] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.369531 20798 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.375836 20676 raft_consensus.cc:1275] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.377714 20807 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.436203 20676 raft_consensus.cc:1275] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.437233 20807 consensus_queue.cc:1048] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.444384 20601 raft_consensus.cc:1275] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.445881 20807 consensus_queue.cc:1048] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.517283 20601 raft_consensus.cc:1275] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.518308 20807 consensus_queue.cc:1048] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.526800 20676 raft_consensus.cc:1275] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.528137 20771 consensus_queue.cc:1048] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.624010 19888 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:15:53.624868 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:53.639935 20528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e024997893f4294810835b3579fb30c"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
mode: GRACEFUL
new_leader_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:36580
I20260709 12:15:53.640318 20528 raft_consensus.cc:606] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Received request to transfer leadership to TS b950009a7cf4486187570819f25f6474
I20260709 12:15:53.642205 20528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
mode: GRACEFUL
new_leader_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:36580
I20260709 12:15:53.642539 20528 raft_consensus.cc:606] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Received request to transfer leadership to TS b950009a7cf4486187570819f25f6474
I20260709 12:15:53.643276 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:53.643636 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:53.826660 20811 raft_consensus.cc:993] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8: : Instructing follower b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:15:53.827062 20818 raft_consensus.cc:1081] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Signalling peer b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:15:53.828404 20676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063"
dest_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:56542
I20260709 12:15:53.828817 20676 raft_consensus.cc:493] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:53.829085 20676 raft_consensus.cc:3060] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.833232 20676 raft_consensus.cc:515] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:53.834829 20676 leader_election.cc:290] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 2 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:53.835544 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:53.835714 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:53.836069 20528 raft_consensus.cc:3055] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:53.836129 20601 raft_consensus.cc:3060] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.836377 20528 raft_consensus.cc:740] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:15:53.836963 20528 consensus_queue.cc:260] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:53.837708 20528 raft_consensus.cc:3060] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.839843 20601 raft_consensus.cc:2468] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 2.
I20260709 12:15:53.840692 20643 leader_election.cc:304] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:15:53.841254 20814 raft_consensus.cc:2804] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.841466 20528 raft_consensus.cc:2468] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 2.
I20260709 12:15:53.842286 20814 raft_consensus.cc:697] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 2 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:53.842931 20814 consensus_queue.cc:237] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:53.849285 20424 catalog_manager.cc:5697] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 1 to 2, leader changed from d8ac51280a96483496b0b04242053dd8 (127.19.108.1) to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:54.056828 20811 raft_consensus.cc:993] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8: : Instructing follower b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:15:54.057212 20818 raft_consensus.cc:1081] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Signalling peer b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:15:54.058794 20676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e024997893f4294810835b3579fb30c"
dest_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:56542
I20260709 12:15:54.059283 20676 raft_consensus.cc:493] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:54.059561 20676 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.063742 20676 raft_consensus.cc:515] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:54.065174 20676 leader_election.cc:290] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 3 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:15:54.065966 20528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:15:54.066205 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:15:54.066521 20528 raft_consensus.cc:3055] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:54.066681 20601 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.066890 20528 raft_consensus.cc:740] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:15:54.067616 20528 consensus_queue.cc:260] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:54.068673 20528 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.070513 20601 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 3.
I20260709 12:15:54.071293 20643 leader_election.cc:304] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:15:54.071895 20814 raft_consensus.cc:2804] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:54.072345 20814 raft_consensus.cc:697] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 3 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:15:54.073079 20814 consensus_queue.cc:237] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:15:54.073645 20528 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 3.
I20260709 12:15:54.079545 20424 catalog_manager.cc:5697] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 2 to 3, leader changed from d8ac51280a96483496b0b04242053dd8 (127.19.108.1) to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:54.344123 20602 raft_consensus.cc:1275] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.345146 20814 consensus_queue.cc:1048] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:54.353930 20528 raft_consensus.cc:1275] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:54.355446 20814 consensus_queue.cc:1048] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:54.530069 20602 raft_consensus.cc:1275] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:54.531139 20814 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:54.538352 20528 raft_consensus.cc:1275] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:54.539736 20828 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:54.644492 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:54.651288 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:54.651600 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:55.652383 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:55.657594 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:55.657912 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:56.658690 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:56.663897 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:56.664217 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:57.664973 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:57.670006 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:57.670333 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:58.671314 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:58.679370 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:58.679751 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:59.680681 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:59.687139 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:59.687489 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:00.688300 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:00.694397 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:00.694746 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:01.695547 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:01.701228 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:01.701696 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:02.702564 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:02.707669 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:02.707983 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:03.734416 19888 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:16:03.742424 20676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063"
dest_uuid: "b950009a7cf4486187570819f25f6474"
mode: GRACEFUL
new_leader_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:56554
I20260709 12:16:03.743000 20676 raft_consensus.cc:606] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 2 LEADER]: Received request to transfer leadership to TS d8ac51280a96483496b0b04242053dd8
I20260709 12:16:03.747032 20676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e024997893f4294810835b3579fb30c"
dest_uuid: "b950009a7cf4486187570819f25f6474"
mode: GRACEFUL
new_leader_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:56554
I20260709 12:16:03.747385 20676 raft_consensus.cc:606] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 3 LEADER]: Received request to transfer leadership to TS d8ac51280a96483496b0b04242053dd8
I20260709 12:16:03.753242 20601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
mode: GRACEFUL
new_leader_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:57430
I20260709 12:16:03.753610 20601 raft_consensus.cc:606] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Received request to transfer leadership to TS d8ac51280a96483496b0b04242053dd8
I20260709 12:16:03.757400 20601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
mode: GRACEFUL
new_leader_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:57430
I20260709 12:16:03.757753 20601 raft_consensus.cc:606] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Received request to transfer leadership to TS d8ac51280a96483496b0b04242053dd8
I20260709 12:16:03.761482 20601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
mode: GRACEFUL
new_leader_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:57430
I20260709 12:16:03.761852 20601 raft_consensus.cc:606] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Received request to transfer leadership to TS d8ac51280a96483496b0b04242053dd8
I20260709 12:16:03.832835 20835 raft_consensus.cc:993] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474: : Instructing follower d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:03.833282 20845 raft_consensus.cc:1081] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 2 LEADER]: Signalling peer d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:03.834604 20527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:36550
I20260709 12:16:03.835047 20527 raft_consensus.cc:493] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:03.835369 20527 raft_consensus.cc:3060] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:03.841328 20527 raft_consensus.cc:515] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:03.842978 20527 leader_election.cc:290] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 3 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:16:03.843693 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:16:03.843940 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafb06f36d144072868f8cfd58e82063" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:16:03.844345 20601 raft_consensus.cc:3060] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:03.844463 20676 raft_consensus.cc:3055] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:03.844749 20676 raft_consensus.cc:740] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:16:03.845424 20676 consensus_queue.cc:260] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:03.846542 20676 raft_consensus.cc:3060] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:03.849390 20601 raft_consensus.cc:2468] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 3.
I20260709 12:16:03.850442 20494 leader_election.cc:304] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:16:03.851302 20838 raft_consensus.cc:2804] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:03.851711 20676 raft_consensus.cc:2468] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 3.
I20260709 12:16:03.852205 20838 raft_consensus.cc:697] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 3 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:16:03.853298 20838 consensus_queue.cc:237] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:03.860739 20426 catalog_manager.cc:5697] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 2 to 3, leader changed from b950009a7cf4486187570819f25f6474 (127.19.108.3) to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 3 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:03.867874 20844 raft_consensus.cc:993] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: : Instructing follower d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:03.868335 20725 raft_consensus.cc:1081] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Signalling peer d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:03.869778 20527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:36536
I20260709 12:16:03.870262 20527 raft_consensus.cc:493] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:03.870540 20527 raft_consensus.cc:3060] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:03.875314 20527 raft_consensus.cc:515] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:03.876690 20527 leader_election.cc:290] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:16:03.877314 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:16:03.877550 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:16:03.877800 20601 raft_consensus.cc:3055] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:03.877970 20676 raft_consensus.cc:3060] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:03.878120 20601 raft_consensus.cc:740] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:16:03.878813 20601 consensus_queue.cc:260] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:03.879691 20601 raft_consensus.cc:3060] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:03.881773 20676 raft_consensus.cc:2468] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:16:03.882639 20492 leader_election.cc:304] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:16:03.883381 20838 raft_consensus.cc:2804] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:03.883718 20838 raft_consensus.cc:697] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:16:03.884205 20601 raft_consensus.cc:2468] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 2.
I20260709 12:16:03.884409 20838 consensus_queue.cc:237] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:03.890221 20426 catalog_manager.cc:5697] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 1 to 2, leader changed from a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2) to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.119174 20835 raft_consensus.cc:993] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474: : Instructing follower d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:04.119580 20845 raft_consensus.cc:1081] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 3 LEADER]: Signalling peer d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:04.120793 20527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e024997893f4294810835b3579fb30c"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:36550
I20260709 12:16:04.121235 20527 raft_consensus.cc:493] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.121503 20527 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:04.125560 20527 raft_consensus.cc:515] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:04.126770 20527 leader_election.cc:290] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 4 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:16:04.127424 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:16:04.127708 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:16:04.127893 20601 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:04.128160 20676 raft_consensus.cc:3055] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:04.128389 20676 raft_consensus.cc:740] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:16:04.128975 20676 consensus_queue.cc:260] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:04.129743 20676 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:04.132133 20601 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 4.
I20260709 12:16:04.132900 20494 leader_election.cc:304] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:16:04.133729 20846 raft_consensus.cc:2804] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:04.134160 20846 raft_consensus.cc:697] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 4 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:16:04.134779 20676 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 4.
I20260709 12:16:04.135010 20846 consensus_queue.cc:237] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:04.141544 20426 catalog_manager.cc:5697] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 3 to 4, leader changed from b950009a7cf4486187570819f25f6474 (127.19.108.3) to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 4 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.157701 20844 raft_consensus.cc:993] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: : Instructing follower d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:04.158108 20725 raft_consensus.cc:1081] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Signalling peer d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:04.159374 20527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:36536
I20260709 12:16:04.159837 20527 raft_consensus.cc:493] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.160161 20527 raft_consensus.cc:3060] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.166153 20527 raft_consensus.cc:515] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:04.167845 20527 leader_election.cc:290] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 3 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:16:04.168699 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:16:04.169219 20601 raft_consensus.cc:3055] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:04.169394 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211a1162451a4dd2ad38ab6682fb9cd4" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:16:04.169525 20601 raft_consensus.cc:740] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:16:04.169904 20676 raft_consensus.cc:3060] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.170332 20601 consensus_queue.cc:260] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:04.171424 20601 raft_consensus.cc:3060] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.175698 20676 raft_consensus.cc:2468] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 3.
I20260709 12:16:04.176599 20492 leader_election.cc:304] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:16:04.177052 20601 raft_consensus.cc:2468] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 3.
I20260709 12:16:04.177273 20846 raft_consensus.cc:2804] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:04.177706 20846 raft_consensus.cc:697] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 3 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:16:04.178437 20846 consensus_queue.cc:237] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:04.184178 20426 catalog_manager.cc:5697] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 2 to 3, leader changed from a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2) to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 3 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.230680 20844 raft_consensus.cc:993] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: : Instructing follower d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:04.231093 20725 raft_consensus.cc:1081] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Signalling peer d8ac51280a96483496b0b04242053dd8 to start an election
I20260709 12:16:04.232201 20527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
 from {username='slave'} at 127.0.0.1:36536
I20260709 12:16:04.232576 20527 raft_consensus.cc:493] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:04.232811 20527 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.236784 20527 raft_consensus.cc:515] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:04.238013 20527 leader_election.cc:290] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 3 election: Requested vote from peers a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:16:04.238675 20601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:16:04.238876 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "d8ac51280a96483496b0b04242053dd8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:16:04.239205 20601 raft_consensus.cc:3055] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:04.239300 20676 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.239467 20601 raft_consensus.cc:740] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:16:04.240167 20601 consensus_queue.cc:260] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:04.241017 20601 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.243846 20676 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 3.
I20260709 12:16:04.244590 20492 leader_election.cc:304] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b950009a7cf4486187570819f25f6474, d8ac51280a96483496b0b04242053dd8; no voters: 
I20260709 12:16:04.245116 20846 raft_consensus.cc:2804] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:04.245544 20846 raft_consensus.cc:697] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 3 LEADER]: Becoming Leader. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:16:04.245839 20601 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ac51280a96483496b0b04242053dd8 in term 3.
I20260709 12:16:04.246456 20846 consensus_queue.cc:237] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:04.252498 20426 catalog_manager.cc:5697] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 reported cstate change: term changed from 2 to 3, leader changed from a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2) to d8ac51280a96483496b0b04242053dd8 (127.19.108.1). New cstate: current_term: 3 leader_uuid: "d8ac51280a96483496b0b04242053dd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.308172 20676 raft_consensus.cc:1275] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.309371 20846 consensus_queue.cc:1048] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:04.318938 20601 raft_consensus.cc:1275] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.320664 20838 consensus_queue.cc:1048] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:04.373826 20601 raft_consensus.cc:1275] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.374960 20838 consensus_queue.cc:1048] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:04.383167 20675 raft_consensus.cc:1275] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.384636 20838 consensus_queue.cc:1048] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:04.595255 20601 raft_consensus.cc:1275] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.596144 20838 consensus_queue.cc:1048] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:04.604269 20675 raft_consensus.cc:1275] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.605497 20846 consensus_queue.cc:1048] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:04.676483 20675 raft_consensus.cc:1275] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 4 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:04.677510 20846 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:04.685248 20601 raft_consensus.cc:1275] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 4 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:04.686507 20838 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:04.731112 20675 raft_consensus.cc:1275] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.732153 20838 consensus_queue.cc:1048] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:04.740682 20601 raft_consensus.cc:1275] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Refusing update from remote peer d8ac51280a96483496b0b04242053dd8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.741894 20838 consensus_queue.cc:1048] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.791524 19888 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:16:06.792124 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:06.799208 20527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
mode: GRACEFUL
new_leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:36580
I20260709 12:16:06.799610 20527 raft_consensus.cc:606] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 3 LEADER]: Received request to transfer leadership to TS a60f0d02c3fb45a3b666a0ac4ff9e8b9
I20260709 12:16:06.801774 20527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e024997893f4294810835b3579fb30c"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
mode: GRACEFUL
new_leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:36580
I20260709 12:16:06.802217 20527 raft_consensus.cc:606] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 4 LEADER]: Received request to transfer leadership to TS a60f0d02c3fb45a3b666a0ac4ff9e8b9
I20260709 12:16:06.804215 20527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
mode: GRACEFUL
new_leader_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:36580
I20260709 12:16:06.804565 20527 raft_consensus.cc:606] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Received request to transfer leadership to TS b950009a7cf4486187570819f25f6474
I20260709 12:16:06.806329 20527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940"
dest_uuid: "d8ac51280a96483496b0b04242053dd8"
mode: GRACEFUL
new_leader_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:36580
I20260709 12:16:06.806679 20527 raft_consensus.cc:606] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Received request to transfer leadership to TS b950009a7cf4486187570819f25f6474
I20260709 12:16:06.807442 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:06.807778 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:06.866660 20862 raft_consensus.cc:993] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8: : Instructing follower a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:16:06.867226 20872 raft_consensus.cc:1081] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 3 LEADER]: Signalling peer a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:16:06.868610 20602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:57424
I20260709 12:16:06.868979 20602 raft_consensus.cc:493] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.869210 20602 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.873260 20602 raft_consensus.cc:515] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:06.874888 20602 leader_election.cc:290] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 4 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:16:06.875592 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:16:06.875684 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d7236493a9d4e67a13c5dce09813e26" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:16:06.876087 20527 raft_consensus.cc:3055] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:06.876209 20676 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.876355 20527 raft_consensus.cc:740] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:16:06.877022 20527 consensus_queue.cc:260] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:06.877826 20527 raft_consensus.cc:3060] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.880185 20676 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 4.
I20260709 12:16:06.881049 20567 leader_election.cc:304] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:16:06.881611 20725 raft_consensus.cc:2804] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:06.882112 20527 raft_consensus.cc:2468] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 4.
I20260709 12:16:06.882380 20725 raft_consensus.cc:697] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 4 LEADER]: Becoming Leader. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:16:06.883080 20725 consensus_queue.cc:237] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:06.888279 20423 catalog_manager.cc:5697] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 reported cstate change: term changed from 3 to 4, leader changed from d8ac51280a96483496b0b04242053dd8 (127.19.108.1) to a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2). New cstate: current_term: 4 leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.927815 20862 raft_consensus.cc:993] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8: : Instructing follower a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:16:06.928195 20872 raft_consensus.cc:1081] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 4 LEADER]: Signalling peer a60f0d02c3fb45a3b666a0ac4ff9e8b9 to start an election
I20260709 12:16:06.929400 20602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e024997893f4294810835b3579fb30c"
dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
 from {username='slave'} at 127.0.0.1:57424
I20260709 12:16:06.929747 20602 raft_consensus.cc:493] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.929950 20602 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:06.933723 20602 raft_consensus.cc:515] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:06.935047 20602 leader_election.cc:290] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 5 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), b950009a7cf4486187570819f25f6474 (127.19.108.3:36847)
I20260709 12:16:06.935667 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:16:06.935911 20676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e024997893f4294810835b3579fb30c" candidate_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b950009a7cf4486187570819f25f6474"
I20260709 12:16:06.936088 20527 raft_consensus.cc:3055] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:06.936342 20676 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:06.936338 20527 raft_consensus.cc:740] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:16:06.937084 20527 consensus_queue.cc:260] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:06.937824 20527 raft_consensus.cc:3060] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:06.940081 20676 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 5.
I20260709 12:16:06.940820 20567 leader_election.cc:304] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:16:06.941344 20725 raft_consensus.cc:2804] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:06.941653 20725 raft_consensus.cc:697] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 5 LEADER]: Becoming Leader. State: Replica: a60f0d02c3fb45a3b666a0ac4ff9e8b9, State: Running, Role: LEADER
I20260709 12:16:06.941859 20527 raft_consensus.cc:2468] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a60f0d02c3fb45a3b666a0ac4ff9e8b9 in term 5.
I20260709 12:16:06.942265 20725 consensus_queue.cc:237] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:06.947721 20423 catalog_manager.cc:5697] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 reported cstate change: term changed from 4 to 5, leader changed from d8ac51280a96483496b0b04242053dd8 (127.19.108.1) to a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.955597 20872 raft_consensus.cc:993] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8: : Instructing follower b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:16:06.955964 20862 raft_consensus.cc:1081] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Signalling peer b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:16:06.957036 20676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a"
dest_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:56542
I20260709 12:16:06.957396 20676 raft_consensus.cc:493] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.957636 20676 raft_consensus.cc:3060] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.961083 20676 raft_consensus.cc:515] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:06.962589 20676 leader_election.cc:290] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 3 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:16:06.963142 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:16:06.963502 20602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ff187d428401e9f52e19406130c9a" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:16:06.963608 20527 raft_consensus.cc:3055] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:06.963943 20527 raft_consensus.cc:740] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:16:06.963958 20602 raft_consensus.cc:3060] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.964556 20527 consensus_queue.cc:260] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:06.965307 20527 raft_consensus.cc:3060] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.967517 20602 raft_consensus.cc:2468] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 3.
I20260709 12:16:06.968525 20643 leader_election.cc:304] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:16:06.969244 20871 raft_consensus.cc:2804] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:06.969255 20527 raft_consensus.cc:2468] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 3.
I20260709 12:16:06.970423 20871 raft_consensus.cc:697] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 3 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:16:06.971184 20871 consensus_queue.cc:237] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:06.977254 20423 catalog_manager.cc:5697] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 2 to 3, leader changed from d8ac51280a96483496b0b04242053dd8 (127.19.108.1) to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:07.320924 20872 raft_consensus.cc:993] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8: : Instructing follower b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:16:07.321350 20862 raft_consensus.cc:1081] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Signalling peer b950009a7cf4486187570819f25f6474 to start an election
I20260709 12:16:07.322559 20676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940"
dest_uuid: "b950009a7cf4486187570819f25f6474"
 from {username='slave'} at 127.0.0.1:56542
I20260709 12:16:07.322978 20676 raft_consensus.cc:493] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.323230 20676 raft_consensus.cc:3060] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.327054 20676 raft_consensus.cc:515] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:07.328285 20676 leader_election.cc:290] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 3 election: Requested vote from peers d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927), a60f0d02c3fb45a3b666a0ac4ff9e8b9 (127.19.108.2:38071)
I20260709 12:16:07.328956 20527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8ac51280a96483496b0b04242053dd8"
I20260709 12:16:07.329255 20602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef96fc5bcd4648a4a1a282ba98170940" candidate_uuid: "b950009a7cf4486187570819f25f6474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9"
I20260709 12:16:07.329394 20527 raft_consensus.cc:3055] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:07.329664 20527 raft_consensus.cc:740] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8ac51280a96483496b0b04242053dd8, State: Running, Role: LEADER
I20260709 12:16:07.329675 20602 raft_consensus.cc:3060] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.330267 20527 consensus_queue.cc:260] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:07.331141 20527 raft_consensus.cc:3060] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.333630 20602 raft_consensus.cc:2468] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 3.
I20260709 12:16:07.334481 20643 leader_election.cc:304] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a60f0d02c3fb45a3b666a0ac4ff9e8b9, b950009a7cf4486187570819f25f6474; no voters: 
I20260709 12:16:07.335172 20871 raft_consensus.cc:2804] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.335604 20871 raft_consensus.cc:697] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 3 LEADER]: Becoming Leader. State: Replica: b950009a7cf4486187570819f25f6474, State: Running, Role: LEADER
I20260709 12:16:07.336356 20527 raft_consensus.cc:2468] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b950009a7cf4486187570819f25f6474 in term 3.
I20260709 12:16:07.336400 20871 consensus_queue.cc:237] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } }
I20260709 12:16:07.342386 20676 raft_consensus.cc:1275] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 5 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:07.343425 20725 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:07.343541 20423 catalog_manager.cc:5697] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 reported cstate change: term changed from 2 to 3, leader changed from d8ac51280a96483496b0b04242053dd8 (127.19.108.1) to b950009a7cf4486187570819f25f6474 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "b950009a7cf4486187570819f25f6474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:07.354800 20527 raft_consensus.cc:1275] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 5 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:07.355789 20887 consensus_queue.cc:1048] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:07.372438 20527 raft_consensus.cc:1275] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 4 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:07.373405 20887 consensus_queue.cc:1048] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:07.380985 20676 raft_consensus.cc:1275] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 4 FOLLOWER]: Refusing update from remote peer a60f0d02c3fb45a3b666a0ac4ff9e8b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:07.382635 20725 consensus_queue.cc:1048] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b950009a7cf4486187570819f25f6474" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:07.442579 20602 raft_consensus.cc:1275] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:07.443542 20871 consensus_queue.cc:1048] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:07.451064 20527 raft_consensus.cc:1275] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:07.452445 20871 consensus_queue.cc:1048] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:07.808516 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:07.813611 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:07.813925 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:07.913245 20527 raft_consensus.cc:1275] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:07.914196 20871 consensus_queue.cc:1048] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac51280a96483496b0b04242053dd8" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 41927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:07.922268 20601 raft_consensus.cc:1275] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Refusing update from remote peer b950009a7cf4486187570819f25f6474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:07.923391 20881 consensus_queue.cc:1048] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a60f0d02c3fb45a3b666a0ac4ff9e8b9" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:08.814953 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:08.821310 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:08.821676 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:09.822542 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:09.828099 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:09.828469 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:10.829275 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:10.834394 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:10.834765 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:11.835726 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:11.841845 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:11.842216 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:12.843003 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:12.848109 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:12.848474 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:13.849256 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:13.854774 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:13.855191 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:14.856012 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:14.861157 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:14.861519 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:15.862289 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:15.868345 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:15.868721 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:16.895159 19888 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:16:16.895610 19888 tablet_server.cc:179] TabletServer@127.19.108.1:0 shutting down...
I20260709 12:16:16.918437 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:16.919075 19888 tablet_replica.cc:333] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.919736 19888 raft_consensus.cc:2243] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:16.920238 19888 raft_consensus.cc:2272] T 442cb4a9acdc487a933f3ed94c8df563 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.922101 19888 tablet_replica.cc:333] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.922586 19888 raft_consensus.cc:2243] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:16.922973 19888 raft_consensus.cc:2272] T 1d7236493a9d4e67a13c5dce09813e26 P d8ac51280a96483496b0b04242053dd8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.924535 19888 tablet_replica.cc:333] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.924997 19888 raft_consensus.cc:2243] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:16.925364 19888 raft_consensus.cc:2272] T ef96fc5bcd4648a4a1a282ba98170940 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.927239 19888 tablet_replica.cc:333] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.927934 19888 raft_consensus.cc:2243] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:16:16.928130 20568 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 12:16:16.929001 19888 raft_consensus.cc:2272] T 211a1162451a4dd2ad38ab6682fb9cd4 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:16.931171 20568 consensus_peers.cc:597] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 -> Peer d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927): Couldn't send request to peer d8ac51280a96483496b0b04242053dd8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:16.931450 19888 tablet_replica.cc:333] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.931952 19888 raft_consensus.cc:2243] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:16.932605 19888 raft_consensus.cc:2272] T efa1c61a851e4f639ee2ff7078ec05ef P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.934152 19888 tablet_replica.cc:333] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.934574 19888 raft_consensus.cc:2243] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:16.934981 19888 raft_consensus.cc:2272] T 8cbc8a590c2940acbd3e153ea19cea7e P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.936430 19888 tablet_replica.cc:333] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.936873 19888 raft_consensus.cc:2243] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:16.937215 19888 raft_consensus.cc:2272] T 4e024997893f4294810835b3579fb30c P d8ac51280a96483496b0b04242053dd8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.938783 19888 tablet_replica.cc:333] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.939234 19888 raft_consensus.cc:2243] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:16.940047 19888 raft_consensus.cc:2272] T cafb06f36d144072868f8cfd58e82063 P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.941864 19888 tablet_replica.cc:333] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.942305 19888 raft_consensus.cc:2243] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:16.942991 19888 raft_consensus.cc:2272] T c4ccf36d717743f9b82872dd920685a5 P d8ac51280a96483496b0b04242053dd8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.944530 19888 tablet_replica.cc:333] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8: stopping tablet replica
I20260709 12:16:16.944913 19888 raft_consensus.cc:2243] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:16.945266 19888 raft_consensus.cc:2272] T ca8ff187d428401e9f52e19406130c9a P d8ac51280a96483496b0b04242053dd8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:16.973637 19888 tablet_server.cc:196] TabletServer@127.19.108.1:0 shutdown complete.
W20260709 12:16:16.989913 20568 consensus_peers.cc:597] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 -> Peer d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927): Couldn't send request to peer d8ac51280a96483496b0b04242053dd8. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:41927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:16.993609 19888 tablet_server.cc:179] TabletServer@127.19.108.2:0 shutting down...
I20260709 12:16:17.016356 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:17.016958 19888 tablet_replica.cc:333] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.017566 19888 raft_consensus.cc:2243] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.018064 19888 raft_consensus.cc:2272] T cafb06f36d144072868f8cfd58e82063 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.019850 19888 tablet_replica.cc:333] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.020426 19888 raft_consensus.cc:2243] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.020855 19888 raft_consensus.cc:2272] T c4ccf36d717743f9b82872dd920685a5 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.022466 19888 tablet_replica.cc:333] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.022964 19888 raft_consensus.cc:2243] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.023331 19888 raft_consensus.cc:2272] T ca8ff187d428401e9f52e19406130c9a P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.024813 19888 tablet_replica.cc:333] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.025295 19888 raft_consensus.cc:2243] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.025965 19888 raft_consensus.cc:2272] T 8cbc8a590c2940acbd3e153ea19cea7e P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.027732 19888 tablet_replica.cc:333] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.028223 19888 raft_consensus.cc:2243] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.028915 19888 raft_consensus.cc:2272] T 4e024997893f4294810835b3579fb30c P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.030392 19888 tablet_replica.cc:333] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.030881 19888 raft_consensus.cc:2243] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.031579 19888 raft_consensus.cc:2272] T 1d7236493a9d4e67a13c5dce09813e26 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.033126 19888 tablet_replica.cc:333] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.033565 19888 raft_consensus.cc:2243] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.033969 19888 raft_consensus.cc:2272] T 442cb4a9acdc487a933f3ed94c8df563 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.035703 19888 tablet_replica.cc:333] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.036141 19888 raft_consensus.cc:2243] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.036545 19888 raft_consensus.cc:2272] T ef96fc5bcd4648a4a1a282ba98170940 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.038053 19888 tablet_replica.cc:333] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.038503 19888 raft_consensus.cc:2243] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.038898 19888 raft_consensus.cc:2272] T 211a1162451a4dd2ad38ab6682fb9cd4 P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.040417 19888 tablet_replica.cc:333] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9: stopping tablet replica
I20260709 12:16:17.040839 19888 raft_consensus.cc:2243] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.041210 19888 raft_consensus.cc:2272] T efa1c61a851e4f639ee2ff7078ec05ef P a60f0d02c3fb45a3b666a0ac4ff9e8b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.067582 19888 tablet_server.cc:196] TabletServer@127.19.108.2:0 shutdown complete.
I20260709 12:16:17.085902 19888 tablet_server.cc:179] TabletServer@127.19.108.3:0 shutting down...
I20260709 12:16:17.111244 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:17.111879 19888 tablet_replica.cc:333] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.112612 19888 raft_consensus.cc:2243] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.113198 19888 raft_consensus.cc:2272] T cafb06f36d144072868f8cfd58e82063 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:17.113242 20642 consensus_peers.cc:597] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 -> Peer d8ac51280a96483496b0b04242053dd8 (127.19.108.1:41927): Couldn't send request to peer d8ac51280a96483496b0b04242053dd8. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:41927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:17.115247 19888 tablet_replica.cc:333] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.115782 19888 raft_consensus.cc:2243] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.116235 19888 raft_consensus.cc:2272] T 211a1162451a4dd2ad38ab6682fb9cd4 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.117841 19888 tablet_replica.cc:333] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.118297 19888 raft_consensus.cc:2243] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.118705 19888 raft_consensus.cc:2272] T efa1c61a851e4f639ee2ff7078ec05ef P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.120236 19888 tablet_replica.cc:333] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.120728 19888 raft_consensus.cc:2243] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.121392 19888 raft_consensus.cc:2272] T ca8ff187d428401e9f52e19406130c9a P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.122980 19888 tablet_replica.cc:333] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.123413 19888 raft_consensus.cc:2243] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.124080 19888 raft_consensus.cc:2272] T 442cb4a9acdc487a933f3ed94c8df563 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.125577 19888 tablet_replica.cc:333] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.125996 19888 raft_consensus.cc:2243] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.126405 19888 raft_consensus.cc:2272] T 1d7236493a9d4e67a13c5dce09813e26 P b950009a7cf4486187570819f25f6474 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.127952 19888 tablet_replica.cc:333] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.128396 19888 raft_consensus.cc:2243] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.129009 19888 raft_consensus.cc:2272] T ef96fc5bcd4648a4a1a282ba98170940 P b950009a7cf4486187570819f25f6474 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.130539 19888 tablet_replica.cc:333] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.131023 19888 raft_consensus.cc:2243] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.131378 19888 raft_consensus.cc:2272] T 8cbc8a590c2940acbd3e153ea19cea7e P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.132876 19888 tablet_replica.cc:333] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.133281 19888 raft_consensus.cc:2243] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.133678 19888 raft_consensus.cc:2272] T 4e024997893f4294810835b3579fb30c P b950009a7cf4486187570819f25f6474 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.135195 19888 tablet_replica.cc:333] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474: stopping tablet replica
I20260709 12:16:17.135583 19888 raft_consensus.cc:2243] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.135932 19888 raft_consensus.cc:2272] T c4ccf36d717743f9b82872dd920685a5 P b950009a7cf4486187570819f25f6474 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.161649 19888 tablet_server.cc:196] TabletServer@127.19.108.3:0 shutdown complete.
I20260709 12:16:17.178951 19888 master.cc:562] Master@127.19.108.62:40419 shutting down...
I20260709 12:16:17.197399 19888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.197899 19888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.198189 19888 tablet_replica.cc:333] T 00000000000000000000000000000000 P c198b4a5dcc646c0970285e060212f86: stopping tablet replica
I20260709 12:16:17.216475 19888 master.cc:584] Master@127.19.108.62:40419 shutdown complete.
a60f0d02c3fb45a3b666a0ac4ff9e8b9  4
b950009a7cf4486187570819f25f6474  1
d8ac51280a96483496b0b04242053dd8  5
a60f0d02c3fb45a3b666a0ac4ff9e8b9  4
b950009a7cf4486187570819f25f6474  3
d8ac51280a96483496b0b04242053dd8  3
a60f0d02c3fb45a3b666a0ac4ff9e8b9  1
b950009a7cf4486187570819f25f6474  1
d8ac51280a96483496b0b04242053dd8  8
a60f0d02c3fb45a3b666a0ac4ff9e8b9  3
b950009a7cf4486187570819f25f6474  3
d8ac51280a96483496b0b04242053dd8  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28360 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:16:17.251688 19888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.108.62:42247
I20260709 12:16:17.252789 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:17.257568 20909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:17.258180 20910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:17.258857 20912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:17.259464 19888 server_base.cc:1061] running on GCE node
I20260709 12:16:17.260216 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:17.260396 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:17.260532 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599377260515 us; error 0 us; skew 500 ppm
I20260709 12:16:17.260995 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:17.263111 19888 webserver.cc:533] Webserver started at http://127.19.108.62:41409/ using document root <none> and password file <none>
I20260709 12:16:17.263532 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:17.263695 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:17.263937 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:17.264973 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/master-0-root/instance:
uuid: "d43fece763204ac08240a85f3921173b"
format_stamp: "Formatted at 2026-07-09 12:16:17 on dist-test-slave-0g1j"
I20260709 12:16:17.269335 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:16:17.272297 20917 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.272905 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:16:17.273161 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/master-0-root
uuid: "d43fece763204ac08240a85f3921173b"
format_stamp: "Formatted at 2026-07-09 12:16:17 on dist-test-slave-0g1j"
I20260709 12:16:17.273408 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:17.293941 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:17.295066 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:17.329957 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.62:42247
I20260709 12:16:17.330035 20968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.62:42247 every 8 connection(s)
I20260709 12:16:17.333675 20969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.342749 20969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Bootstrap starting.
I20260709 12:16:17.346908 20969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.350433 20969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: No bootstrap required, opened a new log
I20260709 12:16:17.352326 20969 raft_consensus.cc:359] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d43fece763204ac08240a85f3921173b" member_type: VOTER }
I20260709 12:16:17.352699 20969 raft_consensus.cc:385] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.352875 20969 raft_consensus.cc:740] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43fece763204ac08240a85f3921173b, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.353359 20969 consensus_queue.cc:260] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d43fece763204ac08240a85f3921173b" member_type: VOTER }
I20260709 12:16:17.353783 20969 raft_consensus.cc:399] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:17.353974 20969 raft_consensus.cc:493] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:17.354259 20969 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.357817 20969 raft_consensus.cc:515] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d43fece763204ac08240a85f3921173b" member_type: VOTER }
I20260709 12:16:17.358246 20969 leader_election.cc:304] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d43fece763204ac08240a85f3921173b; no voters: 
I20260709 12:16:17.359218 20969 leader_election.cc:290] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:17.359539 20972 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.360775 20972 raft_consensus.cc:697] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 1 LEADER]: Becoming Leader. State: Replica: d43fece763204ac08240a85f3921173b, State: Running, Role: LEADER
I20260709 12:16:17.361331 20972 consensus_queue.cc:237] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d43fece763204ac08240a85f3921173b" member_type: VOTER }
I20260709 12:16:17.361791 20969 sys_catalog.cc:565] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:17.364130 20973 sys_catalog.cc:455] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d43fece763204ac08240a85f3921173b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d43fece763204ac08240a85f3921173b" member_type: VOTER } }
I20260709 12:16:17.364204 20974 sys_catalog.cc:455] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d43fece763204ac08240a85f3921173b. Latest consensus state: current_term: 1 leader_uuid: "d43fece763204ac08240a85f3921173b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d43fece763204ac08240a85f3921173b" member_type: VOTER } }
I20260709 12:16:17.364775 20974 sys_catalog.cc:458] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:17.364699 20973 sys_catalog.cc:458] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:17.367269 20978 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:17.371704 20978 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:17.380084 20978 catalog_manager.cc:1383] Generated new cluster ID: efdeeaade18d4140a0b6f3c02f1a0e03
I20260709 12:16:17.380354 20978 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:17.380589 19888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:17.395342 20978 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:17.396485 20978 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:17.414377 20978 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Generated new TSK 0
I20260709 12:16:17.414896 20978 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:17.446201 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:17.451596 20990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:17.452297 20991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:17.453470 20993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:17.453928 19888 server_base.cc:1061] running on GCE node
I20260709 12:16:17.454643 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:17.454809 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:17.454981 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599377454967 us; error 0 us; skew 500 ppm
I20260709 12:16:17.455423 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:17.457373 19888 webserver.cc:533] Webserver started at http://127.19.108.1:33673/ using document root <none> and password file <none>
I20260709 12:16:17.457782 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:17.457931 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:17.458129 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:17.459125 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/instance:
uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
format_stamp: "Formatted at 2026-07-09 12:16:17 on dist-test-slave-0g1j"
I20260709 12:16:17.463023 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:16:17.465890 20998 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.466501 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:17.466763 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
format_stamp: "Formatted at 2026-07-09 12:16:17 on dist-test-slave-0g1j"
I20260709 12:16:17.467042 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:17.493157 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:17.494295 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:17.495671 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:17.497743 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:17.497924 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.498140 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:17.498298 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.534786 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:42723
I20260709 12:16:17.534889 21060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:42723 every 8 connection(s)
I20260709 12:16:17.539187 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:17.545218 21065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:17.547575 21066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:17.548872 21068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:17.549077 19888 server_base.cc:1061] running on GCE node
I20260709 12:16:17.549968 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:17.550165 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:17.550326 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599377550308 us; error 0 us; skew 500 ppm
I20260709 12:16:17.550896 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:17.553514 19888 webserver.cc:533] Webserver started at http://127.19.108.2:41127/ using document root <none> and password file <none>
I20260709 12:16:17.553565 21061 heartbeater.cc:344] Connected to a master server at 127.19.108.62:42247
I20260709 12:16:17.553953 21061 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:17.554152 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:17.554397 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:17.554704 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:17.554800 21061 heartbeater.cc:507] Master 127.19.108.62:42247 requested a full tablet report, sending...
I20260709 12:16:17.556070 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/instance:
uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
format_stamp: "Formatted at 2026-07-09 12:16:17 on dist-test-slave-0g1j"
I20260709 12:16:17.556870 20934 ts_manager.cc:194] Registered new tserver with Master: 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:16:17.558498 20934 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49666
I20260709 12:16:17.560382 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 12:16:17.563385 21073 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.564011 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260709 12:16:17.564261 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root
uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
format_stamp: "Formatted at 2026-07-09 12:16:17 on dist-test-slave-0g1j"
I20260709 12:16:17.564500 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:17.602083 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:17.603200 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:17.604513 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:17.606536 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:17.606719 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.606946 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:17.607103 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.643196 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.2:37643
I20260709 12:16:17.643285 21136 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.2:37643 every 8 connection(s)
I20260709 12:16:17.647500 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:17.653918 21140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:17.654428 21141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:17.656611 21143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:17.659446 21137 heartbeater.cc:344] Connected to a master server at 127.19.108.62:42247
I20260709 12:16:17.659798 21137 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:17.660254 19888 server_base.cc:1061] running on GCE node
I20260709 12:16:17.660571 21137 heartbeater.cc:507] Master 127.19.108.62:42247 requested a full tablet report, sending...
I20260709 12:16:17.661082 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:17.661284 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:17.661477 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599377661457 us; error 0 us; skew 500 ppm
I20260709 12:16:17.662150 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:17.662489 20934 ts_manager.cc:194] Registered new tserver with Master: a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:17.663964 20934 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49682
I20260709 12:16:17.664539 19888 webserver.cc:533] Webserver started at http://127.19.108.3:46143/ using document root <none> and password file <none>
I20260709 12:16:17.665139 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:17.665373 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:17.665683 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:17.666927 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/instance:
uuid: "694635cc4a20455fbbec925e0a84a1ee"
format_stamp: "Formatted at 2026-07-09 12:16:17 on dist-test-slave-0g1j"
I20260709 12:16:17.670883 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:16:17.673606 21148 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.674248 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:17.674479 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root
uuid: "694635cc4a20455fbbec925e0a84a1ee"
format_stamp: "Formatted at 2026-07-09 12:16:17 on dist-test-slave-0g1j"
I20260709 12:16:17.674702 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:17.684793 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:17.685768 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:17.687013 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:17.689073 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:17.689239 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.689414 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:17.689538 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:17.725361 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.3:36737
I20260709 12:16:17.725447 21211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.3:36737 every 8 connection(s)
I20260709 12:16:17.737387 21212 heartbeater.cc:344] Connected to a master server at 127.19.108.62:42247
I20260709 12:16:17.737712 21212 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:17.738354 21212 heartbeater.cc:507] Master 127.19.108.62:42247 requested a full tablet report, sending...
I20260709 12:16:17.740104 20934 ts_manager.cc:194] Registered new tserver with Master: 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:17.741211 19888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013020074s
I20260709 12:16:17.741398 20934 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49692
I20260709 12:16:17.763309 20934 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49700:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:17.769079 20934 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:17.943856 21100 tablet_service.cc:1511] Processing CreateTablet for tablet 0f86692ab0d642a990d934ba6bd6493f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:17.944130 21099 tablet_service.cc:1511] Processing CreateTablet for tablet e77746cf06a844b28506688985401b7d (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:17.944674 21101 tablet_service.cc:1511] Processing CreateTablet for tablet 03fd332fad7045099765ea2b69124fb6 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:17.945374 21100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f86692ab0d642a990d934ba6bd6493f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.945896 21098 tablet_service.cc:1511] Processing CreateTablet for tablet 1acde8fc7a134a5e9e141721bf0a4791 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:17.947391 21101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03fd332fad7045099765ea2b69124fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.948215 21097 tablet_service.cc:1511] Processing CreateTablet for tablet 7c63a55bdad346dabf469f0ab75f7020 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:17.949415 21097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c63a55bdad346dabf469f0ab75f7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.951478 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1acde8fc7a134a5e9e141721bf0a4791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.955437 21099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77746cf06a844b28506688985401b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.956279 21025 tablet_service.cc:1511] Processing CreateTablet for tablet 0f86692ab0d642a990d934ba6bd6493f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:17.957486 21025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f86692ab0d642a990d934ba6bd6493f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.959913 21024 tablet_service.cc:1511] Processing CreateTablet for tablet e77746cf06a844b28506688985401b7d (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:17.961130 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77746cf06a844b28506688985401b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.963888 21023 tablet_service.cc:1511] Processing CreateTablet for tablet 1acde8fc7a134a5e9e141721bf0a4791 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:17.965082 21023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1acde8fc7a134a5e9e141721bf0a4791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.967759 21227 tablet_bootstrap.cc:492] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:17.967846 21022 tablet_service.cc:1511] Processing CreateTablet for tablet 7c63a55bdad346dabf469f0ab75f7020 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:17.969115 21022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c63a55bdad346dabf469f0ab75f7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.971915 21021 tablet_service.cc:1511] Processing CreateTablet for tablet 747d6b1df3604e0ab07ec5ad8fa568cf (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:17.973132 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 747d6b1df3604e0ab07ec5ad8fa568cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.973698 21227 tablet_bootstrap.cc:654] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.976065 21026 tablet_service.cc:1511] Processing CreateTablet for tablet 03fd332fad7045099765ea2b69124fb6 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:17.977243 21026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03fd332fad7045099765ea2b69124fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.980139 21096 tablet_service.cc:1511] Processing CreateTablet for tablet 81f567d6458f4dddaa94452e04485030 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:17.981353 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f567d6458f4dddaa94452e04485030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.981819 21100 tablet_service.cc:1511] Processing CreateTablet for tablet 747d6b1df3604e0ab07ec5ad8fa568cf (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:17.983321 21100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 747d6b1df3604e0ab07ec5ad8fa568cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.985370 21095 tablet_service.cc:1511] Processing CreateTablet for tablet f505123ebaba425fa2dadd415e464dfa (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:17.986554 21095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f505123ebaba425fa2dadd415e464dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.991926 21094 tablet_service.cc:1511] Processing CreateTablet for tablet fa441bc31c5043668f08c6e72305c329 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:17.993166 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa441bc31c5043668f08c6e72305c329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.992973 21093 tablet_service.cc:1511] Processing CreateTablet for tablet aaaf493e892d4ee9839b45b601fc8400 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:17.994159 21093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaf493e892d4ee9839b45b601fc8400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.991926 21092 tablet_service.cc:1511] Processing CreateTablet for tablet e531721f3cd9498c9cc3b11699d5de8f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:17.995230 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e531721f3cd9498c9cc3b11699d5de8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.003087 21020 tablet_service.cc:1511] Processing CreateTablet for tablet 81f567d6458f4dddaa94452e04485030 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:18.004315 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f567d6458f4dddaa94452e04485030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.005291 21018 tablet_service.cc:1511] Processing CreateTablet for tablet fa441bc31c5043668f08c6e72305c329 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:18.006462 21018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa441bc31c5043668f08c6e72305c329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.007936 21019 tablet_service.cc:1511] Processing CreateTablet for tablet f505123ebaba425fa2dadd415e464dfa (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:18.008426 21017 tablet_service.cc:1511] Processing CreateTablet for tablet aaaf493e892d4ee9839b45b601fc8400 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:18.009675 21017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaf493e892d4ee9839b45b601fc8400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.011222 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f505123ebaba425fa2dadd415e464dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.034744 21227 tablet_bootstrap.cc:492] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:18.035218 21227 ts_tablet_manager.cc:1403] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.068s	user 0.002s	sys 0.010s
I20260709 12:16:18.037995 21227 raft_consensus.cc:359] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.041759 21099 tablet_service.cc:1511] Processing CreateTablet for tablet 11c217b90c5a4022be2281765e591c5a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:18.045509 21099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c217b90c5a4022be2281765e591c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.038679 21227 raft_consensus.cc:385] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.051615 21227 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.067317 21098 tablet_service.cc:1511] Processing CreateTablet for tablet b7f6c7d44dcf4a5787879c202071e5ba (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:18.067606 21101 tablet_service.cc:1511] Processing CreateTablet for tablet db9d39844048444b8a7293196d1349e9 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:18.071558 21023 tablet_service.cc:1511] Processing CreateTablet for tablet db9d39844048444b8a7293196d1349e9 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:18.073565 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f6c7d44dcf4a5787879c202071e5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.074148 21023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9d39844048444b8a7293196d1349e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.076367 21101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9d39844048444b8a7293196d1349e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.078120 21227 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.078754 21021 tablet_service.cc:1511] Processing CreateTablet for tablet 11c217b90c5a4022be2281765e591c5a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:18.079968 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c217b90c5a4022be2281765e591c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.080066 21092 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc4c9f937ef4713ba45ba63b0602a7a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:18.081288 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc4c9f937ef4713ba45ba63b0602a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.063005 21026 tablet_service.cc:1511] Processing CreateTablet for tablet e531721f3cd9498c9cc3b11699d5de8f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:18.089548 21026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e531721f3cd9498c9cc3b11699d5de8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.063004 21019 tablet_service.cc:1511] Processing CreateTablet for tablet b7f6c7d44dcf4a5787879c202071e5ba (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:18.105000 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f6c7d44dcf4a5787879c202071e5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.120580 21024 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc4c9f937ef4713ba45ba63b0602a7a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:18.121737 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc4c9f937ef4713ba45ba63b0602a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.122141 21229 tablet_bootstrap.cc:492] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:18.123759 21096 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa56a6078064852ac53dd912136460b (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:18.124872 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa56a6078064852ac53dd912136460b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.126220 21025 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa56a6078064852ac53dd912136460b (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:18.136277 21095 tablet_service.cc:1511] Processing CreateTablet for tablet b547f01ae7e54c0c870de561008eb7e0 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:18.137355 21176 tablet_service.cc:1511] Processing CreateTablet for tablet 03fd332fad7045099765ea2b69124fb6 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:18.138610 21176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03fd332fad7045099765ea2b69124fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.138504 21020 tablet_service.cc:1511] Processing CreateTablet for tablet b547f01ae7e54c0c870de561008eb7e0 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:18.139707 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b547f01ae7e54c0c870de561008eb7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.140818 21173 tablet_service.cc:1511] Processing CreateTablet for tablet 1acde8fc7a134a5e9e141721bf0a4791 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:18.137007 21022 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1a8045038f4383ba6d1a13bfda6966 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:18.137470 21095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b547f01ae7e54c0c870de561008eb7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.145043 21173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1acde8fc7a134a5e9e141721bf0a4791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.144790 21171 tablet_service.cc:1511] Processing CreateTablet for tablet 747d6b1df3604e0ab07ec5ad8fa568cf (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:18.146077 21171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 747d6b1df3604e0ab07ec5ad8fa568cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.146924 21097 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1a8045038f4383ba6d1a13bfda6966 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:18.148200 21097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1a8045038f4383ba6d1a13bfda6966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.148563 21170 tablet_service.cc:1511] Processing CreateTablet for tablet 81f567d6458f4dddaa94452e04485030 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:18.149771 21170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f567d6458f4dddaa94452e04485030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.146973 21168 tablet_service.cc:1511] Processing CreateTablet for tablet fa441bc31c5043668f08c6e72305c329 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:18.147114 21137 heartbeater.cc:499] Master 127.19.108.62:42247 was elected leader, sending a full tablet report...
I20260709 12:16:18.154556 21167 tablet_service.cc:1511] Processing CreateTablet for tablet aaaf493e892d4ee9839b45b601fc8400 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:18.138638 21175 tablet_service.cc:1511] Processing CreateTablet for tablet 0f86692ab0d642a990d934ba6bd6493f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:18.145254 21169 tablet_service.cc:1511] Processing CreateTablet for tablet f505123ebaba425fa2dadd415e464dfa (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:18.139724 21174 tablet_service.cc:1511] Processing CreateTablet for tablet e77746cf06a844b28506688985401b7d (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:18.152541 21172 tablet_service.cc:1511] Processing CreateTablet for tablet 7c63a55bdad346dabf469f0ab75f7020 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:18.167130 21093 tablet_service.cc:1511] Processing CreateTablet for tablet bc9e2a2fa444400287e8c1f7e71cbf5f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:18.168324 21025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa56a6078064852ac53dd912136460b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.170359 21093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9e2a2fa444400287e8c1f7e71cbf5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.170887 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa441bc31c5043668f08c6e72305c329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.171460 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f505123ebaba425fa2dadd415e464dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.172111 21172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c63a55bdad346dabf469f0ab75f7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.178192 21175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f86692ab0d642a990d934ba6bd6493f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.180521 21019 tablet_service.cc:1511] Processing CreateTablet for tablet bc9e2a2fa444400287e8c1f7e71cbf5f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:18.181392 21174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77746cf06a844b28506688985401b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.183326 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaf493e892d4ee9839b45b601fc8400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.207680 21227 ts_tablet_manager.cc:1434] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.172s	user 0.006s	sys 0.002s
I20260709 12:16:18.208420 21176 tablet_service.cc:1511] Processing CreateTablet for tablet b7f6c7d44dcf4a5787879c202071e5ba (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:18.210306 21176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f6c7d44dcf4a5787879c202071e5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.208724 21227 tablet_bootstrap.cc:492] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:18.225144 21227 tablet_bootstrap.cc:654] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.209115 21168 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa56a6078064852ac53dd912136460b (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:18.182536 21022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1a8045038f4383ba6d1a13bfda6966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.228116 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa56a6078064852ac53dd912136460b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.227267 21229 tablet_bootstrap.cc:654] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.231099 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9e2a2fa444400287e8c1f7e71cbf5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.238507 21175 tablet_service.cc:1511] Processing CreateTablet for tablet e531721f3cd9498c9cc3b11699d5de8f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:18.239684 21175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e531721f3cd9498c9cc3b11699d5de8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.266345 21100 tablet_service.cc:1511] Processing CreateTablet for tablet 77e78d4839734d8d87724fa056914153 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:18.267567 21100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e78d4839734d8d87724fa056914153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.272185 21171 tablet_service.cc:1511] Processing CreateTablet for tablet db9d39844048444b8a7293196d1349e9 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:18.273339 21171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9d39844048444b8a7293196d1349e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.297588 21231 tablet_bootstrap.cc:492] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:18.287525 21098 tablet_service.cc:1511] Processing CreateTablet for tablet 002c722a71214448b1f4889cc8bb0c37 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:18.300660 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002c722a71214448b1f4889cc8bb0c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.302403 21172 tablet_service.cc:1511] Processing CreateTablet for tablet b547f01ae7e54c0c870de561008eb7e0 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:18.281726 21092 tablet_service.cc:1511] Processing CreateTablet for tablet 81531ae383b1419ea24efbb10c3d2949 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:18.304260 21172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b547f01ae7e54c0c870de561008eb7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.304535 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81531ae383b1419ea24efbb10c3d2949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.306371 21023 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef296563f06493294dd3c3ee1d30263 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:18.307556 21023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef296563f06493294dd3c3ee1d30263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.296268 21167 tablet_service.cc:1511] Processing CreateTablet for tablet 2a1a8045038f4383ba6d1a13bfda6966 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:18.316305 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1a8045038f4383ba6d1a13bfda6966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.317302 21168 tablet_service.cc:1511] Processing CreateTablet for tablet bc9e2a2fa444400287e8c1f7e71cbf5f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:18.318440 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9e2a2fa444400287e8c1f7e71cbf5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.318297 21172 tablet_service.cc:1511] Processing CreateTablet for tablet 77e78d4839734d8d87724fa056914153 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:18.319195 21227 tablet_bootstrap.cc:492] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:18.319434 21172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e78d4839734d8d87724fa056914153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.319775 21227 ts_tablet_manager.cc:1403] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.111s	user 0.030s	sys 0.017s
I20260709 12:16:18.322808 21094 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef296563f06493294dd3c3ee1d30263 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:18.323973 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef296563f06493294dd3c3ee1d30263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.324280 21229 tablet_bootstrap.cc:492] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:18.324725 21229 ts_tablet_manager.cc:1403] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.203s	user 0.008s	sys 0.009s
I20260709 12:16:18.327425 21229 raft_consensus.cc:359] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.328084 21229 raft_consensus.cc:385] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.328370 21229 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.329175 21229 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.285826 21024 tablet_service.cc:1511] Processing CreateTablet for tablet 002c722a71214448b1f4889cc8bb0c37 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:18.331885 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002c722a71214448b1f4889cc8bb0c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.332129 21227 raft_consensus.cc:359] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.288498 21176 tablet_service.cc:1511] Processing CreateTablet for tablet 11c217b90c5a4022be2281765e591c5a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:18.334832 21018 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9e0f35d22542d19db11ce7085af404 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:18.336165 21018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9e0f35d22542d19db11ce7085af404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.293691 21169 tablet_service.cc:1511] Processing CreateTablet for tablet 9bc4c9f937ef4713ba45ba63b0602a7a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:18.339705 21022 tablet_service.cc:1511] Processing CreateTablet for tablet 81531ae383b1419ea24efbb10c3d2949 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:18.340839 21022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81531ae383b1419ea24efbb10c3d2949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.274816 21021 tablet_service.cc:1511] Processing CreateTablet for tablet 77e78d4839734d8d87724fa056914153 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:18.343858 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e78d4839734d8d87724fa056914153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.349890 21227 raft_consensus.cc:385] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.354497 21229 ts_tablet_manager.cc:1434] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.029s	user 0.011s	sys 0.001s
I20260709 12:16:18.354336 21094 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9e0f35d22542d19db11ce7085af404 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:18.355515 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9e0f35d22542d19db11ce7085af404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.356282 21172 tablet_service.cc:1511] Processing CreateTablet for tablet 81531ae383b1419ea24efbb10c3d2949 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:18.359762 21229 tablet_bootstrap.cc:492] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:18.359231 21061 heartbeater.cc:499] Master 127.19.108.62:42247 was elected leader, sending a full tablet report...
I20260709 12:16:18.369836 21170 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef296563f06493294dd3c3ee1d30263 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:18.356047 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc4c9f937ef4713ba45ba63b0602a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.373165 21174 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9e0f35d22542d19db11ce7085af404 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:18.374261 21174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9e0f35d22542d19db11ce7085af404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.375517 21175 tablet_service.cc:1511] Processing CreateTablet for tablet 002c722a71214448b1f4889cc8bb0c37 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 12:16:18.376667 20982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:18.376696 21175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002c722a71214448b1f4889cc8bb0c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.383055 21229 tablet_bootstrap.cc:654] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.383479 21172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81531ae383b1419ea24efbb10c3d2949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.387184 21176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c217b90c5a4022be2281765e591c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.354707 21231 tablet_bootstrap.cc:654] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.393379 21099 tablet_service.cc:1511] Processing CreateTablet for tablet 98a3a4bebb9546ba9e773da391cb42b6 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:18.351115 21227 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.395802 21227 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.397831 21227 ts_tablet_manager.cc:1434] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.076s	user 0.002s	sys 0.002s
I20260709 12:16:18.396349 21099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a3a4bebb9546ba9e773da391cb42b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.399295 21025 tablet_service.cc:1511] Processing CreateTablet for tablet 98a3a4bebb9546ba9e773da391cb42b6 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:18.400457 21025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a3a4bebb9546ba9e773da391cb42b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.402343 21170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef296563f06493294dd3c3ee1d30263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.402808 21173 tablet_service.cc:1511] Processing CreateTablet for tablet 98a3a4bebb9546ba9e773da391cb42b6 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:18.403930 21173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a3a4bebb9546ba9e773da391cb42b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:18.405949 21138 tablet.cc:2406] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:18.398751 21227 tablet_bootstrap.cc:492] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:18.406224 21020 tablet_service.cc:1511] Processing CreateTablet for tablet be0e4a74d2d54b1e94234933e9f489c7 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:18.410965 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0e4a74d2d54b1e94234933e9f489c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.414002 21229 tablet_bootstrap.cc:492] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:18.414438 21229 ts_tablet_manager.cc:1403] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.004s
I20260709 12:16:18.429520 21098 tablet_service.cc:1511] Processing CreateTablet for tablet be0e4a74d2d54b1e94234933e9f489c7 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:18.430826 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0e4a74d2d54b1e94234933e9f489c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.456971 21231 tablet_bootstrap.cc:492] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:18.457440 21231 ts_tablet_manager.cc:1403] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.160s	user 0.007s	sys 0.008s
I20260709 12:16:18.460443 21231 raft_consensus.cc:359] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.461134 21231 raft_consensus.cc:385] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.461417 21231 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.461894 21227 tablet_bootstrap.cc:654] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.462117 21231 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.464951 21229 raft_consensus.cc:359] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.465759 21229 raft_consensus.cc:385] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.466149 21229 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.468473 21231 ts_tablet_manager.cc:1434] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:16:18.469231 21212 heartbeater.cc:499] Master 127.19.108.62:42247 was elected leader, sending a full tablet report...
I20260709 12:16:18.469543 21231 tablet_bootstrap.cc:492] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:18.475191 21231 tablet_bootstrap.cc:654] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.479709 21229 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.481460 21229 ts_tablet_manager.cc:1434] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.067s	user 0.002s	sys 0.004s
I20260709 12:16:18.482185 21229 tablet_bootstrap.cc:492] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:18.484772 21227 tablet_bootstrap.cc:492] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:18.485214 21227 ts_tablet_manager.cc:1403] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.087s	user 0.007s	sys 0.001s
I20260709 12:16:18.518066 21169 tablet_service.cc:1511] Processing CreateTablet for tablet be0e4a74d2d54b1e94234933e9f489c7 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:18.520457 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0e4a74d2d54b1e94234933e9f489c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.521749 21024 tablet_service.cc:1511] Processing CreateTablet for tablet f16c07bcae284f65a7c0ee0375e00769 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:18.523319 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16c07bcae284f65a7c0ee0375e00769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.526710 21230 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.528000 21230 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.532490 21229 tablet_bootstrap.cc:654] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.534004 21098 tablet_service.cc:1511] Processing CreateTablet for tablet f16c07bcae284f65a7c0ee0375e00769 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:18.535475 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16c07bcae284f65a7c0ee0375e00769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.536815 21227 raft_consensus.cc:359] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.537534 21227 raft_consensus.cc:385] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.537853 21227 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.548430 21230 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:18.555761 21230 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.556241 21230 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.558178 21230 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:18.538607 21227 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.568889 21227 ts_tablet_manager.cc:1434] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.083s	user 0.001s	sys 0.008s
I20260709 12:16:18.571466 21227 tablet_bootstrap.cc:492] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:18.575543 21234 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.576095 21234 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.584926 21171 tablet_service.cc:1511] Processing CreateTablet for tablet f16c07bcae284f65a7c0ee0375e00769 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:18.586331 21171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16c07bcae284f65a7c0ee0375e00769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.614259 21227 tablet_bootstrap.cc:654] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.617859 21020 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4f0fe95c524d56a1d1a832a802a359 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:18.619064 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4f0fe95c524d56a1d1a832a802a359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.629570 21234 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:18.632405 21227 tablet_bootstrap.cc:492] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:18.647540 21022 tablet_service.cc:1511] Processing CreateTablet for tablet 3a806d7d80a64c98ad9053bacc618d37 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:18.648767 21022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a806d7d80a64c98ad9053bacc618d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.651137 21168 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4f0fe95c524d56a1d1a832a802a359 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:18.652304 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4f0fe95c524d56a1d1a832a802a359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.669657 21098 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4f0fe95c524d56a1d1a832a802a359 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:18.671023 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4f0fe95c524d56a1d1a832a802a359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.673673 21173 tablet_service.cc:1511] Processing CreateTablet for tablet 3a806d7d80a64c98ad9053bacc618d37 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:18.675027 21173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a806d7d80a64c98ad9053bacc618d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.676518 21099 tablet_service.cc:1511] Processing CreateTablet for tablet 3a806d7d80a64c98ad9053bacc618d37 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:18.669559 21231 tablet_bootstrap.cc:492] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:18.677738 21099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a806d7d80a64c98ad9053bacc618d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.684859 21231 ts_tablet_manager.cc:1403] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.216s	user 0.011s	sys 0.058s
I20260709 12:16:18.685863 21229 tablet_bootstrap.cc:492] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:18.686394 21229 ts_tablet_manager.cc:1403] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.204s	user 0.042s	sys 0.031s
I20260709 12:16:18.641418 21227 ts_tablet_manager.cc:1403] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.012s
I20260709 12:16:18.687961 21231 raft_consensus.cc:359] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.688665 21231 raft_consensus.cc:385] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.688951 21231 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.674650 21025 tablet_service.cc:1511] Processing CreateTablet for tablet 2afb5fda50b04769b30c8dfc6a46563e (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:18.691751 21231 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.692350 21025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afb5fda50b04769b30c8dfc6a46563e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.694244 21231 ts_tablet_manager.cc:1434] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:16:18.695312 21231 tablet_bootstrap.cc:492] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:18.697988 21227 raft_consensus.cc:359] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.698668 21227 raft_consensus.cc:385] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.698964 21227 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.699692 21227 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.701781 21227 ts_tablet_manager.cc:1434] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.003s
I20260709 12:16:18.702684 21227 tablet_bootstrap.cc:492] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:18.689162 21229 raft_consensus.cc:359] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.717700 21238 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.718084 21238 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.711913 21094 tablet_service.cc:1511] Processing CreateTablet for tablet 2afb5fda50b04769b30c8dfc6a46563e (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:18.720103 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afb5fda50b04769b30c8dfc6a46563e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.711597 21229 raft_consensus.cc:385] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.720523 21238 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:18.721868 21227 tablet_bootstrap.cc:654] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.709964 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:18.705888 21231 tablet_bootstrap.cc:654] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.710477 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:18.725803 21185 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:18.723520 21229 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.713680 21024 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5bea9516464fcf9fb8a2464ec2f1a8 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:18.732870 21096 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5bea9516464fcf9fb8a2464ec2f1a8 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:18.733588 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5bea9516464fcf9fb8a2464ec2f1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.733995 21229 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.740792 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5bea9516464fcf9fb8a2464ec2f1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.713205 21171 tablet_service.cc:1511] Processing CreateTablet for tablet 2afb5fda50b04769b30c8dfc6a46563e (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:18.748968 21171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afb5fda50b04769b30c8dfc6a46563e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.749310 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:18.750629 21002 leader_election.cc:343] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.752373 21229 ts_tablet_manager.cc:1434] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 12:16:18.755244 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:18.759295 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:18.762244 21076 leader_election.cc:343] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:18.763180 21076 leader_election.cc:343] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.774973 21020 tablet_service.cc:1511] Processing CreateTablet for tablet 066b481f21914e9aa6feafafc76db125 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:18.776270 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 066b481f21914e9aa6feafafc76db125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.786324 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:16:18.787536 21077 leader_election.cc:343] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.787917 21077 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:18.790191 21230 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.790549 21230 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.790885 21230 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.799638 21169 tablet_service.cc:1511] Processing CreateTablet for tablet 066b481f21914e9aa6feafafc76db125 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:18.800881 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 066b481f21914e9aa6feafafc76db125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.799638 21168 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5bea9516464fcf9fb8a2464ec2f1a8 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:18.804055 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5bea9516464fcf9fb8a2464ec2f1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.807585 21098 tablet_service.cc:1511] Processing CreateTablet for tablet 066b481f21914e9aa6feafafc76db125 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:18.808723 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 066b481f21914e9aa6feafafc76db125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.809804 21021 tablet_service.cc:1511] Processing CreateTablet for tablet cff4bd391fcd4a0e98a7359c8267ab60 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:18.811053 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff4bd391fcd4a0e98a7359c8267ab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.822245 21229 tablet_bootstrap.cc:492] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:18.825639 21096 tablet_service.cc:1511] Processing CreateTablet for tablet cff4bd391fcd4a0e98a7359c8267ab60 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:18.827816 21231 tablet_bootstrap.cc:492] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:18.828275 21231 ts_tablet_manager.cc:1403] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.017s
I20260709 12:16:18.830397 21229 tablet_bootstrap.cc:654] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.832769 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff4bd391fcd4a0e98a7359c8267ab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.847308 21231 raft_consensus.cc:359] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.848050 21231 raft_consensus.cc:385] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.848337 21231 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.849097 21231 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.857779 21230 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.859889 21230 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:18.860459 21230 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.860491 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:18.861193 21230 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.861626 21230 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:18.861949 21076 leader_election.cc:343] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.863601 21230 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:18.864301 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:18.866230 21076 leader_election.cc:343] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.864068 21230 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:18.834386 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 46882.7us
I20260709 12:16:18.877411 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:18.877702 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:18.878679 21186 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.883256 21227 tablet_bootstrap.cc:492] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:18.883731 21227 ts_tablet_manager.cc:1403] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.181s	user 0.012s	sys 0.007s
W20260709 12:16:18.880204 21077 leader_election.cc:343] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.887215 21231 ts_tablet_manager.cc:1434] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 12:16:18.887122 21077 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:18.887979 21256 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.886699 21186 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:18.878230 21230 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.892711 21230 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:18.893468 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:18.893993 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:18.894642 21185 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:18.894068 21035 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:18.895866 21077 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:18.886452 21227 raft_consensus.cc:359] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.897349 21227 raft_consensus.cc:385] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.895416 21099 tablet_service.cc:1511] Processing CreateTablet for tablet a039020e2b434452bdc6cf055df7cc8a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:18.897660 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:18.898293 21099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a039020e2b434452bdc6cf055df7cc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.889513 21025 tablet_service.cc:1511] Processing CreateTablet for tablet a039020e2b434452bdc6cf055df7cc8a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:18.902215 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:18.902566 21025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a039020e2b434452bdc6cf055df7cc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.903360 21255 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.903833 21255 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:18.900523 21230 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.904573 21255 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.905416 21230 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.905797 21230 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:18.909767 20999 leader_election.cc:343] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.910233 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:18.911013 21234 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.911378 21229 tablet_bootstrap.cc:492] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:18.911811 21229 ts_tablet_manager.cc:1403] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.115s	user 0.005s	sys 0.005s
I20260709 12:16:18.897683 21227 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.914374 21231 tablet_bootstrap.cc:492] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:18.917573 21171 tablet_service.cc:1511] Processing CreateTablet for tablet cff4bd391fcd4a0e98a7359c8267ab60 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:18.918756 21171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff4bd391fcd4a0e98a7359c8267ab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.920783 21227 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.922600 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:18.922950 21227 ts_tablet_manager.cc:1434] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:16:18.923952 21227 tablet_bootstrap.cc:492] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:18.928431 21231 tablet_bootstrap.cc:654] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.928787 21173 tablet_service.cc:1511] Processing CreateTablet for tablet a039020e2b434452bdc6cf055df7cc8a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:18.929930 21173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a039020e2b434452bdc6cf055df7cc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.930534 21229 raft_consensus.cc:359] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.932621 21229 raft_consensus.cc:385] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.934940 21229 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.935827 21229 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.943295 21234 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.943696 21234 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.946249 21234 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:18.948155 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:18.949824 21094 tablet_service.cc:1511] Processing CreateTablet for tablet 097c05b85fe14dc38775d8347e0478fe (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:18.950695 21227 tablet_bootstrap.cc:654] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.951093 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c05b85fe14dc38775d8347e0478fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.953032 21021 tablet_service.cc:1511] Processing CreateTablet for tablet 36a88ddff51a4bcea630447226c59041 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:18.955212 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:18.956151 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:18.958616 21168 tablet_service.cc:1511] Processing CreateTablet for tablet 36a88ddff51a4bcea630447226c59041 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:18.959872 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a88ddff51a4bcea630447226c59041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.962523 21229 ts_tablet_manager.cc:1434] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
W20260709 12:16:18.949776 20999 leader_election.cc:343] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.963558 21229 tablet_bootstrap.cc:492] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:18.963827 21020 tablet_service.cc:1511] Processing CreateTablet for tablet 097c05b85fe14dc38775d8347e0478fe (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 12:16:18.966818 21151 leader_election.cc:343] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.967303 21151 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:18.967612 21238 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.968040 21238 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.969381 21231 tablet_bootstrap.cc:492] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:18.969815 21231 ts_tablet_manager.cc:1403] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.012s
I20260709 12:16:18.969967 21238 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:18.970425 21238 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:18.964110 21002 leader_election.cc:343] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.973515 21231 raft_consensus.cc:359] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.974174 21231 raft_consensus.cc:385] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.974452 21231 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.976380 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:18.977831 21149 leader_election.cc:343] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.977905 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:18.983358 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a88ddff51a4bcea630447226c59041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.985283 21098 tablet_service.cc:1511] Processing CreateTablet for tablet 36a88ddff51a4bcea630447226c59041 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:18.986527 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a88ddff51a4bcea630447226c59041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.972411 21234 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.987171 21234 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.989040 21234 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:18.989459 21234 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.989801 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:18.975167 21231 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:18.991245 20999 leader_election.cc:343] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.992199 21231 ts_tablet_manager.cc:1434] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:16:18.993207 21231 tablet_bootstrap.cc:492] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:18.993566 20934 catalog_manager.cc:5697] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.971897 21230 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:18.995184 21096 tablet_service.cc:1511] Processing CreateTablet for tablet 92c5682e4a6f4eb6a687f13065840f5f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:18.995975 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c05b85fe14dc38775d8347e0478fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.000154 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c5682e4a6f4eb6a687f13065840f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.004185 21169 tablet_service.cc:1511] Processing CreateTablet for tablet 097c05b85fe14dc38775d8347e0478fe (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:19.005327 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c05b85fe14dc38775d8347e0478fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.005012 21170 tablet_service.cc:1511] Processing CreateTablet for tablet 92c5682e4a6f4eb6a687f13065840f5f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:19.006206 21170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c5682e4a6f4eb6a687f13065840f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.005975 21024 tablet_service.cc:1511] Processing CreateTablet for tablet f5b9dc7576af431ea6e483cb2a8c04f7 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:19.007156 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b9dc7576af431ea6e483cb2a8c04f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.007764 21231 tablet_bootstrap.cc:654] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:19.013423 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 49357.4us
I20260709 12:16:19.019246 21025 tablet_service.cc:1511] Processing CreateTablet for tablet 92c5682e4a6f4eb6a687f13065840f5f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:19.020404 21025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c5682e4a6f4eb6a687f13065840f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.020057 21022 tablet_service.cc:1511] Processing CreateTablet for tablet b90da36dbc3d409db5612d97106ad05a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:19.021286 21022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90da36dbc3d409db5612d97106ad05a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.021507 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:19.022061 21229 tablet_bootstrap.cc:654] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.022034 21035 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.024062 21176 tablet_service.cc:1511] Processing CreateTablet for tablet f5b9dc7576af431ea6e483cb2a8c04f7 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:19.025326 21176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b9dc7576af431ea6e483cb2a8c04f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.031231 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:19.048291 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:19.048806 21186 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.051746 21099 tablet_service.cc:1511] Processing CreateTablet for tablet b90da36dbc3d409db5612d97106ad05a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:19.053014 21099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90da36dbc3d409db5612d97106ad05a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.053646 21230 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.054922 21035 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:19.055909 21186 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:19.056133 21076 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:19.057417 21230 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.057904 21230 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:19.058681 21230 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.070235 21168 tablet_service.cc:1511] Processing CreateTablet for tablet b90da36dbc3d409db5612d97106ad05a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:19.073133 21092 tablet_service.cc:1511] Processing CreateTablet for tablet 40fd334874764b26ba28ac382c4199f8 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:19.074496 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fd334874764b26ba28ac382c4199f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.079893 21171 tablet_service.cc:1511] Processing CreateTablet for tablet 40fd334874764b26ba28ac382c4199f8 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:19.081065 21171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fd334874764b26ba28ac382c4199f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.081620 21023 tablet_service.cc:1511] Processing CreateTablet for tablet 861699cfca584c7b963879b6d12f2866 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:19.084578 21173 tablet_service.cc:1511] Processing CreateTablet for tablet 861699cfca584c7b963879b6d12f2866 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:19.085716 21173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861699cfca584c7b963879b6d12f2866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.085644 21021 tablet_service.cc:1511] Processing CreateTablet for tablet 40fd334874764b26ba28ac382c4199f8 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:19.086508 21227 tablet_bootstrap.cc:492] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:19.086954 21227 ts_tablet_manager.cc:1403] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.163s	user 0.017s	sys 0.033s
W20260709 12:16:19.087206 21002 leader_election.cc:343] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.087258 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.087723 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:19.088593 21263 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:19.089416 21151 leader_election.cc:343] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.089709 21227 raft_consensus.cc:359] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.082782 21023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861699cfca584c7b963879b6d12f2866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.091840 21151 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:19.094255 21262 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.091220 21227 raft_consensus.cc:385] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.095575 21227 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.096398 21227 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.098124 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fd334874764b26ba28ac382c4199f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.098778 21227 ts_tablet_manager.cc:1434] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:16:19.104883 21227 tablet_bootstrap.cc:492] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:19.103729 21094 tablet_service.cc:1511] Processing CreateTablet for tablet f5b9dc7576af431ea6e483cb2a8c04f7 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:19.118156 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b9dc7576af431ea6e483cb2a8c04f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.120252 21255 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.120700 21255 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.123652 21231 tablet_bootstrap.cc:492] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:19.124119 21231 ts_tablet_manager.cc:1403] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.131s	user 0.020s	sys 0.044s
I20260709 12:16:19.124009 21174 tablet_service.cc:1511] Processing CreateTablet for tablet 1407b8879f4c4fe6a95ea91c62d72196 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:19.126943 21231 raft_consensus.cc:359] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.127616 21231 raft_consensus.cc:385] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.127894 21231 raft_consensus.cc:740] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.127807 21096 tablet_service.cc:1511] Processing CreateTablet for tablet 1407b8879f4c4fe6a95ea91c62d72196 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:19.128973 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1407b8879f4c4fe6a95ea91c62d72196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.128640 21231 consensus_queue.cc:260] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.130827 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.130964 21256 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.133327 21256 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.135773 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:19.130730 21231 ts_tablet_manager.cc:1434] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:19.136857 21256 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.122692 21255 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:19.136994 21077 leader_election.cc:343] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.143193 21023 tablet_service.cc:1511] Processing CreateTablet for tablet b6f88dd1e21043668981ccdd8686a159 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 12:16:19.143549 21076 leader_election.cc:343] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.144536 21023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f88dd1e21043668981ccdd8686a159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.154106 21231 tablet_bootstrap.cc:492] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:19.146375 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:19.148612 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:19.149055 21172 tablet_service.cc:1511] Processing CreateTablet for tablet b6f88dd1e21043668981ccdd8686a159 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:19.153115 21025 tablet_service.cc:1511] Processing CreateTablet for tablet 44d4361c1e5c40639a84f16f00228b6f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:19.158277 21025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d4361c1e5c40639a84f16f00228b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.158509 21255 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.145488 21227 tablet_bootstrap.cc:654] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:19.160418 21077 leader_election.cc:343] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.160904 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.161495 21035 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:19.140704 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90da36dbc3d409db5612d97106ad05a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.158524 21099 tablet_service.cc:1511] Processing CreateTablet for tablet 861699cfca584c7b963879b6d12f2866 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:19.175976 21262 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.176772 21174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1407b8879f4c4fe6a95ea91c62d72196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.176450 21262 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.179510 21099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861699cfca584c7b963879b6d12f2866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.179656 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:19.181005 21149 leader_election.cc:343] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.183238 21172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f88dd1e21043668981ccdd8686a159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.178573 21262 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:19.186335 21094 tablet_service.cc:1511] Processing CreateTablet for tablet b6f88dd1e21043668981ccdd8686a159 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:19.187664 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f88dd1e21043668981ccdd8686a159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.183960 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:19.201459 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.202626 21255 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:19.202702 21151 leader_election.cc:343] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.203045 21255 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.203209 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:19.203269 21098 tablet_service.cc:1511] Processing CreateTablet for tablet 44d4361c1e5c40639a84f16f00228b6f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:19.204013 21238 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.204453 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d4361c1e5c40639a84f16f00228b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.217559 21024 tablet_service.cc:1511] Processing CreateTablet for tablet fe28fa2b431c442da6a32fe2e3de3ffb (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:19.218725 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe28fa2b431c442da6a32fe2e3de3ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.219015 21100 tablet_service.cc:1511] Processing CreateTablet for tablet fe28fa2b431c442da6a32fe2e3de3ffb (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:19.220139 21100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe28fa2b431c442da6a32fe2e3de3ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.227850 21170 tablet_service.cc:1511] Processing CreateTablet for tablet 44d4361c1e5c40639a84f16f00228b6f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:19.229118 21170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d4361c1e5c40639a84f16f00228b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.140972 21021 tablet_service.cc:1511] Processing CreateTablet for tablet 1407b8879f4c4fe6a95ea91c62d72196 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:19.231823 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1407b8879f4c4fe6a95ea91c62d72196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.203389 21255 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.269306 21262 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.269861 21262 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.272351 21262 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:19.273099 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.274276 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:19.275691 21149 leader_election.cc:343] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:19.276743 21151 leader_election.cc:343] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.277148 21151 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:19.277827 21262 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.283762 21255 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.286190 21255 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.286509 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:19.286715 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:19.287098 21035 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.287992 21231 tablet_bootstrap.cc:654] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:19.287987 21077 leader_election.cc:343] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.294338 21035 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:19.295571 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:19.296828 21255 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.297358 21255 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:19.298207 21255 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.304963 21229 tablet_bootstrap.cc:492] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:19.305430 21229 ts_tablet_manager.cc:1403] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.342s	user 0.043s	sys 0.012s
I20260709 12:16:19.308250 21229 raft_consensus.cc:359] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.308894 21229 raft_consensus.cc:385] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.309149 21229 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.309784 21229 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.311901 21229 ts_tablet_manager.cc:1434] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:19.317483 21173 tablet_service.cc:1511] Processing CreateTablet for tablet fe28fa2b431c442da6a32fe2e3de3ffb (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:19.318678 21173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe28fa2b431c442da6a32fe2e3de3ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.325067 21169 tablet_service.cc:1511] Processing CreateTablet for tablet c68b72acae564588a3a276b7b233d977 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:19.325738 21096 tablet_service.cc:1511] Processing CreateTablet for tablet c68b72acae564588a3a276b7b233d977 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:19.326318 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68b72acae564588a3a276b7b233d977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.326928 21024 tablet_service.cc:1511] Processing CreateTablet for tablet b55836eaff314a2ebc52f7e3a6801d96 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:19.328346 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55836eaff314a2ebc52f7e3a6801d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.326943 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68b72acae564588a3a276b7b233d977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.336410 21231 tablet_bootstrap.cc:492] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:19.348893 21092 tablet_service.cc:1511] Processing CreateTablet for tablet b55836eaff314a2ebc52f7e3a6801d96 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:19.349654 21231 ts_tablet_manager.cc:1403] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.196s	user 0.008s	sys 0.006s
I20260709 12:16:19.351845 21227 tablet_bootstrap.cc:492] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:19.352334 21227 ts_tablet_manager.cc:1403] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.248s	user 0.051s	sys 0.064s
I20260709 12:16:19.353816 21231 raft_consensus.cc:359] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.354485 21231 raft_consensus.cc:385] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.354763 21231 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.355607 21023 tablet_service.cc:1511] Processing CreateTablet for tablet c68b72acae564588a3a276b7b233d977 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:19.363106 21021 tablet_service.cc:1511] Processing CreateTablet for tablet e3372843b9d8457e9e243e1b6e33141a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:19.359709 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55836eaff314a2ebc52f7e3a6801d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.363938 21023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68b72acae564588a3a276b7b233d977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.366305 21227 raft_consensus.cc:359] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.360813 20932 catalog_manager.cc:5697] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.359326 21229 tablet_bootstrap.cc:492] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:19.367022 21227 raft_consensus.cc:385] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.367344 21227 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.368055 21227 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.369293 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3372843b9d8457e9e243e1b6e33141a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.370294 21227 ts_tablet_manager.cc:1434] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:16:19.370666 21263 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.371122 21263 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.371265 21230 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.373123 21263 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.371258 21227 tablet_bootstrap.cc:492] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:19.376569 21174 tablet_service.cc:1511] Processing CreateTablet for tablet e3372843b9d8457e9e243e1b6e33141a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:19.376763 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:19.375880 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:19.375854 21024 tablet_service.cc:1511] Processing CreateTablet for tablet b6491ed44ddd40e88e8100b87d9eac5e (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:19.378592 21111 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:19.378997 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6491ed44ddd40e88e8100b87d9eac5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:19.379209 20982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:19.379906 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:16:19.381098 21002 leader_election.cc:343] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.361853 21169 tablet_service.cc:1511] Processing CreateTablet for tablet b55836eaff314a2ebc52f7e3a6801d96 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:19.382031 21263 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.382365 21263 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.383531 21263 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.385319 21172 tablet_service.cc:1511] Processing CreateTablet for tablet b6491ed44ddd40e88e8100b87d9eac5e (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:19.377736 21174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3372843b9d8457e9e243e1b6e33141a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.387143 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55836eaff314a2ebc52f7e3a6801d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.388290 21172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6491ed44ddd40e88e8100b87d9eac5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:19.393239 21076 consensus_peers.cc:597] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:19.370254 20932 catalog_manager.cc:5697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.399376 21263 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.401945 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:19.402472 21111 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.406226 21168 tablet_service.cc:1511] Processing CreateTablet for tablet f2065378b47e42a29f6e7eb69f39f47c (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:19.407392 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2065378b47e42a29f6e7eb69f39f47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.408718 21100 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4624827ee54eb0ba008c640f0ffb6b (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:19.409904 21100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4624827ee54eb0ba008c640f0ffb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.415058 21022 tablet_service.cc:1511] Processing CreateTablet for tablet 2dc46ba93c94432f85502db4f2496cfc (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:19.416178 21022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc46ba93c94432f85502db4f2496cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.416642 21098 tablet_service.cc:1511] Processing CreateTablet for tablet 2dc46ba93c94432f85502db4f2496cfc (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:19.410750 21096 tablet_service.cc:1511] Processing CreateTablet for tablet f2065378b47e42a29f6e7eb69f39f47c (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:19.417671 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc46ba93c94432f85502db4f2496cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.418293 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2065378b47e42a29f6e7eb69f39f47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.419783 21020 tablet_service.cc:1511] Processing CreateTablet for tablet 25ea03120f0340dab2b56ee8ae2b19f9 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:19.419958 21093 tablet_service.cc:1511] Processing CreateTablet for tablet 79b5e6970bf54d93a119ce3444c25c6a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:19.420949 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ea03120f0340dab2b56ee8ae2b19f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.421172 21093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b5e6970bf54d93a119ce3444c25c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.421905 21097 tablet_service.cc:1511] Processing CreateTablet for tablet e6a8bfa2966c4510a71d4867b74a1a58 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:19.423082 21097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a8bfa2966c4510a71d4867b74a1a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.423138 21095 tablet_service.cc:1511] Processing CreateTablet for tablet 25ea03120f0340dab2b56ee8ae2b19f9 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:19.423704 21024 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4624827ee54eb0ba008c640f0ffb6b (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:19.424779 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4624827ee54eb0ba008c640f0ffb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.424896 21095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ea03120f0340dab2b56ee8ae2b19f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.427416 21171 tablet_service.cc:1511] Processing CreateTablet for tablet 25ea03120f0340dab2b56ee8ae2b19f9 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:19.428527 21171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ea03120f0340dab2b56ee8ae2b19f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.431769 21176 tablet_service.cc:1511] Processing CreateTablet for tablet 79b5e6970bf54d93a119ce3444c25c6a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:19.432888 21176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b5e6970bf54d93a119ce3444c25c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.402464 21227 tablet_bootstrap.cc:654] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.365821 21231 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.438611 21262 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.441618 21262 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.438016 21101 tablet_service.cc:1511] Processing CreateTablet for tablet 2747202c22c64b3cb3fb096f2f65e662 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:19.442062 21019 tablet_service.cc:1511] Processing CreateTablet for tablet 79b5e6970bf54d93a119ce3444c25c6a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:19.443511 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b5e6970bf54d93a119ce3444c25c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.446969 21018 tablet_service.cc:1511] Processing CreateTablet for tablet e6a8bfa2966c4510a71d4867b74a1a58 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:19.448160 21018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a8bfa2966c4510a71d4867b74a1a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.447894 21026 tablet_service.cc:1511] Processing CreateTablet for tablet 2747202c22c64b3cb3fb096f2f65e662 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:19.449083 21026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2747202c22c64b3cb3fb096f2f65e662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.450111 21017 tablet_service.cc:1511] Processing CreateTablet for tablet 2794b9a38ad54e088a7b3f884de8ef3d (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:19.451314 21017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2794b9a38ad54e088a7b3f884de8ef3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.451373 21101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2747202c22c64b3cb3fb096f2f65e662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.453279 21173 tablet_service.cc:1511] Processing CreateTablet for tablet 2dc46ba93c94432f85502db4f2496cfc (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:19.454319 21175 tablet_service.cc:1511] Processing CreateTablet for tablet 2747202c22c64b3cb3fb096f2f65e662 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:19.456279 21167 tablet_service.cc:1511] Processing CreateTablet for tablet 2794b9a38ad54e088a7b3f884de8ef3d (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:19.456818 21175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2747202c22c64b3cb3fb096f2f65e662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.437912 21094 tablet_service.cc:1511] Processing CreateTablet for tablet b6491ed44ddd40e88e8100b87d9eac5e (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:19.460696 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6491ed44ddd40e88e8100b87d9eac5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.461035 21174 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9fa6d1b68a474195f679c548dd3e4f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:19.450228 21170 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4624827ee54eb0ba008c640f0ffb6b (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:19.458537 21169 tablet_service.cc:1511] Processing CreateTablet for tablet e6a8bfa2966c4510a71d4867b74a1a58 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:19.459609 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2794b9a38ad54e088a7b3f884de8ef3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.479533 21263 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.488180 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:19.489323 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.489967 21035 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:19.491454 21111 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:19.483206 21262 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:19.466315 21025 tablet_service.cc:1511] Processing CreateTablet for tablet f2065378b47e42a29f6e7eb69f39f47c (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:19.508728 21025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2065378b47e42a29f6e7eb69f39f47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.489634 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:19.510345 21149 leader_election.cc:343] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:19.510377 21002 leader_election.cc:343] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.511098 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:19.512102 21262 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.512421 21262 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.512718 21262 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.515089 21231 ts_tablet_manager.cc:1434] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.164s	user 0.009s	sys 0.000s
I20260709 12:16:19.515483 21099 tablet_service.cc:1511] Processing CreateTablet for tablet e3372843b9d8457e9e243e1b6e33141a (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:19.516669 21099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3372843b9d8457e9e243e1b6e33141a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.518827 21262 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.521543 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:19.522092 21035 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.538302 21021 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb2ddbea74b45ee881e46a2349d3cc9 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:19.539353 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb2ddbea74b45ee881e46a2349d3cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.543655 21024 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9fa6d1b68a474195f679c548dd3e4f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:19.544767 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9fa6d1b68a474195f679c548dd3e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.546451 21231 tablet_bootstrap.cc:492] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:19.552554 21098 tablet_service.cc:1511] Processing CreateTablet for tablet 2794b9a38ad54e088a7b3f884de8ef3d (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:19.554638 21092 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb2ddbea74b45ee881e46a2349d3cc9 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:19.554638 21095 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9fa6d1b68a474195f679c548dd3e4f (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:19.555749 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb2ddbea74b45ee881e46a2349d3cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.561646 21098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2794b9a38ad54e088a7b3f884de8ef3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.565730 21035 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:19.568256 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:19.570187 21238 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.570704 21256 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.575031 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:19.576110 21263 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.533911 21174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9fa6d1b68a474195f679c548dd3e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.584693 21167 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb2ddbea74b45ee881e46a2349d3cc9 (DEFAULT_TABLE table=test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:19.585855 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb2ddbea74b45ee881e46a2349d3cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.592420 21229 tablet_bootstrap.cc:654] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.597004 21256 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.608930 21263 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:19.611084 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a8bfa2966c4510a71d4867b74a1a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.611275 21262 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:19.613834 21227 tablet_bootstrap.cc:492] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:19.614243 21227 ts_tablet_manager.cc:1403] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.243s	user 0.010s	sys 0.027s
I20260709 12:16:19.615200 21095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9fa6d1b68a474195f679c548dd3e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.615218 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:16:19.617527 21149 leader_election.cc:343] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:19.608137 20920 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 71079.4us
I20260709 12:16:19.632607 21170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4624827ee54eb0ba008c640f0ffb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.648799 21173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc46ba93c94432f85502db4f2496cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:19.648758 21227 raft_consensus.cc:359] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.652107 21227 raft_consensus.cc:385] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.652375 21227 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.653039 21227 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.655432 21263 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.664151 21227 ts_tablet_manager.cc:1434] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 12:16:19.668007 21238 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:19.677277 21231 tablet_bootstrap.cc:654] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.679479 21229 tablet_bootstrap.cc:492] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:19.689260 21227 tablet_bootstrap.cc:492] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:19.690992 21229 ts_tablet_manager.cc:1403] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.332s	user 0.012s	sys 0.009s
I20260709 12:16:19.693737 21229 raft_consensus.cc:359] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.694423 21227 tablet_bootstrap.cc:654] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.695927 21238 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.694391 21229 raft_consensus.cc:385] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.705180 21229 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.706667 21229 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.708777 21229 ts_tablet_manager.cc:1434] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 12:16:19.709755 21229 tablet_bootstrap.cc:492] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:19.719565 20934 catalog_manager.cc:5697] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.723716 21229 tablet_bootstrap.cc:654] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.730697 21227 tablet_bootstrap.cc:492] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:19.731179 21227 ts_tablet_manager.cc:1403] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.002s
I20260709 12:16:19.733740 21227 raft_consensus.cc:359] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.739821 21227 raft_consensus.cc:385] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.740099 21227 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.740732 21227 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.742607 21227 ts_tablet_manager.cc:1434] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 12:16:19.743364 21227 tablet_bootstrap.cc:492] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:19.735908 21231 tablet_bootstrap.cc:492] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:19.738770 20932 catalog_manager.cc:5697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:19.746978 21227 tablet_bootstrap.cc:654] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.747347 21231 ts_tablet_manager.cc:1403] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.201s	user 0.008s	sys 0.031s
I20260709 12:16:19.748378 21255 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.748801 21255 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.750663 21255 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.752066 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.752652 21035 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:19.752948 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:19.753400 21077 consensus_peers.cc:597] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:19.754554 21231 raft_consensus.cc:359] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.754832 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:19.755378 21231 raft_consensus.cc:385] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.755820 21231 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.755932 21255 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:19.755795 21077 leader_election.cc:343] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.756361 21255 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.756728 21255 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.756841 21231 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.759346 21231 ts_tablet_manager.cc:1434] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:16:19.766542 21238 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.766937 21231 tablet_bootstrap.cc:492] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:19.766983 21238 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.769076 21227 tablet_bootstrap.cc:492] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:19.769161 21238 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:19.769627 21227 ts_tablet_manager.cc:1403] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.014s
I20260709 12:16:19.770620 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:19.772195 21227 raft_consensus.cc:359] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.772614 21256 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.773525 21231 tablet_bootstrap.cc:654] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.773669 21227 raft_consensus.cc:385] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.774322 21227 raft_consensus.cc:740] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.773682 21256 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.775585 21227 consensus_queue.cc:260] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.777253 21256 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.777868 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.778589 21227 ts_tablet_manager.cc:1434] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:16:19.778648 21229 tablet_bootstrap.cc:492] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:19.772143 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.778716 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:19.779114 21076 leader_election.cc:343] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.779253 21035 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:19.779871 21227 tablet_bootstrap.cc:492] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
W20260709 12:16:19.780237 21077 leader_election.cc:343] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.780475 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:19.780690 21077 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:19.781553 21229 ts_tablet_manager.cc:1403] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.007s
I20260709 12:16:19.781710 21238 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.782080 21238 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.782830 21256 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.782402 21238 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.784240 21229 raft_consensus.cc:359] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.784909 21229 raft_consensus.cc:385] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.785184 21229 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.786010 21227 tablet_bootstrap.cc:654] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.785941 21229 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.788131 21229 ts_tablet_manager.cc:1434] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:16:19.789124 21229 tablet_bootstrap.cc:492] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:19.798659 21238 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.803642 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:19.804713 21229 tablet_bootstrap.cc:654] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.805133 21238 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:19.807720 21227 tablet_bootstrap.cc:492] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:19.805167 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:19.801296 21255 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.808539 21227 ts_tablet_manager.cc:1403] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.007s
I20260709 12:16:19.809145 21111 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 1: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:19.811069 21227 raft_consensus.cc:359] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.811677 21227 raft_consensus.cc:385] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.811920 21227 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.812520 21227 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.813495 21036 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.814137 21227 ts_tablet_manager.cc:1434] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:16:19.815218 21283 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.815666 21283 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.816388 21227 tablet_bootstrap.cc:492] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:19.817658 21283 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.819448 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:19.820493 21036 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:19.821008 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:19.821581 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:19.821835 21227 tablet_bootstrap.cc:654] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.822194 21255 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.823009 21238 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.823453 21238 raft_consensus.cc:697] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:19.824213 21238 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.826000 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:19.826391 21231 tablet_bootstrap.cc:492] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:19.826675 21035 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:19.826835 21231 ts_tablet_manager.cc:1403] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.060s	user 0.004s	sys 0.017s
I20260709 12:16:19.827872 21002 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:19.829100 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:19.829324 21231 raft_consensus.cc:359] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.829737 21283 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.830013 21231 raft_consensus.cc:385] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.830333 21231 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.830976 21231 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.831782 21077 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:19.831420 21229 tablet_bootstrap.cc:492] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:19.832901 21231 ts_tablet_manager.cc:1434] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:19.833067 21255 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.833160 21229 ts_tablet_manager.cc:1403] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.000s
I20260709 12:16:19.833942 21231 tablet_bootstrap.cc:492] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:19.835954 21229 raft_consensus.cc:359] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.836598 21229 raft_consensus.cc:385] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.836853 21229 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.837563 21229 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.840020 21231 tablet_bootstrap.cc:654] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.842445 21229 ts_tablet_manager.cc:1434] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:19.843341 21229 tablet_bootstrap.cc:492] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:19.844353 21280 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.844789 21280 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.846643 20932 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:19.848004 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:19.848398 21229 tablet_bootstrap.cc:654] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.848572 21111 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:19.849794 21149 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:19.850720 21278 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.851121 21278 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.851419 21278 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.846735 21280 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:19.860036 21278 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.863554 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:19.864118 21035 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.873270 21034 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.883271 21255 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.883798 21035 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:19.884881 21151 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:19.885735 21280 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.886983 21280 raft_consensus.cc:697] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:19.889252 21280 consensus_queue.cc:237] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.861032 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.896207 21036 raft_consensus.cc:2376] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1. Re-sending same reply.
I20260709 12:16:19.899546 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:19.900099 21111 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.901141 21231 tablet_bootstrap.cc:492] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:19.901595 21231 ts_tablet_manager.cc:1403] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.012s
I20260709 12:16:19.904253 21231 raft_consensus.cc:359] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.904867 21231 raft_consensus.cc:385] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.905117 21231 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.905764 21231 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.906950 21278 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:19.906577 21111 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:19.911849 21231 ts_tablet_manager.cc:1434] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:16:19.912729 21231 tablet_bootstrap.cc:492] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:19.914645 20934 catalog_manager.cc:5697] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:19.918875 21231 tablet_bootstrap.cc:654] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.958740 21227 tablet_bootstrap.cc:492] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:19.959251 21227 ts_tablet_manager.cc:1403] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.143s	user 0.081s	sys 0.056s
I20260709 12:16:19.959431 21231 tablet_bootstrap.cc:492] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:19.959848 21231 ts_tablet_manager.cc:1403] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.021s
I20260709 12:16:19.960161 21229 tablet_bootstrap.cc:492] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:19.960638 21229 ts_tablet_manager.cc:1403] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.117s	user 0.024s	sys 0.048s
I20260709 12:16:19.961694 21227 raft_consensus.cc:359] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.962335 21227 raft_consensus.cc:385] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.962116 21231 raft_consensus.cc:359] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.962596 21227 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.962738 21231 raft_consensus.cc:385] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.963092 21231 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.963418 21229 raft_consensus.cc:359] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.963413 21227 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.963800 21231 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.965528 21227 ts_tablet_manager.cc:1434] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:16:19.965823 21231 ts_tablet_manager.cc:1434] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:16:19.966459 21227 tablet_bootstrap.cc:492] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:19.966784 21255 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.967237 21255 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.967710 21231 tablet_bootstrap.cc:492] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:19.969161 21255 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:19.964294 21229 raft_consensus.cc:385] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.969856 21229 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.970124 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:19.970690 21229 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:19.971421 21077 leader_election.cc:343] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.972612 21229 ts_tablet_manager.cc:1434] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:16:19.973485 21229 tablet_bootstrap.cc:492] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:19.973629 21231 tablet_bootstrap.cc:654] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.975261 21227 tablet_bootstrap.cc:654] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.979413 21229 tablet_bootstrap.cc:654] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.981117 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:19.981781 21033 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:19.983021 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:19.984055 21256 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.984383 21256 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.984568 21231 tablet_bootstrap.cc:492] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:19.984884 21256 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.985140 21231 ts_tablet_manager.cc:1403] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.006s
I20260709 12:16:19.986653 21227 tablet_bootstrap.cc:492] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:19.987061 21227 ts_tablet_manager.cc:1403] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:16:19.987594 21231 raft_consensus.cc:359] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.988168 21231 raft_consensus.cc:385] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.988407 21231 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.989115 21231 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.989414 21227 raft_consensus.cc:359] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.990022 21227 raft_consensus.cc:385] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.990296 21227 raft_consensus.cc:740] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.991263 21231 ts_tablet_manager.cc:1434] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:19.991067 21227 consensus_queue.cc:260] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.992103 21231 tablet_bootstrap.cc:492] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:19.991981 21256 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:19.993233 21227 ts_tablet_manager.cc:1434] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:16:19.994081 21227 tablet_bootstrap.cc:492] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:19.995507 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:19.996037 21033 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.997714 21231 tablet_bootstrap.cc:654] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.999260 21227 tablet_bootstrap.cc:654] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.003103 21033 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:20.005057 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:16:20.006543 21077 leader_election.cc:343] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.008559 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:20.008921 21231 tablet_bootstrap.cc:492] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.009305 21231 ts_tablet_manager.cc:1403] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:16:20.009341 21255 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.009878 21227 tablet_bootstrap.cc:492] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.009828 21255 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:20.010324 21227 ts_tablet_manager.cc:1403] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 12:16:20.010663 21255 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.011821 21231 raft_consensus.cc:359] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.012403 21231 raft_consensus.cc:385] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.012648 21231 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.012671 21227 raft_consensus.cc:359] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.013358 21227 raft_consensus.cc:385] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.013648 21227 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.013495 21231 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.014268 21227 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.016337 21227 ts_tablet_manager.cc:1434] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:20.016286 21256 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.017213 21227 tablet_bootstrap.cc:492] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:20.024444 21227 tablet_bootstrap.cc:654] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.026152 21229 tablet_bootstrap.cc:492] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.026552 21229 ts_tablet_manager.cc:1403] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.002s
I20260709 12:16:20.027704 21231 ts_tablet_manager.cc:1434] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:16:20.028661 21231 tablet_bootstrap.cc:492] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.028887 21229 raft_consensus.cc:359] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.029503 21229 raft_consensus.cc:385] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.029753 21229 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.029141 20932 catalog_manager.cc:5697] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.030440 21229 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.032999 21229 ts_tablet_manager.cc:1434] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:20.034205 21229 tablet_bootstrap.cc:492] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.037792 21283 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.038233 21283 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.040177 21283 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.040447 21231 tablet_bootstrap.cc:654] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.042951 21229 tablet_bootstrap.cc:654] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.041420 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.043596 21185 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:20.043918 21227 tablet_bootstrap.cc:492] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.044339 21227 ts_tablet_manager.cc:1403] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.027s	user 0.002s	sys 0.015s
I20260709 12:16:20.041633 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:20.045718 20999 leader_election.cc:343] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.046801 21002 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:20.047017 21227 raft_consensus.cc:359] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.047685 21227 raft_consensus.cc:385] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.047955 21227 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.048717 21227 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.050282 21283 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.051980 21283 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.052361 21283 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.053706 21227 ts_tablet_manager.cc:1434] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:16:20.054675 21227 tablet_bootstrap.cc:492] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:20.062630 21283 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.065802 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:20.067859 21231 tablet_bootstrap.cc:492] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.068368 21231 ts_tablet_manager.cc:1403] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.005s
I20260709 12:16:20.069664 21229 tablet_bootstrap.cc:492] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.070067 21229 ts_tablet_manager.cc:1403] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.015s
I20260709 12:16:20.070390 21227 tablet_bootstrap.cc:654] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:20.067729 20999 leader_election.cc:343] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.070891 21231 raft_consensus.cc:359] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.071518 21231 raft_consensus.cc:385] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.071776 21231 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.072546 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:20.072386 21231 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.073093 21185 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.073199 21229 raft_consensus.cc:359] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.073853 21229 raft_consensus.cc:385] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.074106 21229 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.074285 21231 ts_tablet_manager.cc:1434] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:20.074728 21229 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.076900 21229 ts_tablet_manager.cc:1434] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:20.077665 21231 tablet_bootstrap.cc:492] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.083669 21231 tablet_bootstrap.cc:654] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.082638 21185 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:20.092387 21111 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.092782 21002 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:20.093665 21263 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.094121 21263 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:20.094941 21263 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.101460 21283 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.104617 21229 tablet_bootstrap.cc:492] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.104331 21280 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.111099 21229 tablet_bootstrap.cc:654] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.118221 21238 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.118669 21238 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.120673 21238 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.122889 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.123116 21280 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.123975 21255 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.124392 21255 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.126266 21255 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.128811 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.129690 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.129760 21185 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:20.130870 21077 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:20.131649 21256 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.131985 21256 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:20.132122 21151 leader_election.cc:343] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.132330 21256 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.126682 21255 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.132663 21281 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.132972 21255 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.133168 21281 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:20.134914 21076 leader_election.cc:343] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.135401 21281 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.136027 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.136628 21110 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:20.138501 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.139087 21034 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:20.139936 20999 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:20.140969 21229 tablet_bootstrap.cc:492] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.141208 21255 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.140978 21281 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.141952 21281 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.141484 21229 ts_tablet_manager.cc:1403] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.016s
I20260709 12:16:20.142161 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.142329 21281 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.143955 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.144544 21186 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
W20260709 12:16:20.145433 21002 leader_election.cc:343] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.146620 21077 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:20.144984 21229 raft_consensus.cc:359] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.148221 21256 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.148757 21229 raft_consensus.cc:385] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.149077 21229 raft_consensus.cc:740] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.149362 21281 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.150585 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:20.151006 21229 consensus_queue.cc:260] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.151399 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:20.151872 21034 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.151921 21186 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.153332 21255 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.153667 21255 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.153971 21255 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.154984 21229 ts_tablet_manager.cc:1434] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:16:20.155926 21229 tablet_bootstrap.cc:492] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.158200 21034 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:20.159318 21076 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:20.160077 21230 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.161375 21229 tablet_bootstrap.cc:654] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.162928 21256 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.165468 21186 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:20.167805 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.169157 21111 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:20.170079 21149 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:20.171216 21238 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.171535 21238 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.171856 21238 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.177820 20933 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.177858 21255 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.178104 21238 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.180850 21255 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.181787 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:20.181423 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:20.182314 21185 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.182513 21034 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.186280 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:16:20.187538 21151 leader_election.cc:343] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.188269 21185 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:20.188283 21230 raft_consensus.cc:697] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:20.180749 21231 tablet_bootstrap.cc:492] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.189410 21231 ts_tablet_manager.cc:1403] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.112s	user 0.038s	sys 0.052s
I20260709 12:16:20.189504 21077 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:20.190188 21229 tablet_bootstrap.cc:492] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.190357 21319 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.190615 21229 ts_tablet_manager.cc:1403] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.004s
I20260709 12:16:20.190536 21230 consensus_queue.cc:237] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.191198 21319 raft_consensus.cc:697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:20.191985 21231 raft_consensus.cc:359] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.192628 21231 raft_consensus.cc:385] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.192127 21319 consensus_queue.cc:237] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.192899 21231 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.193094 21229 raft_consensus.cc:359] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.193558 21231 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.196492 21227 tablet_bootstrap.cc:492] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.196895 21227 ts_tablet_manager.cc:1403] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.035s
I20260709 12:16:20.197595 21034 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:20.198446 21229 raft_consensus.cc:385] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.198746 21229 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.200143 21231 ts_tablet_manager.cc:1434] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:16:20.200311 21229 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.201309 21231 tablet_bootstrap.cc:492] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.203377 21229 ts_tablet_manager.cc:1434] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:16:20.204249 21229 tablet_bootstrap.cc:492] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.204151 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:20.204722 21111 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.204823 21281 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.205580 21238 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.207552 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:20.207605 21227 raft_consensus.cc:359] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.208164 21110 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.208276 21227 raft_consensus.cc:385] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.208559 21227 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.209174 21227 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.213574 21231 tablet_bootstrap.cc:654] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.211063 21227 ts_tablet_manager.cc:1434] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:16:20.218099 21227 tablet_bootstrap.cc:492] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
W20260709 12:16:20.220564 21002 consensus_peers.cc:597] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:20.223240 21227 tablet_bootstrap.cc:654] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.230990 21263 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:20.235147 21110 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:20.232700 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:20.237303 21231 tablet_bootstrap.cc:492] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.237715 21231 ts_tablet_manager.cc:1403] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.021s
I20260709 12:16:20.237790 21111 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:20.239078 21149 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:20.240361 21238 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.240285 21231 raft_consensus.cc:359] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.241029 21231 raft_consensus.cc:385] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.241009 21278 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.241421 21231 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.241634 20999 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:20.241537 21278 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.242456 21263 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.242898 21263 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:20.243221 21185 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.243767 21278 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.243654 21263 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.245255 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.240927 21238 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:20.242167 21231 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.245924 21230 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.248488 21230 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.249048 21231 ts_tablet_manager.cc:1434] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
W20260709 12:16:20.246861 21151 leader_election.cc:343] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.246608 21238 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.247584 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:20.252204 21149 leader_election.cc:343] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.252633 21149 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:20.253638 21278 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.254535 21185 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:20.255781 20934 catalog_manager.cc:5697] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.257547 21231 tablet_bootstrap.cc:492] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.258235 21229 tablet_bootstrap.cc:654] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.263454 21230 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.264505 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:20.265893 21077 leader_election.cc:343] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.270000 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:20.271557 21076 leader_election.cc:343] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.272521 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:20.273546 21319 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.276944 20934 catalog_manager.cc:5697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.282972 21238 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.283473 21238 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.283684 21278 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.284317 20933 catalog_manager.cc:5697] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:20.286573 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.287506 21319 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.288049 21238 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.287988 21319 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.288209 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:20.292091 21149 leader_election.cc:343] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.292866 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:20.293313 21151 leader_election.cc:343] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.293749 21151 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:16:20.294147 21076 leader_election.cc:343] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.294508 21278 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.295006 21319 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.296469 21278 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.298040 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:20.300099 21077 leader_election.cc:343] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.300484 21077 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:20.304879 21231 tablet_bootstrap.cc:654] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.305828 21230 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.312141 21238 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.313750 21229 tablet_bootstrap.cc:492] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.314148 21229 ts_tablet_manager.cc:1403] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.000s
I20260709 12:16:20.316908 21230 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.317332 21230 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.320039 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:20.321291 21076 leader_election.cc:343] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.322821 21227 tablet_bootstrap.cc:492] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.323252 21227 ts_tablet_manager.cc:1403] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.018s
I20260709 12:16:20.325701 21227 raft_consensus.cc:359] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.325258 20933 catalog_manager.cc:5697] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.326323 21227 raft_consensus.cc:385] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.328346 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:20.329746 21077 leader_election.cc:343] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.330169 21077 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:20.330905 21319 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.331151 21230 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.331941 21229 raft_consensus.cc:359] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.332563 21229 raft_consensus.cc:385] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.332809 21229 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.326645 21227 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.334177 21227 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.335232 21229 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.337337 21229 ts_tablet_manager.cc:1434] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:16:20.338179 21229 tablet_bootstrap.cc:492] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.343425 21229 tablet_bootstrap.cc:654] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.347661 21231 tablet_bootstrap.cc:492] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.348042 21231 ts_tablet_manager.cc:1403] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.017s
I20260709 12:16:20.348588 21227 ts_tablet_manager.cc:1434] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:16:20.349448 21227 tablet_bootstrap.cc:492] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:20.350368 21231 raft_consensus.cc:359] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.350981 21231 raft_consensus.cc:385] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.351248 21231 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.351840 21231 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.353730 21231 ts_tablet_manager.cc:1434] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:20.354559 21231 tablet_bootstrap.cc:492] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.356194 21238 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.356647 21238 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.357287 21278 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.357717 21278 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.358592 21238 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.359611 21278 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.359952 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.360538 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:20.361961 21151 leader_election.cc:343] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.363194 21231 tablet_bootstrap.cc:654] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.364989 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.366261 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.368101 21231 tablet_bootstrap.cc:492] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.355836 21227 tablet_bootstrap.cc:654] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.368314 21185 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.368614 21231 ts_tablet_manager.cc:1403] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 12:16:20.369719 21149 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:16:20.370774 21149 leader_election.cc:343] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.371191 21149 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:20.372542 21238 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.373118 21238 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.373587 21231 raft_consensus.cc:359] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.374251 21231 raft_consensus.cc:385] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.374583 21231 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.373957 21229 tablet_bootstrap.cc:492] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.375633 21229 ts_tablet_manager.cc:1403] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:16:20.376545 21231 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.379382 21231 ts_tablet_manager.cc:1434] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:16:20.389506 21229 raft_consensus.cc:359] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.390179 21229 raft_consensus.cc:385] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.390439 21229 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.391111 21229 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.393625 21229 ts_tablet_manager.cc:1434] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:20.394690 21231 tablet_bootstrap.cc:492] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.396754 21229 tablet_bootstrap.cc:492] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.405946 21227 tablet_bootstrap.cc:492] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.406368 21227 ts_tablet_manager.cc:1403] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.009s
I20260709 12:16:20.412927 21227 raft_consensus.cc:359] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.413872 21238 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.415315 21238 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.414175 21262 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.417423 21227 raft_consensus.cc:385] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.417768 21227 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.419916 21238 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.420456 21229 tablet_bootstrap.cc:654] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.418516 21227 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.423202 21227 ts_tablet_manager.cc:1434] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 12:16:20.423151 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:20.424582 21151 leader_election.cc:343] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.425891 21227 tablet_bootstrap.cc:492] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
W20260709 12:16:20.424660 20982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:20.426980 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:20.430540 21149 leader_election.cc:343] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.430970 21149 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:20.431929 21227 tablet_bootstrap.cc:654] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.432410 21238 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.424757 21231 tablet_bootstrap.cc:654] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.441145 21229 tablet_bootstrap.cc:492] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.441534 21229 ts_tablet_manager.cc:1403] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.010s
I20260709 12:16:20.443068 21227 tablet_bootstrap.cc:492] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.443511 21227 ts_tablet_manager.cc:1403] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 12:16:20.443866 21229 raft_consensus.cc:359] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.444479 21229 raft_consensus.cc:385] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.444761 21231 tablet_bootstrap.cc:492] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.444751 21229 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.445257 21231 ts_tablet_manager.cc:1403] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.005s
I20260709 12:16:20.445480 21229 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.447161 21231 raft_consensus.cc:359] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.447417 21229 ts_tablet_manager.cc:1434] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:20.447628 21231 raft_consensus.cc:385] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.446029 21227 raft_consensus.cc:359] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.447889 21231 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.448127 21227 raft_consensus.cc:385] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.448436 21229 tablet_bootstrap.cc:492] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.448426 21227 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.448648 21231 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.450802 21231 ts_tablet_manager.cc:1434] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:20.451979 21231 tablet_bootstrap.cc:492] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.456699 21231 tablet_bootstrap.cc:654] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.465608 21229 tablet_bootstrap.cc:654] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.468066 21230 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.449227 21227 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.468545 21230 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.470132 21227 ts_tablet_manager.cc:1434] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.001s
I20260709 12:16:20.470498 21230 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.471091 21227 tablet_bootstrap.cc:492] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:20.472273 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.473052 21185 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:20.475104 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.476594 21227 tablet_bootstrap.cc:654] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.476668 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:20.477414 21230 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.482515 21230 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.483888 21229 tablet_bootstrap.cc:492] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.484175 21231 tablet_bootstrap.cc:492] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.484266 21229 ts_tablet_manager.cc:1403] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.003s
I20260709 12:16:20.484609 21231 ts_tablet_manager.cc:1403] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.007s
I20260709 12:16:20.485487 21227 tablet_bootstrap.cc:492] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.485896 21227 ts_tablet_manager.cc:1403] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:16:20.486697 21229 raft_consensus.cc:359] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.487005 21231 raft_consensus.cc:359] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.487339 21229 raft_consensus.cc:385] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.487632 21231 raft_consensus.cc:385] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.487675 21229 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.487989 21231 raft_consensus.cc:740] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.487864 21256 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.488201 21227 raft_consensus.cc:359] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.488523 21229 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.488790 21227 raft_consensus.cc:385] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.488775 21231 consensus_queue.cc:260] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.489243 21227 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.489818 21227 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.491632 21227 ts_tablet_manager.cc:1434] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:16:20.492472 21227 tablet_bootstrap.cc:492] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:20.497726 21227 tablet_bootstrap.cc:654] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.498713 21229 ts_tablet_manager.cc:1434] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:16:20.498792 21231 ts_tablet_manager.cc:1434] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:16:20.501775 21229 tablet_bootstrap.cc:492] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.503183 21231 tablet_bootstrap.cc:492] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.506903 21229 tablet_bootstrap.cc:654] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.509771 21231 tablet_bootstrap.cc:654] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:20.516268 21077 consensus_peers.cc:597] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:20.516851 21263 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.517517 21229 tablet_bootstrap.cc:492] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.517316 21263 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.517925 21229 ts_tablet_manager.cc:1403] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 12:16:20.520335 21229 raft_consensus.cc:359] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.520890 21229 raft_consensus.cc:385] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.521148 21229 raft_consensus.cc:740] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.521447 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.521768 21263 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.521752 21229 consensus_queue.cc:260] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:20.522750 21002 leader_election.cc:343] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.523943 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.524335 21229 ts_tablet_manager.cc:1434] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 12:16:20.525390 20999 leader_election.cc:343] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.525799 20999 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:20.527127 21263 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.528334 21229 tablet_bootstrap.cc:492] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.528375 21227 tablet_bootstrap.cc:492] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.530166 21227 ts_tablet_manager.cc:1403] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.025s
I20260709 12:16:20.532632 21231 tablet_bootstrap.cc:492] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.532437 21227 raft_consensus.cc:359] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.533011 21231 ts_tablet_manager.cc:1403] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 12:16:20.533011 21227 raft_consensus.cc:385] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.533428 21227 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.534125 21227 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.534881 21229 tablet_bootstrap.cc:654] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.536150 21227 ts_tablet_manager.cc:1434] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:20.538537 21227 tablet_bootstrap.cc:492] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:20.539235 21231 raft_consensus.cc:359] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.539853 21231 raft_consensus.cc:385] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.540112 21231 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.540694 21231 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.542491 21231 ts_tablet_manager.cc:1434] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.000s
I20260709 12:16:20.544493 21231 tablet_bootstrap.cc:492] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.545802 21229 tablet_bootstrap.cc:492] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.546147 21229 ts_tablet_manager.cc:1403] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:16:20.548187 21227 tablet_bootstrap.cc:654] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.548802 21229 raft_consensus.cc:359] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.549413 21229 raft_consensus.cc:385] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.549726 21229 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.550040 21231 tablet_bootstrap.cc:654] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.549999 21263 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.550366 21229 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.550670 21263 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.552359 21229 ts_tablet_manager.cc:1434] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:16:20.552556 21263 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.553238 21229 tablet_bootstrap.cc:492] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:20.555198 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.555785 21185 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:20.554675 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.556757 21111 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:20.558866 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:20.566094 21263 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.566484 21263 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.566836 21263 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.602415 21229 tablet_bootstrap.cc:654] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.607852 21281 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.608520 21281 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.612942 21281 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:20.608583 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 50001.4us
I20260709 12:16:20.618590 21238 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.618374 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.625087 21185 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:20.624962 21238 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.626150 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:20.615778 21263 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.627475 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.628361 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.629034 21231 tablet_bootstrap.cc:492] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.629091 21281 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.628669 21227 tablet_bootstrap.cc:492] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.629632 21231 ts_tablet_manager.cc:1403] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.022s
I20260709 12:16:20.629731 21281 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.629807 21227 ts_tablet_manager.cc:1403] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.091s	user 0.034s	sys 0.033s
I20260709 12:16:20.630191 21281 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.632468 21231 raft_consensus.cc:359] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.633150 21231 raft_consensus.cc:385] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.633538 21231 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.633190 21227 raft_consensus.cc:359] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.634155 21227 raft_consensus.cc:385] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.630059 21263 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.634433 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:20.634243 21231 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.634702 21227 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.635449 21227 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.629774 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:20.636399 21231 ts_tablet_manager.cc:1434] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:20.637332 21231 tablet_bootstrap.cc:492] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.636904 21262 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.635022 21185 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.644898 21230 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.648089 21230 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.648331 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:20.648860 21110 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.637477 21227 ts_tablet_manager.cc:1434] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:16:20.651333 21263 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.651590 21227 tablet_bootstrap.cc:492] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:20.651767 21263 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.653540 21263 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.653784 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.654366 21111 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:20.654997 21186 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.655349 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.655966 21184 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:20.657145 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:20.657604 21227 tablet_bootstrap.cc:654] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.657949 21283 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.658288 21283 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.658603 21283 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.649992 21230 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.660293 21278 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.660547 21231 tablet_bootstrap.cc:654] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.660753 21278 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.661509 21230 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.661931 21230 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.662645 21278 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.663126 21278 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.663518 21278 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.664395 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.664657 21230 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.664985 21184 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:20.665246 21278 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.666976 21230 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.667367 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.667992 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:20.668444 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.673343 21109 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:20.668919 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.674322 21034 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:20.674456 21149 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:20.675488 21256 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.669098 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.675887 21256 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.676225 21111 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:20.669330 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.676633 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:20.676774 21263 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.670743 21110 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:20.672819 21184 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:20.676234 21256 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.678435 21230 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.682041 21278 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.682448 21278 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.682780 21278 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.688722 20999 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:20.689936 21263 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.690402 21263 raft_consensus.cc:697] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:20.682046 21262 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.691215 21263 consensus_queue.cc:237] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.691576 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.671289 21283 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.694087 21238 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.691217 21262 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.698777 21262 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.722565 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.723325 21033 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:20.725061 21229 tablet_bootstrap.cc:492] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:20.725483 21229 ts_tablet_manager.cc:1403] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.172s	user 0.006s	sys 0.006s
I20260709 12:16:20.735641 21229 raft_consensus.cc:359] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.736248 21229 raft_consensus.cc:385] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.736526 21229 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.736613 21262 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.737154 21229 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.738456 21262 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.694478 21230 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.740403 21230 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.742076 21185 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:20.742738 21278 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.746517 21354 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.747040 21354 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.749009 21354 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.749992 21281 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.752470 21281 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.770953 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.788733 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.789748 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:20.791965 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:20.792588 21256 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.793286 21283 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.793830 21283 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.794545 21256 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.799677 21184 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:20.795236 21110 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:20.798928 21278 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:20.799296 21185 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.799547 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:20.802367 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:16:20.767370 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 90823.1us
I20260709 12:16:20.800906 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:20.804994 21108 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.809892 21108 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:20.810865 21231 tablet_bootstrap.cc:492] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:20.811388 21231 ts_tablet_manager.cc:1403] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.174s	user 0.037s	sys 0.059s
I20260709 12:16:20.812258 21227 tablet_bootstrap.cc:492] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:20.812744 21227 ts_tablet_manager.cc:1403] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.161s	user 0.032s	sys 0.058s
W20260709 12:16:20.811343 21076 leader_election.cc:343] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.813791 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:20.817863 21229 ts_tablet_manager.cc:1434] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.092s	user 0.013s	sys 0.005s
I20260709 12:16:20.820256 21229 tablet_bootstrap.cc:492] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
W20260709 12:16:20.815933 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 141544us
I20260709 12:16:20.827801 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:20.830596 21034 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:20.818895 20999 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:16:20.817893 21151 leader_election.cc:343] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.859236 21263 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.859745 21263 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.862201 21263 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.858793 21231 raft_consensus.cc:359] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.863958 21231 raft_consensus.cc:385] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.838182 21186 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.865149 21231 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.830722 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:20.882391 21186 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:20.883379 21231 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.886479 21231 ts_tablet_manager.cc:1434] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 12:16:20.856869 21364 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:20.858902 21076 leader_election.cc:343] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.919767 21231 tablet_bootstrap.cc:492] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:20.935187 21281 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.935606 21281 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.935935 21281 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:20.888933 20999 leader_election.cc:343] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:20.900309 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 70683.1us
W20260709 12:16:20.921214 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 62998.7us
I20260709 12:16:20.956857 21256 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.955116 21364 raft_consensus.cc:697] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:20.953198 21361 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.143s
I20260709 12:16:20.961439 21319 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.960438 21256 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.963078 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:16:20.958344 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 93554.9us
I20260709 12:16:20.970803 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:20.964511 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:20.971419 21186 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:20.971902 21106 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.964670 21110 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.977012 21229 tablet_bootstrap.cc:654] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.976527 21364 consensus_queue.cc:237] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.977034 21227 raft_consensus.cc:359] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.979346 21227 raft_consensus.cc:385] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.979562 21227 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.963353 21319 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:20.979827 20930 catalog_manager.cc:5697] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.987011 21319 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.987228 21255 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:16:20.994542 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:20.995319 21182 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:20.993559 21256 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:20.995841 21227 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.001077 21227 ts_tablet_manager.cc:1434] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.188s	user 0.005s	sys 0.003s
I20260709 12:16:21.004724 21227 tablet_bootstrap.cc:492] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:21.004967 21185 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:21.008190 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:21.008793 21106 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:21.008785 21109 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:21.099450 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:21.017414 21227 tablet_bootstrap.cc:654] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.013338 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:21.087236 21356 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.020856 21149 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:21.088936 21281 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.074579 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:21.095655 21110 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:21.189849 21361 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.197278 21361 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:16:21.192432 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 220083us
I20260709 12:16:21.200189 21280 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.200686 21280 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:21.051278 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:21.014497 21364 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.099635 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:21.093357 21255 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.196496 21229 tablet_bootstrap.cc:492] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:21.196301 21356 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.059463 21230 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.137s
I20260709 12:16:21.204747 21229 ts_tablet_manager.cc:1403] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.385s	user 0.016s	sys 0.022s
I20260709 12:16:21.106467 21077 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:21.201802 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:21.201506 21280 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.208016 21361 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.205060 21032 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:21.211390 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:16:21.202426 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 188393us
I20260709 12:16:21.212704 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:21.213505 21281 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.215409 21231 tablet_bootstrap.cc:654] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.212332 21255 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.216180 21357 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:21.217007 21185 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
W20260709 12:16:21.222225 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 115865us
I20260709 12:16:21.220391 21256 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.207096 21035 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:21.224294 21256 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.224453 21365 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.225569 21256 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.218137 21031 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.205468 21364 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.213621 21149 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:21.229908 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:21.233637 21036 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.236791 21280 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.232514 21255 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.228783 20999 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:21.241971 21280 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:16:21.238759 21151 leader_election.cc:343] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.240651 21230 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.252781 21362 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.253155 21362 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.253460 21362 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.250164 21230 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.259127 21230 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.260136 21364 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.258579 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:21.263123 21182 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.263638 21229 raft_consensus.cc:359] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.264308 21229 raft_consensus.cc:385] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.264569 21229 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.265391 21229 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.265915 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:21.262470 21256 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.268867 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:21.276892 21255 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.279924 21229 ts_tablet_manager.cc:1434] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.001s
I20260709 12:16:21.280776 21255 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:21.284242 21077 leader_election.cc:343] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.270473 21230 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.292054 21032 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:21.296509 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:21.296636 21362 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.297170 21107 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:21.297552 21229 tablet_bootstrap.cc:492] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:21.300370 21149 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:21.292641 21356 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:21.249441 21280 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:21.302582 21368 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:16:21.302754 21002 leader_election.cc:343] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.302999 21278 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.298774 21031 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:21.310768 21227 tablet_bootstrap.cc:492] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:21.311523 21227 ts_tablet_manager.cc:1403] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.307s	user 0.031s	sys 0.073s
I20260709 12:16:21.313943 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:21.314597 21184 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:21.308313 21278 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.320235 21227 raft_consensus.cc:359] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.320760 21227 raft_consensus.cc:385] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.320956 21227 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.322382 21227 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.324899 21362 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.325606 21077 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:21.319205 21278 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.327020 21255 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.327219 21182 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:21.327390 21255 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.327809 21255 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.328490 21077 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:21.327145 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:21.332917 21107 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.315845 21361 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:16:21.340052 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:21.341555 21231 tablet_bootstrap.cc:492] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:21.341454 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:21.341998 21231 ts_tablet_manager.cc:1403] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.422s	user 0.021s	sys 0.007s
I20260709 12:16:21.342535 21230 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.348330 21383 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.348753 21383 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.349057 21383 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.349313 21227 ts_tablet_manager.cc:1434] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.001s
I20260709 12:16:21.358212 21227 tablet_bootstrap.cc:492] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:21.376561 21227 tablet_bootstrap.cc:654] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.382875 21387 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.383282 21387 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.383616 21387 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.387238 21231 raft_consensus.cc:359] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.389567 21231 raft_consensus.cc:385] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:21.391175 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 53702.3us
I20260709 12:16:21.363507 21256 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.361688 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:21.392843 21231 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.362567 21358 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:16:21.390614 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:21.397490 21231 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:21.395049 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 66884.3us
I20260709 12:16:21.402957 21229 tablet_bootstrap.cc:654] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.405347 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:21.402344 21361 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.407238 21361 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:21.407502 21383 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.408020 21361 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.401921 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:21.406760 21376 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:16:21.418380 21231 ts_tablet_manager.cc:1434] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:16:21.424855 21278 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.426306 21383 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.412369 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:21.402961 21034 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:21.427006 21227 tablet_bootstrap.cc:492] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:21.467744 21229 tablet_bootstrap.cc:492] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:21.589610 21227 ts_tablet_manager.cc:1403] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.002s
I20260709 12:16:21.426262 21278 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:21.425745 21387 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.589735 21229 ts_tablet_manager.cc:1403] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.292s	user 0.009s	sys 0.018s
I20260709 12:16:21.431500 21231 tablet_bootstrap.cc:492] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:21.589725 21185 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.487222 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:21.594563 21180 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.596421 21111 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:21.597344 21387 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.598102 21185 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:21.509243 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:21.598775 21033 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.599455 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:21.600304 21354 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.600852 21354 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:16:21.488461 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 56764.2us
I20260709 12:16:21.601629 21354 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.539189 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:21.469336 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:21.605548 21183 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.602223 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:21.609157 21365 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.564358 21107 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:21.576229 21255 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.611428 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:16:21.604856 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 196733us
I20260709 12:16:21.641417 21186 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.576056 20930 catalog_manager.cc:5697] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.658905 21186 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:21.660669 21033 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:21.662012 21110 raft_consensus.cc:2393] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 1: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:21.673602 21229 raft_consensus.cc:359] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.674006 21077 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:21.674247 21229 raft_consensus.cc:385] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.674510 21229 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.674991 21278 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.675101 21229 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.675417 21383 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.676548 21383 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:21.658178 21183 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:21.677277 21229 ts_tablet_manager.cc:1434] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.006s
I20260709 12:16:21.677289 21383 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.679297 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:21.679924 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:21.680218 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:21.681737 21036 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.662281 21255 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:21.670819 20982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:21.678574 21227 raft_consensus.cc:359] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.684324 21227 raft_consensus.cc:385] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.684624 21227 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.685497 21229 tablet_bootstrap.cc:492] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:21.685225 21227 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.690362 21231 tablet_bootstrap.cc:654] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.695830 21181 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:21.707718 21227 ts_tablet_manager.cc:1434] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.118s	user 0.004s	sys 0.002s
I20260709 12:16:21.660223 20930 catalog_manager.cc:5697] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.710577 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:16:21.713231 21076 leader_election.cc:343] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.711714 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:21.713359 21184 raft_consensus.cc:2393] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:21.713773 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:21.714340 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:21.714886 21031 raft_consensus.cc:2393] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:21.715445 21255 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.715902 21255 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:21.716672 21255 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.710736 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:21.718883 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:21.719358 21033 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.720515 21227 tablet_bootstrap.cc:492] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:21.721462 21278 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.723124 21278 raft_consensus.cc:697] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:21.723989 21036 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:21.723888 21278 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.730754 21229 tablet_bootstrap.cc:654] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.731845 21033 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:21.744863 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:21.745674 21385 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.745906 21231 tablet_bootstrap.cc:492] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:21.746325 21231 ts_tablet_manager.cc:1403] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.315s	user 0.019s	sys 0.016s
I20260709 12:16:21.748319 21076 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:21.749022 21385 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.748858 21231 raft_consensus.cc:359] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.749502 21231 raft_consensus.cc:385] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.749771 21231 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.750381 21231 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.756135 21231 ts_tablet_manager.cc:1434] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:16:21.761539 21076 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:21.762532 21385 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.762996 21385 raft_consensus.cc:697] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:21.763718 21385 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.763981 21365 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.765573 21180 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:21.754565 21361 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:16:21.767032 21364 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.768445 21231 tablet_bootstrap.cc:492] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:21.768314 21362 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.765600 21281 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:16:21.781919 21227 tablet_bootstrap.cc:654] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.783288 21356 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:21.799546 21229 tablet_bootstrap.cc:492] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:21.799899 21229 ts_tablet_manager.cc:1403] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.016s
I20260709 12:16:21.816366 21229 raft_consensus.cc:359] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.818472 21229 raft_consensus.cc:385] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.818759 21229 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.819440 21229 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.827555 21229 ts_tablet_manager.cc:1434] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:16:21.837159 21229 tablet_bootstrap.cc:492] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:21.840497 21231 tablet_bootstrap.cc:654] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.841578 21227 tablet_bootstrap.cc:492] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:21.842067 21227 ts_tablet_manager.cc:1403] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.010s
I20260709 12:16:21.858660 21227 raft_consensus.cc:359] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.864748 21227 raft_consensus.cc:385] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.865022 21227 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.865736 21227 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.874019 21227 ts_tablet_manager.cc:1434] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 12:16:21.874995 21227 tablet_bootstrap.cc:492] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:21.878247 21383 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.878701 21383 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.880185 21229 tablet_bootstrap.cc:654] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.880694 21383 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.881664 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:21.882059 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:21.882234 21181 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:21.870657 20931 catalog_manager.cc:5697] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.883443 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:16:21.885180 21076 leader_election.cc:343] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.884338 21383 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.887771 21383 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.888271 21383 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.891770 21227 tablet_bootstrap.cc:654] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.897217 21231 tablet_bootstrap.cc:492] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:21.897743 21231 ts_tablet_manager.cc:1403] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.141s	user 0.025s	sys 0.005s
I20260709 12:16:21.897612 20933 catalog_manager.cc:5697] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.899509 21383 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.899148 20933 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.900697 20933 catalog_manager.cc:5697] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.901598 21383 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.902554 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:21.903209 21180 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.902570 20933 catalog_manager.cc:5697] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.903682 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:16:21.905033 21076 leader_election.cc:343] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.906059 21231 raft_consensus.cc:359] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.906649 21231 raft_consensus.cc:385] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.906919 21231 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.907348 21280 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.907523 21231 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.910599 21180 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:21.911909 21231 ts_tablet_manager.cc:1434] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:16:21.912787 21231 tablet_bootstrap.cc:492] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:21.911752 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:21.918323 21031 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.918599 21255 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.919052 21255 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:21.919824 21255 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.921571 21231 tablet_bootstrap.cc:654] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.926131 21231 tablet_bootstrap.cc:492] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:21.925855 21278 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.926515 21231 ts_tablet_manager.cc:1403] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:16:21.929142 21231 raft_consensus.cc:359] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.928791 20930 catalog_manager.cc:5697] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.929752 21231 raft_consensus.cc:385] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.930047 21231 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.931000 21227 tablet_bootstrap.cc:492] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:21.931465 21227 ts_tablet_manager.cc:1403] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.000s
I20260709 12:16:21.931178 21231 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.933353 21231 ts_tablet_manager.cc:1434] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:21.933538 21229 tablet_bootstrap.cc:492] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:21.933925 21229 ts_tablet_manager.cc:1403] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.000s
I20260709 12:16:21.934173 21231 tablet_bootstrap.cc:492] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:21.936295 21229 raft_consensus.cc:359] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.936913 21229 raft_consensus.cc:385] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.937170 21229 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.937757 21229 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.939694 21229 ts_tablet_manager.cc:1434] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:21.940191 21231 tablet_bootstrap.cc:654] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.940505 21229 tablet_bootstrap.cc:492] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:21.946604 21229 tablet_bootstrap.cc:654] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.951390 21231 tablet_bootstrap.cc:492] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:21.951066 21227 raft_consensus.cc:359] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.951833 21231 ts_tablet_manager.cc:1403] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:16:21.952040 21227 raft_consensus.cc:385] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.952342 21227 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.953256 21227 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.954219 21231 raft_consensus.cc:359] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.954810 21231 raft_consensus.cc:385] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.955096 21231 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.955192 21227 ts_tablet_manager.cc:1434] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:16:21.956092 21227 tablet_bootstrap.cc:492] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:21.955883 21231 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.958043 21231 ts_tablet_manager.cc:1434] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:21.958818 21231 tablet_bootstrap.cc:492] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:21.962229 21227 tablet_bootstrap.cc:654] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.963799 21231 tablet_bootstrap.cc:654] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.971561 21231 tablet_bootstrap.cc:492] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:21.971931 21231 ts_tablet_manager.cc:1403] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 12:16:21.974196 21231 raft_consensus.cc:359] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.975195 20931 catalog_manager.cc:5697] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.974946 21231 raft_consensus.cc:385] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.976461 21231 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.976696 20931 catalog_manager.cc:5697] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.977152 21231 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.978765 21231 ts_tablet_manager.cc:1434] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:21.977981 20931 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.979597 21231 tablet_bootstrap.cc:492] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:21.983412 21229 tablet_bootstrap.cc:492] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:21.983808 21229 ts_tablet_manager.cc:1403] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.003s
I20260709 12:16:21.985112 21231 tablet_bootstrap.cc:654] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.986095 21229 raft_consensus.cc:359] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.986720 21229 raft_consensus.cc:385] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.987011 21229 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.987578 21229 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.988721 21362 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.989181 21362 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.989737 21229 ts_tablet_manager.cc:1434] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:21.990581 21229 tablet_bootstrap.cc:492] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:21.991734 21227 tablet_bootstrap.cc:492] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:21.992014 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:21.992158 21362 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:21.993387 21227 ts_tablet_manager.cc:1403] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.009s
I20260709 12:16:21.993561 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:21.994357 21180 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:21.995666 21229 tablet_bootstrap.cc:654] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.996065 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:21.996059 21227 raft_consensus.cc:359] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:21.996753 21231 tablet_bootstrap.cc:492] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:21.997001 21227 raft_consensus.cc:385] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.997259 21362 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.997386 21227 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.998224 21227 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.002637 21227 ts_tablet_manager.cc:1434] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:16:22.003611 21227 tablet_bootstrap.cc:492] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:22.003651 21362 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.997256 21231 ts_tablet_manager.cc:1403] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:16:22.006738 21231 raft_consensus.cc:359] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.007371 21231 raft_consensus.cc:385] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.007606 21231 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.008177 21231 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.010258 21231 ts_tablet_manager.cc:1434] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:22.011083 21231 tablet_bootstrap.cc:492] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:22.016274 21231 tablet_bootstrap.cc:654] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.022775 21231 tablet_bootstrap.cc:492] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:22.023173 21231 ts_tablet_manager.cc:1403] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:16:22.023278 21229 tablet_bootstrap.cc:492] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:22.024432 21229 ts_tablet_manager.cc:1403] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.034s	user 0.029s	sys 0.003s
I20260709 12:16:22.025683 21231 raft_consensus.cc:359] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.026124 21231 raft_consensus.cc:385] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.026280 21231 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.026734 21231 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.026978 21229 raft_consensus.cc:359] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.027616 21229 raft_consensus.cc:385] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.027887 21229 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.028512 21229 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.029043 21231 ts_tablet_manager.cc:1434] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:22.030126 21231 tablet_bootstrap.cc:492] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:22.030406 21229 ts_tablet_manager.cc:1434] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:16:22.031266 21229 tablet_bootstrap.cc:492] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:22.034188 21231 tablet_bootstrap.cc:654] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.036299 21229 tablet_bootstrap.cc:654] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.038947 21227 tablet_bootstrap.cc:654] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.050537 21227 tablet_bootstrap.cc:492] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:22.050887 21227 ts_tablet_manager.cc:1403] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.047s	user 0.003s	sys 0.014s
I20260709 12:16:22.051294 21229 tablet_bootstrap.cc:492] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:22.051308 21231 tablet_bootstrap.cc:492] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:22.051815 21229 ts_tablet_manager.cc:1403] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:16:22.051880 21231 ts_tablet_manager.cc:1403] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 12:16:22.052681 21227 raft_consensus.cc:359] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.053146 21227 raft_consensus.cc:385] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.053335 21227 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.053867 21227 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.054198 21231 raft_consensus.cc:359] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.054374 21229 raft_consensus.cc:359] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.054875 21231 raft_consensus.cc:385] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.054991 21229 raft_consensus.cc:385] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.055166 21231 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.057143 21229 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.057534 21231 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.057766 21229 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.055560 21227 ts_tablet_manager.cc:1434] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:22.059850 21229 ts_tablet_manager.cc:1434] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:22.060534 21227 tablet_bootstrap.cc:492] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:22.061441 21231 ts_tablet_manager.cc:1434] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:22.062261 21231 tablet_bootstrap.cc:492] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:22.063515 21229 tablet_bootstrap.cc:492] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:22.067520 21231 tablet_bootstrap.cc:654] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.069411 21229 tablet_bootstrap.cc:654] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.070994 21278 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.071434 21278 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.073463 21278 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.076071 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:22.076701 21107 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:22.077975 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.081525 21149 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:22.085477 21362 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:22.082754 21151 leader_election.cc:343] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.089838 21383 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.098822 21356 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.099282 21356 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.099663 21356 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.108460 21356 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.110379 21356 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.111778 21365 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.114627 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:22.115679 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:22.116225 21107 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:22.119601 21151 leader_election.cc:343] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.120873 21355 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.121313 21355 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.123301 21355 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.125700 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:22.130295 21355 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.130456 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.133714 21151 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:22.135372 21278 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.136601 21278 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.138700 21185 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.148757 21383 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.164940 21362 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.165402 21362 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.168498 21362 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.171598 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:22.172286 21184 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:22.174908 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:22.175016 21002 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:22.175499 21111 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:22.176294 21365 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.176720 21365 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.177043 21365 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.177251 21383 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.185343 21361 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.187541 21361 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.200122 21107 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:22.201535 21149 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:22.202654 21356 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.069937 21227 tablet_bootstrap.cc:654] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.203159 21356 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:22.204056 21356 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.238914 21365 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.241726 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:22.241914 21365 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.242285 21111 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.244045 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:22.244642 21186 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.250711 21186 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:22.260089 21111 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:22.261111 20999 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:22.263955 21362 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.264598 21362 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:22.265380 21362 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.288300 21278 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.288749 21278 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.289737 21383 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.290222 21383 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.290575 21278 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.292119 21383 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.294314 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:22.296311 21149 leader_election.cc:343] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.299580 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.316473 21355 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.316901 21355 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.318892 21355 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.319766 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.320358 21034 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:22.321521 21076 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:22.322305 21255 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.322645 21255 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.322980 21255 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.331108 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:22.331694 21180 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:22.333686 21256 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.334137 21256 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.335994 21256 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.338130 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.348526 21256 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.353138 21255 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.355803 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:22.356343 21032 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.359138 21355 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.359563 21355 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.362304 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:22.363654 21149 leader_election.cc:343] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.364473 21355 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.368530 21383 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.368789 21032 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:22.369890 21076 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:22.370659 21383 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.371106 21383 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:22.371876 21383 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.320822 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:22.376391 21149 leader_election.cc:343] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.379105 21227 tablet_bootstrap.cc:492] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:22.379522 21227 ts_tablet_manager.cc:1403] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.319s	user 0.005s	sys 0.005s
I20260709 12:16:22.381930 21227 raft_consensus.cc:359] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.382524 21227 raft_consensus.cc:385] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.383766 21255 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.385402 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:22.386509 21076 leader_election.cc:343] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.400427 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:22.405256 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:22.408366 21151 leader_election.cc:343] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.408779 21151 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:22.410262 21355 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.410115 20930 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:22.412593 20934 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:22.382781 21227 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.414465 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:22.415583 21180 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.422611 21227 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:22.423647 21151 leader_election.cc:343] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.424067 21151 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:22.426885 21180 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:22.427416 21229 tablet_bootstrap.cc:492] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:22.427647 21227 ts_tablet_manager.cc:1434] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:16:22.427949 21229 ts_tablet_manager.cc:1403] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.365s	user 0.074s	sys 0.154s
I20260709 12:16:22.428400 21227 tablet_bootstrap.cc:492] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:22.429272 21278 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:22.429646 21151 leader_election.cc:343] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.430051 21151 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:22.430759 21278 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.430663 21229 raft_consensus.cc:359] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.431308 21229 raft_consensus.cc:385] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.431576 21229 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.432293 21229 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.432545 21255 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.433254 21231 tablet_bootstrap.cc:492] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
W20260709 12:16:22.432363 21077 leader_election.cc:343] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.433657 21231 ts_tablet_manager.cc:1403] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.372s	user 0.115s	sys 0.213s
I20260709 12:16:22.433877 21077 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:22.434374 21229 ts_tablet_manager.cc:1434] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:22.434768 21255 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.435212 21229 tablet_bootstrap.cc:492] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:22.436012 21231 raft_consensus.cc:359] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.436650 21231 raft_consensus.cc:385] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.436902 21231 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.437461 21231 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.439273 21227 tablet_bootstrap.cc:654] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.439941 21231 ts_tablet_manager.cc:1434] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:22.440799 21231 tablet_bootstrap.cc:492] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:22.441188 21229 tablet_bootstrap.cc:654] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.446137 21231 tablet_bootstrap.cc:654] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.452540 21227 tablet_bootstrap.cc:492] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:22.452906 21227 ts_tablet_manager.cc:1403] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 12:16:22.455367 21227 raft_consensus.cc:359] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.456279 21227 raft_consensus.cc:385] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.456560 21227 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.458083 21227 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.459105 21229 tablet_bootstrap.cc:492] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:22.459075 21383 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.459626 21383 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.460790 21227 ts_tablet_manager.cc:1434] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:22.461549 21383 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.461705 20931 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:22.461592 21227 tablet_bootstrap.cc:492] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:22.463217 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.463784 21231 tablet_bootstrap.cc:492] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:22.464170 21231 ts_tablet_manager.cc:1403] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
W20260709 12:16:22.464556 21076 leader_election.cc:343] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.459614 21229 ts_tablet_manager.cc:1403] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 12:16:22.466657 21231 raft_consensus.cc:359] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.467994 21231 raft_consensus.cc:385] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.468250 21231 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.468874 21227 tablet_bootstrap.cc:654] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.468952 21231 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.471087 21362 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.471329 21231 ts_tablet_manager.cc:1434] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:16:22.471560 21362 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.472168 21231 tablet_bootstrap.cc:492] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:22.472735 21229 raft_consensus.cc:359] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.473349 21229 raft_consensus.cc:385] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.473465 21362 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.473615 21229 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.474228 21229 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.474982 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:22.475751 21180 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:22.476133 21229 ts_tablet_manager.cc:1434] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:16:22.476895 21229 tablet_bootstrap.cc:492] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:22.477792 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:22.481266 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:22.481848 21229 tablet_bootstrap.cc:654] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.482241 21354 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.485708 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:22.487668 21231 tablet_bootstrap.cc:654] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:22.491016 21077 leader_election.cc:343] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.491465 21077 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:22.492532 21383 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.498459 21354 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.505746 21231 tablet_bootstrap.cc:492] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:22.506186 21231 ts_tablet_manager.cc:1403] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.010s
I20260709 12:16:22.508661 21231 raft_consensus.cc:359] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.509274 21231 raft_consensus.cc:385] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.509537 21231 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.510262 21231 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.512265 21231 ts_tablet_manager.cc:1434] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:16:22.513206 21231 tablet_bootstrap.cc:492] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:22.523723 21229 tablet_bootstrap.cc:492] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:22.524106 21229 ts_tablet_manager.cc:1403] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.008s
I20260709 12:16:22.524570 21227 tablet_bootstrap.cc:492] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:22.524960 21227 ts_tablet_manager.cc:1403] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.006s
I20260709 12:16:22.526335 21229 raft_consensus.cc:359] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.526960 21229 raft_consensus.cc:385] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.527209 21229 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.527657 21227 raft_consensus.cc:359] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.528290 21227 raft_consensus.cc:385] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.528208 21229 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.528587 21227 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.530594 21229 ts_tablet_manager.cc:1434] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:16:22.530992 21227 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.531407 21229 tablet_bootstrap.cc:492] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:22.532883 21227 ts_tablet_manager.cc:1434] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:22.533370 21354 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.533658 21231 tablet_bootstrap.cc:654] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.533807 21354 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.534271 21453 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.535710 21354 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.536513 21227 tablet_bootstrap.cc:492] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:22.536425 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:22.539690 21110 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:22.540277 21229 tablet_bootstrap.cc:654] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.542353 21227 tablet_bootstrap.cc:654] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.546273 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:22.551322 21383 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.555361 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:22.556061 21354 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.563024 21356 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.563480 21356 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.565366 21356 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.567135 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:22.568430 21149 leader_election.cc:343] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.573268 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:22.574584 21151 leader_election.cc:343] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.574992 21151 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:22.576014 21356 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.577062 21354 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.591589 21227 tablet_bootstrap.cc:492] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:22.592041 21227 ts_tablet_manager.cc:1403] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.013s
I20260709 12:16:22.594494 21227 raft_consensus.cc:359] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.595144 21227 raft_consensus.cc:385] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.595403 21227 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.596040 21227 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.598018 21227 ts_tablet_manager.cc:1434] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:22.607473 21227 tablet_bootstrap.cc:492] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:22.610289 21229 tablet_bootstrap.cc:492] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:22.610715 21229 ts_tablet_manager.cc:1403] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.079s	user 0.027s	sys 0.048s
I20260709 12:16:22.612462 21231 tablet_bootstrap.cc:492] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:22.612865 21231 ts_tablet_manager.cc:1403] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.024s
I20260709 12:16:22.613106 21229 raft_consensus.cc:359] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.613745 21229 raft_consensus.cc:385] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.613996 21229 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.614593 21229 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.615263 21231 raft_consensus.cc:359] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.615854 21231 raft_consensus.cc:385] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.616111 21231 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.616526 21229 ts_tablet_manager.cc:1434] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:22.616801 21231 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.617281 21229 tablet_bootstrap.cc:492] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:22.622367 21229 tablet_bootstrap.cc:654] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.622481 21231 ts_tablet_manager.cc:1434] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:16:22.623310 21231 tablet_bootstrap.cc:492] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:22.626703 21229 tablet_bootstrap.cc:492] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:22.627116 21229 ts_tablet_manager.cc:1403] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:16:22.628196 21231 tablet_bootstrap.cc:654] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.631771 21227 tablet_bootstrap.cc:654] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.632341 21229 raft_consensus.cc:359] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.632972 21229 raft_consensus.cc:385] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.633236 21229 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.633837 21229 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.637382 21229 ts_tablet_manager.cc:1434] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:16:22.639101 21453 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.639546 21453 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.638728 21229 tablet_bootstrap.cc:492] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:22.641616 21453 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.643399 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.643834 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:22.643976 21036 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:22.644405 21185 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:22.645126 21076 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:22.647053 21231 tablet_bootstrap.cc:492] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:22.646961 21453 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.647379 21227 tablet_bootstrap.cc:492] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:22.647431 21453 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.647869 21453 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.647943 21227 ts_tablet_manager.cc:1403] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.002s
I20260709 12:16:22.648280 21229 tablet_bootstrap.cc:654] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.650463 21227 raft_consensus.cc:359] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.651155 21227 raft_consensus.cc:385] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.651661 21356 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.652117 21356 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.653945 21356 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.654102 21453 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.656394 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.655115 21227 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.655318 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:22.670826 21231 ts_tablet_manager.cc:1403] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.003s
I20260709 12:16:22.674335 21036 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:22.674456 21110 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:22.674728 21227 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.675772 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:22.676641 21356 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.676990 21356 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.677299 21356 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.677474 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:22.678025 21033 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.688171 21033 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:22.689136 21076 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:22.689862 21383 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.690302 21383 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:22.691322 21227 ts_tablet_manager.cc:1434] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.043s	user 0.017s	sys 0.007s
I20260709 12:16:22.691088 21383 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.692190 21227 tablet_bootstrap.cc:492] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:22.697764 21227 tablet_bootstrap.cc:654] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.710368 21362 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.712370 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:22.712909 21180 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.713091 21453 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.714573 21231 raft_consensus.cc:359] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.715302 21231 raft_consensus.cc:385] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.715539 21231 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.716166 21231 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.718432 21231 ts_tablet_manager.cc:1434] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:16:22.719357 21231 tablet_bootstrap.cc:492] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:22.721287 21356 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.726984 20933 catalog_manager.cc:5697] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:22.726531 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:22.729898 21033 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.730775 21278 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.729312 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:22.733551 21111 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.736474 21278 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.725255 21356 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.762127 21229 tablet_bootstrap.cc:492] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:22.763602 21229 ts_tablet_manager.cc:1403] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.125s	user 0.033s	sys 0.034s
I20260709 12:16:22.764617 21453 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.765118 21453 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.767132 21453 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.767036 21231 tablet_bootstrap.cc:654] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.773413 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:22.774020 21185 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:22.775115 21077 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:22.780102 21111 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:22.781193 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.781379 21383 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.781726 21383 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.781795 21031 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:22.782078 21383 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.782774 21149 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:22.783769 21229 raft_consensus.cc:359] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.785307 21229 raft_consensus.cc:385] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.785562 21229 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.786156 21229 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.787887 21229 ts_tablet_manager.cc:1434] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:16:22.788064 21356 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.785728 21365 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:22.788744 21229 tablet_bootstrap.cc:492] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:22.790197 21383 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.799642 21227 tablet_bootstrap.cc:492] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:22.800076 21227 ts_tablet_manager.cc:1403] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.108s	user 0.007s	sys 0.008s
I20260709 12:16:22.804124 21453 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.804608 21453 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.806550 21453 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.817670 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:22.818248 21181 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:22.820361 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:22.822028 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.822609 21031 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
W20260709 12:16:22.826398 20982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:22.798460 21356 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:22.829582 21356 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.807204 21180 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:22.822793 21227 raft_consensus.cc:359] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.903798 21227 raft_consensus.cc:385] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.904183 21227 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.904759 21227 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.894505 21278 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.832377 21453 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.907624 21278 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.911556 21453 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.911937 21453 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.848155 21383 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.904112 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:22.915025 21227 ts_tablet_manager.cc:1434] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.115s	user 0.020s	sys 0.022s
I20260709 12:16:22.916771 21227 tablet_bootstrap.cc:492] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:22.917083 21255 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.918568 21255 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.919747 21231 tablet_bootstrap.cc:492] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:22.919821 21278 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:22.920387 21255 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:22.921137 21184 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.923166 21231 ts_tablet_manager.cc:1403] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.204s	user 0.007s	sys 0.020s
I20260709 12:16:22.922320 21453 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:22.948701 21229 tablet_bootstrap.cc:654] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:22.958374 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 46419.7us
I20260709 12:16:22.979012 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:22.970369 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:22.992144 21031 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.999857 21231 raft_consensus.cc:359] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.000542 21231 raft_consensus.cc:385] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.000804 21231 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.001374 21231 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.001461 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:23.002605 21186 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:23.001564 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:23.092554 21184 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
W20260709 12:16:23.089012 21076 leader_election.cc:343] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.095399 21356 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.097062 21478 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.097157 21356 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.097589 21478 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.098024 21383 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.098407 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.099540 21478 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.101285 21229 tablet_bootstrap.cc:492] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:23.101639 21355 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.102152 21355 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.101719 21229 ts_tablet_manager.cc:1403] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.313s	user 0.019s	sys 0.003s
I20260709 12:16:23.104061 21355 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.105055 21453 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.105351 21229 raft_consensus.cc:359] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.106026 21229 raft_consensus.cc:385] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.106295 21229 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.106902 21229 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.107887 21227 tablet_bootstrap.cc:654] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.108314 21229 ts_tablet_manager.cc:1434] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:23.109182 21229 tablet_bootstrap.cc:492] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:23.096897 21231 ts_tablet_manager.cc:1434] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.173s	user 0.012s	sys 0.038s
I20260709 12:16:23.115103 21031 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
W20260709 12:16:23.116195 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 136734us
I20260709 12:16:23.118604 21077 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:23.119462 21255 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.119741 21077 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.119804 21255 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.120410 21255 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.120952 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.121093 21485 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.121474 21180 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.121582 21485 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:23.122416 21485 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.127981 21255 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.114764 21229 tablet_bootstrap.cc:654] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.129513 21180 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.130136 21255 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.131906 21227 tablet_bootstrap.cc:492] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:23.132370 21227 ts_tablet_manager.cc:1403] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.216s	user 0.008s	sys 0.004s
I20260709 12:16:23.133015 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.134215 21453 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.134764 21255 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.134649 21453 raft_consensus.cc:697] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:23.136236 21453 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.138875 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:23.139412 21032 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.141151 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.141662 21186 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.152630 21032 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.154701 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:23.048321 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 75054.2us
I20260709 12:16:23.006080 21033 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:23.160938 21231 tablet_bootstrap.cc:492] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.164196 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.165998 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.166708 21231 tablet_bootstrap.cc:654] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.166836 21362 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.168485 21362 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.171427 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.172654 21356 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.175173 21483 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:23.102406 21149 leader_election.cc:343] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.175805 21483 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:16:23.175911 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 73532.9us
I20260709 12:16:23.176803 21483 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.178987 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.179605 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.180593 21110 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:23.180485 21227 raft_consensus.cc:359] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.181293 21227 raft_consensus.cc:385] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.181635 21227 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.183372 21231 tablet_bootstrap.cc:492] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:23.183821 21231 ts_tablet_manager.cc:1403] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 12:16:23.185756 21036 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.191213 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.191804 21029 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:23.194262 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.182298 21227 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.205741 21227 ts_tablet_manager.cc:1434] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.000s
W20260709 12:16:23.206454 21151 leader_election.cc:343] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.209376 21227 tablet_bootstrap.cc:492] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:23.211740 21362 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.212715 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:23.212389 20931 catalog_manager.cc:5697] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.213683 21180 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
W20260709 12:16:23.213995 21149 leader_election.cc:343] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.214425 21149 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:23.215133 21231 raft_consensus.cc:359] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:23.215451 21151 leader_election.cc:343] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:23.215703 21149 leader_election.cc:343] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.215888 21151 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:23.216974 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:23.215850 21477 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.217806 21477 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.218118 21477 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.218427 21477 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.218696 21231 raft_consensus.cc:385] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.219036 21231 raft_consensus.cc:740] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.219660 21231 consensus_queue.cc:260] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.224969 21229 tablet_bootstrap.cc:492] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:23.216890 21478 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.227021 21229 ts_tablet_manager.cc:1403] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.118s	user 0.028s	sys 0.023s
I20260709 12:16:23.227535 20931 catalog_manager.cc:5697] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.222563 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.229166 21110 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:23.229353 21229 raft_consensus.cc:359] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.229065 21477 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.229962 21229 raft_consensus.cc:385] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.230530 21229 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.221698 21231 ts_tablet_manager.cc:1434] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:16:23.229764 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:23.231769 21231 tablet_bootstrap.cc:492] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.231951 21186 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
W20260709 12:16:23.233361 21151 leader_election.cc:343] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.234248 21229 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.238319 21229 ts_tablet_manager.cc:1434] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:23.235244 21151 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:23.242048 21229 tablet_bootstrap.cc:492] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:23.243013 21356 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.247663 21229 tablet_bootstrap.cc:654] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.254415 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:23.256767 21231 tablet_bootstrap.cc:654] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.260982 20930 catalog_manager.cc:5697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.235059 21362 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.264770 21362 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.265136 21362 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.236647 21036 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.240305 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:23.263549 21483 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.268582 21110 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.239378 21477 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.271154 21231 tablet_bootstrap.cc:492] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:23.271566 21231 ts_tablet_manager.cc:1403] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.007s
I20260709 12:16:23.273556 21362 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.273941 21231 raft_consensus.cc:359] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.274616 21029 raft_consensus.cc:2393] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:23.274577 21231 raft_consensus.cc:385] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.275527 21231 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.276376 21231 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.277982 21229 tablet_bootstrap.cc:492] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:23.278555 21231 ts_tablet_manager.cc:1434] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:23.279970 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.280292 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:23.278815 21110 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:23.279810 21227 tablet_bootstrap.cc:654] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.280725 21184 raft_consensus.cc:2393] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:23.283670 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:23.283346 20931 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.284181 21229 ts_tablet_manager.cc:1403] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.015s
I20260709 12:16:23.284472 21482 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.285247 21149 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:23.286274 21477 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.286711 21477 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:23.286928 21229 raft_consensus.cc:359] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.287752 21229 raft_consensus.cc:385] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.288050 21229 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.288745 21229 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.288851 21477 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.290753 21229 ts_tablet_manager.cc:1434] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:23.292837 21229 tablet_bootstrap.cc:492] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:23.278788 21362 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.301589 21229 tablet_bootstrap.cc:654] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.281188 21231 tablet_bootstrap.cc:492] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.304785 21485 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.318946 21231 tablet_bootstrap.cc:654] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.320787 21485 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.321256 21485 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.323319 21485 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.323920 21278 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.324244 21227 tablet_bootstrap.cc:492] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:23.324776 21227 ts_tablet_manager.cc:1403] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.007s
I20260709 12:16:23.326934 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.327527 21036 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:23.328943 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.329728 21383 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.330075 21383 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.330395 21383 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.333966 21227 raft_consensus.cc:359] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.335089 21227 raft_consensus.cc:385] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.335623 21227 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.335896 20930 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.337633 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:23.338205 21184 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:23.336997 21227 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.342723 21227 ts_tablet_manager.cc:1434] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:16:23.346999 21383 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.348372 21227 tablet_bootstrap.cc:492] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:23.349503 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:23.350049 21034 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.359073 21034 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.359400 21229 tablet_bootstrap.cc:492] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:23.359830 21229 ts_tablet_manager.cc:1403] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.004s
I20260709 12:16:23.363039 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.363794 21485 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.364226 21485 raft_consensus.cc:697] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:23.364967 21485 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.369388 21453 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.369837 21453 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.370254 21383 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.371485 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.372359 21186 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.377650 21453 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.378986 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.379419 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:23.380276 21076 leader_election.cc:343] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.380110 21229 raft_consensus.cc:359] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.380734 21229 raft_consensus.cc:385] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.380998 21229 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
W20260709 12:16:23.381740 21077 leader_election.cc:343] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.382207 21227 tablet_bootstrap.cc:654] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.382161 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:23.383322 21485 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.384068 21229 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.386014 21229 ts_tablet_manager.cc:1434] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.002s
I20260709 12:16:23.385479 20930 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.390290 21231 tablet_bootstrap.cc:492] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:23.390705 21231 ts_tablet_manager.cc:1403] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.006s
I20260709 12:16:23.393501 21355 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.386826 21229 tablet_bootstrap.cc:492] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:23.388763 21186 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.409034 21231 raft_consensus.cc:359] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.409474 21231 raft_consensus.cc:385] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.409677 21231 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.410193 21231 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.412034 21231 ts_tablet_manager.cc:1434] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 12:16:23.413682 21231 tablet_bootstrap.cc:492] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.415880 21227 tablet_bootstrap.cc:492] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:23.416291 21227 ts_tablet_manager.cc:1403] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.068s	user 0.004s	sys 0.006s
I20260709 12:16:23.418941 21231 tablet_bootstrap.cc:654] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.418639 21227 raft_consensus.cc:359] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.419291 21227 raft_consensus.cc:385] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.419564 21227 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.420257 21227 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.422549 21227 ts_tablet_manager.cc:1434] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:16:23.423367 21227 tablet_bootstrap.cc:492] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:23.423758 21229 tablet_bootstrap.cc:654] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.428429 21227 tablet_bootstrap.cc:654] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.432698 21231 tablet_bootstrap.cc:492] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:23.433079 21231 ts_tablet_manager.cc:1403] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:16:23.433475 21227 tablet_bootstrap.cc:492] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:23.433864 21227 ts_tablet_manager.cc:1403] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 12:16:23.435613 21453 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.435374 21231 raft_consensus.cc:359] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.436029 21231 raft_consensus.cc:385] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.436393 21231 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.436057 21453 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.437029 21231 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.438153 21453 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.440009 21231 ts_tablet_manager.cc:1434] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:23.439894 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:23.440460 21186 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:23.441009 21231 tablet_bootstrap.cc:492] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.441411 21077 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.442145 21453 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.442477 21453 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.442787 21453 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.443010 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.443585 21034 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:23.449016 21453 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.451831 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.452333 21186 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.452525 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:23.453907 21034 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.452802 21231 tablet_bootstrap.cc:654] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.457736 21227 raft_consensus.cc:359] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.458391 21227 raft_consensus.cc:385] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.458633 21227 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.459283 21227 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.461474 21186 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.462697 21077 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.463405 21453 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.464629 21485 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.465072 21485 raft_consensus.cc:697] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:23.465808 21485 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.472355 21227 ts_tablet_manager.cc:1434] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:16:23.473281 21227 tablet_bootstrap.cc:492] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:23.474954 21034 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.479792 21227 tablet_bootstrap.cc:654] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.480135 21229 tablet_bootstrap.cc:492] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:23.480481 21229 ts_tablet_manager.cc:1403] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.025s
I20260709 12:16:23.482270 21229 raft_consensus.cc:359] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.482180 20933 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.482944 21229 raft_consensus.cc:385] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.483800 21229 raft_consensus.cc:740] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.484400 21227 tablet_bootstrap.cc:492] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:23.484304 21229 consensus_queue.cc:260] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.484896 21227 ts_tablet_manager.cc:1403] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:16:23.486086 21229 ts_tablet_manager.cc:1434] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:23.484447 21231 tablet_bootstrap.cc:492] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:23.486994 21231 ts_tablet_manager.cc:1403] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.006s
I20260709 12:16:23.487274 21227 raft_consensus.cc:359] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.487875 21227 raft_consensus.cc:385] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.488128 21227 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.488739 21227 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.488200 21229 tablet_bootstrap.cc:492] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:23.490473 21231 raft_consensus.cc:359] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.491317 21231 raft_consensus.cc:385] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.491557 21231 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.492244 21231 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.494087 21231 ts_tablet_manager.cc:1434] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:23.494086 21227 ts_tablet_manager.cc:1434] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:16:23.495157 21227 tablet_bootstrap.cc:492] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:23.496392 21229 tablet_bootstrap.cc:654] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.500254 21227 tablet_bootstrap.cc:654] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.501514 21229 tablet_bootstrap.cc:492] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:23.501900 21229 ts_tablet_manager.cc:1403] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 12:16:23.503225 21231 tablet_bootstrap.cc:492] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.504175 21229 raft_consensus.cc:359] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.504758 21229 raft_consensus.cc:385] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.505010 21229 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.505584 21229 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.507534 21229 ts_tablet_manager.cc:1434] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:16:23.508323 21229 tablet_bootstrap.cc:492] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:23.508845 21231 tablet_bootstrap.cc:654] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.512348 21229 tablet_bootstrap.cc:654] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.513594 21485 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.513821 21231 tablet_bootstrap.cc:492] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:23.514709 21231 ts_tablet_manager.cc:1403] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:16:23.514058 21485 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.516355 21485 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.517055 21231 raft_consensus.cc:359] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.517642 21231 raft_consensus.cc:385] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.517884 21231 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.518587 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:23.518445 21231 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.519177 21186 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:23.520344 21231 ts_tablet_manager.cc:1434] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:23.520501 21077 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.521170 21231 tablet_bootstrap.cc:492] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.521247 21485 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.521606 21485 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.521903 21485 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.524358 21362 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.524855 21362 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.526710 21362 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.527279 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.528414 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.539322 21231 tablet_bootstrap.cc:654] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.534137 21477 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.539927 21477 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:23.541227 21076 leader_election.cc:343] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.542246 21477 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.528124 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:23.544723 21184 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:23.544764 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.545677 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.545897 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:16:23.546267 21149 leader_election.cc:343] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.531608 21485 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.548591 21485 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.549564 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.550132 21184 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.550205 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:16:23.552274 20999 leader_election.cc:343] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:23.553122 21076 leader_election.cc:343] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.546254 21034 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:23.553927 21362 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.554710 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:23.555564 21362 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.555979 21362 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.556173 21355 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.556568 21355 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.556902 21355 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.566816 21362 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.569393 21184 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.568061 21355 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.570521 21077 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:23.571599 21485 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.572072 21485 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:23.572243 21355 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.572866 21485 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.574028 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.578063 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:23.578359 21362 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:23.579654 21149 leader_election.cc:343] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.574759 21186 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:23.581738 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:16:23.583104 20999 leader_election.cc:343] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.583539 20999 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:23.585649 21227 tablet_bootstrap.cc:492] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:23.586162 21227 ts_tablet_manager.cc:1403] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.034s
I20260709 12:16:23.587706 21354 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.589629 21227 raft_consensus.cc:359] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.590322 21227 raft_consensus.cc:385] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.590579 21231 tablet_bootstrap.cc:492] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:23.590633 21227 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.590956 21229 tablet_bootstrap.cc:492] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:23.591092 21231 ts_tablet_manager.cc:1403] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.070s	user 0.046s	sys 0.021s
I20260709 12:16:23.591441 21229 ts_tablet_manager.cc:1403] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.008s
I20260709 12:16:23.591612 21227 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.593731 21227 ts_tablet_manager.cc:1434] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:16:23.593534 21231 raft_consensus.cc:359] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.594146 21231 raft_consensus.cc:385] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.594405 21231 raft_consensus.cc:740] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.589789 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:23.595027 21231 consensus_queue.cc:260] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.595583 21227 tablet_bootstrap.cc:492] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:23.595839 21034 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:23.596921 21231 ts_tablet_manager.cc:1434] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:23.597755 21231 tablet_bootstrap.cc:492] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.599229 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:23.600179 21477 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.602147 20931 catalog_manager.cc:5697] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.603649 21256 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.604095 21256 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.604485 21483 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.606362 21256 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.594548 21229 raft_consensus.cc:359] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.607906 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:23.608484 21180 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:23.609555 21077 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.610306 21383 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.610639 21383 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.610973 21383 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.613008 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:23.616886 21076 leader_election.cc:343] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.617110 21227 tablet_bootstrap.cc:654] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.619293 21231 tablet_bootstrap.cc:654] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.619498 21383 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.625809 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:16:23.627082 21076 leader_election.cc:343] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.631594 21231 tablet_bootstrap.cc:492] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:23.632052 21231 ts_tablet_manager.cc:1403] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
I20260709 12:16:23.633355 21256 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.633836 21256 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.634660 21231 raft_consensus.cc:359] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.635895 21256 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.636164 21231 raft_consensus.cc:385] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.636945 21231 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.637418 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:23.637432 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.638170 21186 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:23.638413 21231 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.639588 21077 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.640324 21453 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.640681 21453 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.641016 21453 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.641311 21231 ts_tablet_manager.cc:1434] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:23.642140 21231 tablet_bootstrap.cc:492] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.647395 21231 tablet_bootstrap.cc:654] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.647572 21453 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.651517 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:23.652984 21485 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.675364 21485 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.690208 21453 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.607625 21229 raft_consensus.cc:385] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.692198 21229 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.691675 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.692886 21186 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.692802 21229 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.693670 21034 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:23.703143 21355 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.703658 21355 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.705673 21355 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.707209 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.707780 21110 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:23.708839 21149 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:23.709580 21355 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.709908 21355 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.710227 21355 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.712862 21256 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.713402 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:23.714684 21151 leader_election.cc:343] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.719005 21186 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.719779 21355 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.720613 21077 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:23.721693 21485 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.722188 21485 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:23.722254 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:23.722466 21383 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.725533 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:23.737154 21110 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.694617 21229 ts_tablet_manager.cc:1434] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.103s	user 0.004s	sys 0.001s
I20260709 12:16:23.733843 21453 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:23.735224 21483 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:23.724291 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.745981 21185 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.748690 21229 tablet_bootstrap.cc:492] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
W20260709 12:16:23.726068 21151 leader_election.cc:343] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.755311 21477 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.755730 21477 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.759850 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.760413 21029 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:23.724257 21485 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.767740 21151 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:23.768502 21480 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.768869 21480 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.769188 21480 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.730191 21355 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.820230 21482 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.824726 21482 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.833969 21482 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.834920 21185 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:23.846565 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:23.843662 21077 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:16:23.848721 21002 leader_election.cc:343] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.848821 21110 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:23.849577 21383 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.850044 21383 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:23.851071 21229 tablet_bootstrap.cc:654] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.850790 21383 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.830683 21480 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.836323 21477 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.859249 21227 tablet_bootstrap.cc:492] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:23.859725 21227 ts_tablet_manager.cc:1403] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.264s	user 0.022s	sys 0.046s
I20260709 12:16:23.864899 21231 tablet_bootstrap.cc:492] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:23.865360 21231 ts_tablet_manager.cc:1403] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.223s	user 0.054s	sys 0.090s
I20260709 12:16:23.871623 21355 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.872081 21355 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.872907 21480 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.879396 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.880756 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:23.882165 21355 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:23.889072 20931 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.890712 21227 raft_consensus.cc:359] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.891376 21227 raft_consensus.cc:385] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.891620 21227 raft_consensus.cc:740] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
W20260709 12:16:23.892620 21151 leader_election.cc:343] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.892573 21227 consensus_queue.cc:260] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.897284 21231 raft_consensus.cc:359] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.897899 21231 raft_consensus.cc:385] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.898136 21231 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.887301 21033 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.898715 21231 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.902314 21231 ts_tablet_manager.cc:1434] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 12:16:23.905727 21149 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:23.907668 21278 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.906919 21231 tablet_bootstrap.cc:492] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:23.908139 21278 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:23.902559 21227 ts_tablet_manager.cc:1434] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.003s
I20260709 12:16:23.918262 21355 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.918946 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.919521 21110 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:23.920742 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:23.921638 21482 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.921959 21482 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.922271 21482 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.923252 21278 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.928498 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.935935 21453 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.936614 21033 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:23.937698 21151 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:23.938076 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:23.938508 21355 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.939059 21355 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:23.939244 21530 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.939908 21482 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.939975 21355 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.942718 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:23.943220 21185 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.943406 21528 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.943828 21528 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:23.943360 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:23.947700 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:23.948266 21107 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:23.950042 21149 leader_election.cc:343] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.950416 21528 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:16:23.950909 21149 leader_election.cc:343] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.950971 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:23.951320 21528 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:23.951804 21149 leader_election.cc:343] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:23.952282 21151 leader_election.cc:343] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.952190 21149 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:23.972764 21227 tablet_bootstrap.cc:492] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:23.973183 21185 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:23.967730 21482 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:23.987221 21229 tablet_bootstrap.cc:492] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:23.987646 21229 ts_tablet_manager.cc:1403] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.239s	user 0.005s	sys 0.013s
I20260709 12:16:23.978818 21356 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.993391 21107 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:24.002983 21002 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:24.014278 21356 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.023138 21356 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.025136 21356 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:24.022746 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:24.029807 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:24.036267 21149 leader_election.cc:343] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.036701 21149 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:24.037600 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:24.040096 21151 leader_election.cc:343] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:24.040377 21076 consensus_peers.cc:597] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.045497 21528 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.046264 21484 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.046775 21484 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:24.047588 21484 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.060137 20931 catalog_manager.cc:5697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.069129 21229 raft_consensus.cc:359] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.059039 21529 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.074203 21229 raft_consensus.cc:385] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.094952 21229 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
W20260709 12:16:24.128263 21537 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:16:24.139622 21229 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.146780 20930 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.148451 20930 catalog_manager.cc:5697] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:24.161675 21540 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.080s	user 0.010s	sys 0.006s
W20260709 12:16:24.165925 21539 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.094s	user 0.004s	sys 0.011s
I20260709 12:16:24.168063 21231 tablet_bootstrap.cc:654] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.169718 21229 ts_tablet_manager.cc:1434] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.182s	user 0.008s	sys 0.004s
I20260709 12:16:24.172315 21229 tablet_bootstrap.cc:492] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
W20260709 12:16:24.158874 21149 leader_election.cc:343] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:24.185500 20982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:24.190641 21383 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.191753 21383 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.192677 21229 tablet_bootstrap.cc:654] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.193552 21383 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.196462 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:24.197191 21033 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:24.180254 21149 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:24.200893 20930 catalog_manager.cc:5697] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:24.202152 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 44366.9us
I20260709 12:16:24.202970 21383 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.203054 21528 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.205569 21483 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.209139 21229 tablet_bootstrap.cc:492] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:24.209561 21229 ts_tablet_manager.cc:1403] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.004s
I20260709 12:16:24.209097 21227 tablet_bootstrap.cc:654] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.216645 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:24.217386 21184 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:24.223042 21229 raft_consensus.cc:359] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.223670 21229 raft_consensus.cc:385] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.223927 21229 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.224578 21229 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.241518 21231 tablet_bootstrap.cc:492] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:24.241758 21229 ts_tablet_manager.cc:1434] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.032s	user 0.012s	sys 0.008s
I20260709 12:16:24.241955 21231 ts_tablet_manager.cc:1403] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.336s	user 0.015s	sys 0.031s
I20260709 12:16:24.248644 21231 raft_consensus.cc:359] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.249243 21231 raft_consensus.cc:385] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.249478 21229 tablet_bootstrap.cc:492] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:24.253973 21077 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:24.254830 21256 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.261174 21256 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.274202 21229 tablet_bootstrap.cc:654] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.249516 21231 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.275655 21231 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.277874 21231 ts_tablet_manager.cc:1434] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:16:24.284727 21231 tablet_bootstrap.cc:492] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:24.288141 21229 tablet_bootstrap.cc:492] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:24.288568 21229 ts_tablet_manager.cc:1403] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:16:24.289856 21231 tablet_bootstrap.cc:654] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.290439 21227 tablet_bootstrap.cc:492] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:24.290864 21227 ts_tablet_manager.cc:1403] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.318s	user 0.025s	sys 0.032s
I20260709 12:16:24.290904 21229 raft_consensus.cc:359] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.291615 21229 raft_consensus.cc:385] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.291855 21229 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.292474 21229 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.293407 21227 raft_consensus.cc:359] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.294085 21227 raft_consensus.cc:385] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.294343 21227 raft_consensus.cc:740] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.295109 21227 consensus_queue.cc:260] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.297108 21227 ts_tablet_manager.cc:1434] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:16:24.297955 21227 tablet_bootstrap.cc:492] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:24.302872 21229 ts_tablet_manager.cc:1434] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:16:24.304351 21229 tablet_bootstrap.cc:492] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:24.307552 21227 tablet_bootstrap.cc:654] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.309787 21229 tablet_bootstrap.cc:654] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.322959 21227 tablet_bootstrap.cc:492] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:24.322927 21229 tablet_bootstrap.cc:492] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:24.323510 21227 ts_tablet_manager.cc:1403] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.003s
I20260709 12:16:24.323562 21229 ts_tablet_manager.cc:1403] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.008s
I20260709 12:16:24.326000 21229 raft_consensus.cc:359] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.326184 21227 raft_consensus.cc:359] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.326635 21229 raft_consensus.cc:385] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.326768 21227 raft_consensus.cc:385] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.326941 21229 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.327647 21229 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.327945 21278 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.329054 21229 ts_tablet_manager.cc:1434] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:16:24.327654 21034 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.338425 21231 tablet_bootstrap.cc:492] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:24.338871 21231 ts_tablet_manager.cc:1403] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.009s
I20260709 12:16:24.327090 21227 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.339300 21278 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.341218 21231 raft_consensus.cc:359] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.341845 21231 raft_consensus.cc:385] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.342094 21231 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.339814 21227 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.343588 21229 tablet_bootstrap.cc:492] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:24.345000 21227 ts_tablet_manager.cc:1434] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:16:24.345827 21227 tablet_bootstrap.cc:492] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:24.349157 21229 tablet_bootstrap.cc:654] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.351287 21227 tablet_bootstrap.cc:654] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.351116 21231 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.358500 21231 ts_tablet_manager.cc:1434] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:16:24.359025 21383 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.360210 21231 tablet_bootstrap.cc:492] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:24.362965 21453 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.365191 21033 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.366328 21231 tablet_bootstrap.cc:654] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.370479 21229 tablet_bootstrap.cc:492] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:24.370898 21229 ts_tablet_manager.cc:1403] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.007s
I20260709 12:16:24.373283 21229 raft_consensus.cc:359] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.373870 21229 raft_consensus.cc:385] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.374114 21229 raft_consensus.cc:740] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.374902 21229 consensus_queue.cc:260] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.383126 21229 ts_tablet_manager.cc:1434] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:16:24.383934 21229 tablet_bootstrap.cc:492] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:24.389398 21356 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.389578 21229 tablet_bootstrap.cc:654] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.389885 21356 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.391793 21356 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:24.392729 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:24.392935 21383 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:24.393962 21149 leader_election.cc:343] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.395661 21029 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.397010 21231 tablet_bootstrap.cc:492] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:24.397352 21231 ts_tablet_manager.cc:1403] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.002s
I20260709 12:16:24.403225 21229 tablet_bootstrap.cc:492] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:24.405752 21229 ts_tablet_manager.cc:1403] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.008s
I20260709 12:16:24.399219 21231 raft_consensus.cc:359] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.407114 21231 raft_consensus.cc:385] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.408638 21231 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.407469 21453 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.409281 21231 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.417408 21453 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.418526 21231 ts_tablet_manager.cc:1434] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:16:24.419507 21453 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.420194 21231 tablet_bootstrap.cc:492] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:24.453166 21362 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.453644 21362 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.455289 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:24.455976 21033 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
W20260709 12:16:24.465376 21559 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:16:24.466359 21354 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.393128 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:24.467448 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:24.467870 21186 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:24.468664 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:24.469309 21383 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.469527 21383 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.469769 21383 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.475220 21256 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:16:24.477433 21151 leader_election.cc:343] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.477887 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:24.479424 21356 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.466807 21354 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.475549 21453 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.500360 21453 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.502365 21453 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.504223 21229 raft_consensus.cc:359] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.504884 21229 raft_consensus.cc:385] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.504981 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:24.505160 21229 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.505095 21356 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.505604 21184 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:24.505889 21229 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.506543 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:24.498694 21383 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.511971 21362 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.517915 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:24.518460 21186 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
W20260709 12:16:24.506807 21149 consensus_peers.cc:597] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.521867 21354 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.509249 21453 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.526957 21453 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.527297 21453 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.609508 21356 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.610085 21356 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.612390 21383 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.615347 21231 tablet_bootstrap.cc:654] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.621091 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:24.621699 21032 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:24.623380 21362 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.624131 21227 tablet_bootstrap.cc:492] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:24.624385 21356 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:24.624581 21227 ts_tablet_manager.cc:1403] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.279s	user 0.011s	sys 0.011s
I20260709 12:16:24.628084 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:24.628676 21227 raft_consensus.cc:359] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.629354 21227 raft_consensus.cc:385] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.629666 21227 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.629706 21034 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.630645 21453 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.632071 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:24.632596 21184 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.634545 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:24.635102 21031 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.637874 21227 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.638305 21184 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:24.639684 21227 ts_tablet_manager.cc:1434] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 12:16:24.639869 21229 ts_tablet_manager.cc:1434] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.234s	user 0.015s	sys 0.025s
I20260709 12:16:24.640277 21453 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.641144 21031 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:24.642671 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:24.641300 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:24.643231 21032 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.643426 21180 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.644290 21231 tablet_bootstrap.cc:492] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:24.644712 21231 ts_tablet_manager.cc:1403] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.225s	user 0.019s	sys 0.038s
I20260709 12:16:24.647830 21229 tablet_bootstrap.cc:492] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:24.624590 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:24.652984 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:24.653648 21564 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.654119 21564 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:24.656890 21180 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:24.659015 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:24.659160 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:24.659473 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:24.659924 21029 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
W20260709 12:16:24.660382 21149 leader_election.cc:343] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.660763 21453 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.661264 21453 raft_consensus.cc:697] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:24.653892 21229 tablet_bootstrap.cc:654] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.662070 21453 consensus_queue.cc:237] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.662874 21231 raft_consensus.cc:359] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.663529 21231 raft_consensus.cc:385] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.663797 21231 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.659196 21564 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.664589 21231 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.667111 21231 ts_tablet_manager.cc:1434] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:16:24.668012 21231 tablet_bootstrap.cc:492] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:24.673570 21231 tablet_bootstrap.cc:654] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.675380 21151 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:24.676666 21528 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.677806 21227 tablet_bootstrap.cc:492] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:24.680781 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:24.680256 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:24.678123 21528 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.690533 21528 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.693383 21229 tablet_bootstrap.cc:492] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:24.693745 21229 ts_tablet_manager.cc:1403] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.006s
I20260709 12:16:24.713155 21362 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.714815 21256 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.715281 21256 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.718796 21256 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.719393 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:24.702687 21528 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.735387 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:24.735986 21036 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.740309 21528 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:24.745473 21036 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:24.746026 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:24.746584 21151 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:16:24.747766 21149 leader_election.cc:343] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.749467 21355 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.749969 21355 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:24.750762 21355 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.754868 21227 tablet_bootstrap.cc:654] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.777556 21032 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:24.779120 21354 raft_consensus.cc:2764] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:16:24.826251 21231 tablet_bootstrap.cc:492] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:24.826795 21231 ts_tablet_manager.cc:1403] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.159s	user 0.017s	sys 0.033s
I20260709 12:16:24.836470 21227 tablet_bootstrap.cc:492] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:24.836978 21227 ts_tablet_manager.cc:1403] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.159s	user 0.020s	sys 0.006s
I20260709 12:16:24.848881 21227 raft_consensus.cc:359] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.856990 21227 raft_consensus.cc:385] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.857314 21227 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.858059 21227 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.859781 21231 raft_consensus.cc:359] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.860441 21231 raft_consensus.cc:385] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.862128 21227 ts_tablet_manager.cc:1434] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.002s
I20260709 12:16:24.848827 20931 catalog_manager.cc:5697] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.865038 20931 catalog_manager.cc:5697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.860693 21231 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.850351 21278 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.866441 21231 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.866415 21278 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.871887 21278 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:24.872423 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:24.873579 21151 leader_election.cc:343] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.873826 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:24.875110 21149 leader_election.cc:343] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.875533 21149 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:24.876216 21355 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.876901 21227 tablet_bootstrap.cc:492] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:24.887022 21356 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.887506 21356 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.888895 21229 raft_consensus.cc:359] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.889586 21229 raft_consensus.cc:385] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.889829 21229 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.890484 21229 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.892450 21229 ts_tablet_manager.cc:1434] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.198s	user 0.009s	sys 0.002s
I20260709 12:16:24.893268 21229 tablet_bootstrap.cc:492] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:24.896180 21231 ts_tablet_manager.cc:1434] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 12:16:24.897698 21231 tablet_bootstrap.cc:492] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:24.898339 21453 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.902004 21453 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.906168 21356 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:24.907269 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:24.904471 21453 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.923987 21227 tablet_bootstrap.cc:654] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.906399 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:24.929744 21151 leader_election.cc:343] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.925622 21184 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:24.934100 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:24.945503 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:24.946274 21564 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.946605 21564 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.946919 21564 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.957513 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:24.960475 21231 tablet_bootstrap.cc:654] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:24.963559 21149 leader_election.cc:343] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.963984 21149 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:24.965646 21574 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.966796 21564 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.969314 21564 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:24.969492 21229 tablet_bootstrap.cc:654] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.970230 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:24.970654 21184 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.972273 21227 tablet_bootstrap.cc:492] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:24.972522 21231 tablet_bootstrap.cc:492] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:24.972687 21227 ts_tablet_manager.cc:1403] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.025s
I20260709 12:16:24.973120 21231 ts_tablet_manager.cc:1403] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.001s
I20260709 12:16:24.975437 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:24.975888 21231 raft_consensus.cc:359] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.976651 21231 raft_consensus.cc:385] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.976733 21184 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:24.978595 21227 raft_consensus.cc:359] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.980319 21231 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.981685 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:24.982160 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:24.982345 21231 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.982904 21564 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.981704 21227 raft_consensus.cc:385] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.983613 21227 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.984263 21227 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.983345 21564 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:24.985256 21231 ts_tablet_manager.cc:1434] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:16:24.986177 21227 ts_tablet_manager.cc:1434] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:16:24.985844 21564 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:24.986202 21231 tablet_bootstrap.cc:492] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:24.987053 21227 tablet_bootstrap.cc:492] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:24.990080 20930 catalog_manager.cc:5697] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.991020 21482 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:24.998780 21227 tablet_bootstrap.cc:654] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.002647 21229 tablet_bootstrap.cc:492] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:25.003065 21229 ts_tablet_manager.cc:1403] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.000s
I20260709 12:16:25.003319 21231 tablet_bootstrap.cc:654] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.005470 21229 raft_consensus.cc:359] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.006124 21229 raft_consensus.cc:385] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.006373 21229 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.007009 21229 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.008940 21229 ts_tablet_manager.cc:1434] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:25.009819 21229 tablet_bootstrap.cc:492] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:25.011583 21231 tablet_bootstrap.cc:492] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:25.011647 21528 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.012074 21231 ts_tablet_manager.cc:1403] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 12:16:25.012120 21528 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.015162 21229 tablet_bootstrap.cc:654] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.015283 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:25.017210 21149 leader_election.cc:343] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.018785 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:25.020013 21151 leader_election.cc:343] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.020365 21151 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:25.021063 21574 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.021744 21528 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:25.023711 21227 tablet_bootstrap.cc:492] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:25.027592 21231 raft_consensus.cc:359] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.027973 21227 ts_tablet_manager.cc:1403] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.007s
I20260709 12:16:25.025987 21229 tablet_bootstrap.cc:492] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:25.028671 21229 ts_tablet_manager.cc:1403] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:16:25.028587 20931 catalog_manager.cc:5697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.030411 21227 raft_consensus.cc:359] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.031538 21231 raft_consensus.cc:385] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.035468 21227 raft_consensus.cc:385] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.035683 21231 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.035739 21227 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.036382 21227 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.036382 21231 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.034158 21229 raft_consensus.cc:359] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.038367 21227 ts_tablet_manager.cc:1434] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:16:25.038367 21231 ts_tablet_manager.cc:1434] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:16:25.038497 21229 raft_consensus.cc:385] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.039374 21229 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.039968 21229 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.040809 21227 tablet_bootstrap.cc:492] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:25.041775 21229 ts_tablet_manager.cc:1434] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 12:16:25.042447 21530 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.042605 21229 tablet_bootstrap.cc:492] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:25.041065 21076 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:25.044570 21256 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.045472 21530 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.048229 21227 tablet_bootstrap.cc:654] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:25.050370 21076 leader_election.cc:343] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.051139 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:25.052791 21229 tablet_bootstrap.cc:654] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.052727 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.053486 21231 tablet_bootstrap.cc:492] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:25.057789 21109 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:25.059727 21076 leader_election.cc:343] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.060113 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:25.060819 21031 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:25.061396 21256 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.059650 21574 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.062273 21256 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.063198 21076 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:25.063136 21574 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.053782 21530 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.064055 21483 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.064677 21256 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.065438 21574 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:25.068954 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:25.066768 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.065979 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:25.071870 21151 leader_election.cc:343] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.075717 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:25.079471 21149 leader_election.cc:343] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.079886 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:25.081738 21483 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.083331 21231 tablet_bootstrap.cc:654] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:25.087443 21076 leader_election.cc:343] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.092310 21227 tablet_bootstrap.cc:492] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:25.092705 21227 ts_tablet_manager.cc:1403] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.003s
W20260709 12:16:25.094451 21077 leader_election.cc:343] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.094888 21077 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:25.097378 21227 raft_consensus.cc:359] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.098037 21227 raft_consensus.cc:385] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.098299 21227 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.099258 21229 tablet_bootstrap.cc:492] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:25.098893 21227 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.093674 21528 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.099850 21229 ts_tablet_manager.cc:1403] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.006s
I20260709 12:16:25.103125 21564 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.104727 21229 raft_consensus.cc:359] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.106009 21229 raft_consensus.cc:385] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.106634 21229 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.107637 21229 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.108454 21453 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.111845 21227 ts_tablet_manager.cc:1434] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:16:25.112773 21227 tablet_bootstrap.cc:492] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:25.111152 21229 ts_tablet_manager.cc:1434] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 12:16:25.114317 21229 tablet_bootstrap.cc:492] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:25.136583 21227 tablet_bootstrap.cc:654] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.136356 21530 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.139531 21229 tablet_bootstrap.cc:654] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.147583 21227 tablet_bootstrap.cc:492] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:25.147987 21227 ts_tablet_manager.cc:1403] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:16:25.149523 21229 tablet_bootstrap.cc:492] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:25.149993 21229 ts_tablet_manager.cc:1403] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.003s
I20260709 12:16:25.150262 21227 raft_consensus.cc:359] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.150890 21227 raft_consensus.cc:385] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.151161 21227 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.151759 21227 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.152607 21229 raft_consensus.cc:359] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.153267 21229 raft_consensus.cc:385] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.153565 21229 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.154049 21227 ts_tablet_manager.cc:1434] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:25.154206 21229 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.154829 21227 tablet_bootstrap.cc:492] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:25.156550 21229 ts_tablet_manager.cc:1434] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:16:25.157850 21229 tablet_bootstrap.cc:492] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:25.168296 21229 tablet_bootstrap.cc:654] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.169049 21231 tablet_bootstrap.cc:492] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:25.169394 21231 ts_tablet_manager.cc:1403] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.008s
I20260709 12:16:25.171058 21227 tablet_bootstrap.cc:654] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.183352 21483 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.188695 21483 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.190825 21231 raft_consensus.cc:359] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.191499 21231 raft_consensus.cc:385] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.191740 21231 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.192471 21231 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.192343 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.195722 21231 ts_tablet_manager.cc:1434] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:16:25.196633 21231 tablet_bootstrap.cc:492] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
W20260709 12:16:25.196705 21077 leader_election.cc:343] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.194443 21483 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.213698 21231 tablet_bootstrap.cc:654] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.216944 21229 tablet_bootstrap.cc:492] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:25.217386 21229 ts_tablet_manager.cc:1403] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.009s
I20260709 12:16:25.220058 21229 raft_consensus.cc:359] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.220700 21229 raft_consensus.cc:385] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.220963 21229 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.221585 21229 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.223555 21229 ts_tablet_manager.cc:1434] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:16:25.224503 21229 tablet_bootstrap.cc:492] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:25.225783 21227 tablet_bootstrap.cc:492] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:25.226197 21227 ts_tablet_manager.cc:1403] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.000s
I20260709 12:16:25.228612 21227 raft_consensus.cc:359] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.229219 21227 raft_consensus.cc:385] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.229467 21227 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.229892 21229 tablet_bootstrap.cc:654] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.230063 21227 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.231539 21227 ts_tablet_manager.cc:1434] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:16:25.232376 21227 tablet_bootstrap.cc:492] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:25.236927 21231 tablet_bootstrap.cc:492] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:25.237361 21231 ts_tablet_manager.cc:1403] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.001s
I20260709 12:16:25.238217 21574 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.240269 21231 raft_consensus.cc:359] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.241072 21231 raft_consensus.cc:385] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.241361 21231 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.242110 21231 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.246129 21482 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.246930 21231 ts_tablet_manager.cc:1434] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:25.246583 21482 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.247674 21227 tablet_bootstrap.cc:654] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.247795 21231 tablet_bootstrap.cc:492] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:25.248574 21229 tablet_bootstrap.cc:492] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:25.249091 21229 ts_tablet_manager.cc:1403] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.009s
I20260709 12:16:25.251510 21229 raft_consensus.cc:359] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.252147 21229 raft_consensus.cc:385] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.252388 21229 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.253913 21231 tablet_bootstrap.cc:654] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.262807 21229 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.264918 21229 ts_tablet_manager.cc:1434] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
I20260709 12:16:25.265796 21229 tablet_bootstrap.cc:492] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:25.270972 21229 tablet_bootstrap.cc:654] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.271580 21227 tablet_bootstrap.cc:492] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:25.272064 21227 ts_tablet_manager.cc:1403] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.001s
I20260709 12:16:25.274673 21227 raft_consensus.cc:359] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.275791 21227 raft_consensus.cc:385] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.276064 21227 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.276672 21227 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.279101 21227 ts_tablet_manager.cc:1434] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:25.279901 21227 tablet_bootstrap.cc:492] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:25.248558 21482 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.285794 21227 tablet_bootstrap.cc:654] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.298243 21227 tablet_bootstrap.cc:492] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:25.298640 21227 ts_tablet_manager.cc:1403] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.019s	user 0.002s	sys 0.006s
I20260709 12:16:25.301136 21227 raft_consensus.cc:359] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.301743 21227 raft_consensus.cc:385] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.341995 21227 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.343218 21227 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.343865 21229 tablet_bootstrap.cc:492] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:25.344601 21229 ts_tablet_manager.cc:1403] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.007s
I20260709 12:16:25.345520 21227 ts_tablet_manager.cc:1434] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 12:16:25.346442 21227 tablet_bootstrap.cc:492] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:25.347117 21229 raft_consensus.cc:359] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.347770 21229 raft_consensus.cc:385] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.348026 21229 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.364233 21586 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.364676 21586 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.368762 21231 tablet_bootstrap.cc:492] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:25.369225 21231 ts_tablet_manager.cc:1403] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.122s	user 0.004s	sys 0.024s
I20260709 12:16:25.385146 21586 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.478209 21229 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.479341 21577 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.493922 21577 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.540378 21607 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.540916 21607 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.543473 21607 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.544339 21607 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.544426 21606 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.544783 21607 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.545105 21606 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.547156 21607 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.547837 21606 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.557834 21610 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.558262 21610 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.561347 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:25.561939 21036 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:25.563472 21076 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:25.566561 21611 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.566988 21611 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.571226 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:25.571811 21036 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:25.572901 21608 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.573355 21608 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.578886 21611 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.579438 21611 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.579758 21611 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.580082 21611 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.583312 21610 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.585146 21231 raft_consensus.cc:359] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.585767 21231 raft_consensus.cc:385] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.585999 21231 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.586709 21231 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.589553 21231 ts_tablet_manager.cc:1434] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.220s	user 0.009s	sys 0.001s
I20260709 12:16:25.590911 21231 tablet_bootstrap.cc:492] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:25.593446 21453 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.595579 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.596197 21180 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:25.598932 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.603864 21608 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:25.607457 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.619331 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:25.620098 21533 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.610405 21611 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.610633 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.611641 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.610666 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.615947 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.620301 21231 tablet_bootstrap.cc:654] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.620445 21533 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.626381 21533 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.624266 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:16:25.630674 21002 leader_election.cc:343] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.625293 21109 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:25.632145 21607 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.632529 21607 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.632850 21607 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:25.625627 20999 leader_election.cc:343] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.625514 21111 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:25.625797 21180 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
W20260709 12:16:25.654314 20999 leader_election.cc:343] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.655944 20999 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:25.656047 21611 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.657011 21484 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.657361 21484 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.657671 21484 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.658991 21533 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.660951 21533 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.661563 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:25.662055 21607 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.662717 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.664309 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:25.664990 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:25.668581 21028 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:25.668777 21607 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.669301 21607 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.669613 21607 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.669929 21607 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.667987 21184 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:25.670181 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.670745 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:25.671185 21036 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.671317 21181 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.674974 21586 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.675406 21586 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.676175 21607 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.677387 21586 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.670723 21186 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:25.678130 21607 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.681377 21036 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:25.682407 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:25.683339 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:25.685022 21586 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.684844 21484 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.685415 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:25.685672 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.686013 21184 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.686213 21186 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:25.685416 21586 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.687187 21586 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.688366 21606 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.688696 21606 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.689002 21606 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.681377 21181 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:25.691867 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:25.694090 21184 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:25.695127 21574 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.695605 21574 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.696453 21483 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.696897 21483 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:25.697535 21574 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:25.697661 21483 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.698174 21484 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.698904 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:25.699438 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:25.700306 21231 tablet_bootstrap.cc:492] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:25.702015 21231 ts_tablet_manager.cc:1403] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.003s
I20260709 12:16:25.704732 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.704618 21231 raft_consensus.cc:359] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.700173 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:25.705341 21110 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:25.701486 21616 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:25.705487 21231 raft_consensus.cc:385] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.705883 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:25.706339 21231 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.705853 21616 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.707185 21606 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.707348 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:25.707162 21616 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.709839 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:25.710984 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:25.711473 21110 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.707432 21231 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.713269 21484 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.713708 21484 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:25.711858 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:25.714653 21180 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.715333 21231 ts_tablet_manager.cc:1434] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:16:25.712667 21229 ts_tablet_manager.cc:1434] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.368s	user 0.008s	sys 0.006s
I20260709 12:16:25.718050 21227 tablet_bootstrap.cc:654] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.718102 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:25.709909 21606 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.718914 21229 tablet_bootstrap.cc:492] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:25.719210 21606 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.719632 21606 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:16:25.711450 21002 leader_election.cc:343] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.720389 21606 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.717175 21110 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:25.723832 21484 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.722259 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.724822 21231 tablet_bootstrap.cc:492] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:25.717340 21616 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.729182 21229 tablet_bootstrap.cc:654] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.729233 21616 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.712548 21586 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.729182 21180 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:25.735584 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.736191 21183 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:25.738260 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:25.738734 21183 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.738672 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.740760 21182 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:25.731030 21586 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.742960 21453 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.744141 21453 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.745078 21183 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:25.746068 21453 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.749782 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:25.751938 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.753500 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.755661 21586 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.757685 21586 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:25.759728 21574 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.759861 21586 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.759176 21231 tablet_bootstrap.cc:654] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.762785 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:25.763584 21178 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:25.765228 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:25.765249 21577 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.765766 21183 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.768131 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:25.768918 21031 raft_consensus.cc:2393] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:25.771207 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:25.771739 21178 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.777822 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:25.782469 21183 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:25.785492 21227 tablet_bootstrap.cc:492] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:25.785956 21227 ts_tablet_manager.cc:1403] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.440s	user 0.012s	sys 0.000s
I20260709 12:16:25.786549 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:25.788357 21227 raft_consensus.cc:359] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.789000 21227 raft_consensus.cc:385] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.789260 21227 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.789537 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.789865 21227 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.792299 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:25.793906 21183 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:25.796557 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.797133 21177 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:25.803887 21607 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.804432 21607 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:25.805145 21529 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.805229 21607 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.807228 21533 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.809172 21231 tablet_bootstrap.cc:492] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:25.812322 21178 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:25.816516 21231 ts_tablet_manager.cc:1403] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.092s	user 0.009s	sys 0.001s
I20260709 12:16:25.816416 21614 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.819691 21614 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:25.818638 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 60427.6us
I20260709 12:16:25.821415 21077 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:16:25.822091 21149 leader_election.cc:343] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.822815 21453 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:16:25.822978 21149 leader_election.cc:343] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.824862 21227 ts_tablet_manager.cc:1434] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:16:25.825790 21227 tablet_bootstrap.cc:492] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:25.826287 21614 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.827680 21077 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:25.829051 21530 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.829406 21530 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.829746 21530 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.819687 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:16:25.837388 21151 leader_election.cc:343] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.857932 21151 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:25.861150 21227 tablet_bootstrap.cc:654] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:25.862607 21151 leader_election.cc:343] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.863078 21151 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:25.859561 21606 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.862058 21586 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.861722 21574 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.877090 21229 tablet_bootstrap.cc:492] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:25.877642 21229 ts_tablet_manager.cc:1403] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.004s
I20260709 12:16:25.869306 21626 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:25.890553 20982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:25.873229 21606 raft_consensus.cc:697] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:25.875262 21586 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.905902 21606 consensus_queue.cc:237] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.907192 21231 raft_consensus.cc:359] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.907927 21231 raft_consensus.cc:385] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.908216 21231 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.927350 21231 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.932379 21231 ts_tablet_manager.cc:1434] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.001s
W20260709 12:16:25.944039 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 223563us
I20260709 12:16:25.953053 21076 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:25.957168 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:25.933444 21530 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.963449 21453 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.963867 21229 raft_consensus.cc:359] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.966099 21229 raft_consensus.cc:385] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.966434 21229 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.966254 21453 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.968787 21229 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:25.973223 21227 tablet_bootstrap.cc:492] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:25.973819 21227 ts_tablet_manager.cc:1403] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.148s	user 0.012s	sys 0.011s
I20260709 12:16:25.957532 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.960554 21611 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.959755 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.977062 21231 tablet_bootstrap.cc:492] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Bootstrap starting.
I20260709 12:16:25.964972 21586 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.988811 21229 ts_tablet_manager.cc:1434] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.111s	user 0.005s	sys 0.007s
I20260709 12:16:25.992797 21231 tablet_bootstrap.cc:654] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:25.995388 21620 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:16:25.996268 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:25.997044 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:25.997695 21105 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:26.010644 21453 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:25.982239 21183 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:26.014474 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:26.015163 21229 tablet_bootstrap.cc:492] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:26.015345 21177 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:26.016000 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:26.016491 21530 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.016685 21108 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.018975 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:26.019747 21177 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.017735 21077 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:26.022238 21611 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.022619 21611 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.024644 21227 raft_consensus.cc:359] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.025837 21227 raft_consensus.cc:385] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.026149 21227 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.025437 21611 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:26.028270 21633 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:16:26.031231 21227 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.030937 21484 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.051597 21227 ts_tablet_manager.cc:1434] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.002s
I20260709 12:16:26.053282 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:26.059568 21227 tablet_bootstrap.cc:492] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:26.053534 21484 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.117719 21484 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.119269 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:26.119941 21036 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:26.119985 21611 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.120580 21229 tablet_bootstrap.cc:654] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.122574 21611 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.130371 21177 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:26.145586 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:26.150214 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:26.150626 21626 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.162268 21626 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.164669 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:26.165360 21178 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:26.167352 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:26.168004 21186 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.168635 21626 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:26.170065 21229 tablet_bootstrap.cc:492] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:26.171384 21231 tablet_bootstrap.cc:492] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: No bootstrap required, opened a new log
I20260709 12:16:26.171284 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:26.171900 21231 ts_tablet_manager.cc:1403] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Time spent bootstrapping tablet: real 0.196s	user 0.019s	sys 0.006s
I20260709 12:16:26.172004 21109 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 0.
I20260709 12:16:26.174459 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:26.174547 21186 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:26.175957 21608 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.176307 21608 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.176638 21608 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.185515 21608 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.188107 21227 tablet_bootstrap.cc:654] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.154060 21108 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:26.186543 21640 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.188580 20931 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.189116 21640 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.189859 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:26.190459 21028 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.190692 20931 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.192571 21231 raft_consensus.cc:359] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.192477 20931 catalog_manager.cc:5697] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.193217 21231 raft_consensus.cc:385] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.192502 21640 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.194378 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:26.195634 21108 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.196388 21229 ts_tablet_manager.cc:1403] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.181s	user 0.007s	sys 0.006s
I20260709 12:16:26.199054 21231 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.194885 21608 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:26.199896 21231 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.200512 21640 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.204908 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:26.205633 21177 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:26.202036 21231 ts_tablet_manager.cc:1434] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:16:26.201964 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:26.208638 21227 tablet_bootstrap.cc:492] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:26.208853 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:26.209136 21227 ts_tablet_manager.cc:1403] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.150s	user 0.014s	sys 0.000s
I20260709 12:16:26.209797 21577 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.210112 21484 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.210170 21577 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.210600 21484 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.211036 21484 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.211225 21577 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.211840 21227 raft_consensus.cc:359] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.212517 21227 raft_consensus.cc:385] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.212767 21227 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.219424 21484 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.223466 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:26.223382 21227 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.224170 21177 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.221030 21577 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.230155 21577 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.227174 21484 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.231853 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:26.235898 21182 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:26.234586 21108 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:26.237505 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:26.237655 21028 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:26.238418 21608 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.199064 21229 raft_consensus.cc:359] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.234344 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:26.239516 21574 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.239930 21608 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:26.240095 21227 ts_tablet_manager.cc:1434] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:16:26.240068 21574 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.241279 21227 tablet_bootstrap.cc:492] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:26.241026 21608 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.241019 21177 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:26.242420 21574 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:26.243055 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:26.243852 21640 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.244325 21640 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:26.244779 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:26.245478 21640 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.251258 21108 raft_consensus.cc:2393] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:26.247185 21035 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:16:26.204973 20999 leader_election.cc:343] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:26.254669 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 49720.3us
W20260709 12:16:26.256973 20999 leader_election.cc:343] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.248622 21229 raft_consensus.cc:385] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.248847 21077 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:26.259507 21077 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:26.260977 21229 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.261538 21483 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.262605 20999 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:26.263357 21533 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.263918 21533 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:26.264163 21227 tablet_bootstrap.cc:654] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:26.264462 20999 leader_election.cc:343] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.264611 21484 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.265166 21484 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:16:26.265321 20999 leader_election.cc:343] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.266204 20999 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:26.266551 21229 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.265766 21483 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:26.271759 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:26.277479 21229 ts_tablet_manager.cc:1434] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.081s	user 0.003s	sys 0.003s
I20260709 12:16:26.269469 21577 raft_consensus.cc:2764] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:16:26.287078 21229 tablet_bootstrap.cc:492] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:26.276218 21482 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.280932 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:26.268361 21483 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.296247 21533 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:26.298110 21076 consensus_peers.cc:597] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:26.299163 21484 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:26.301646 21076 leader_election.cc:343] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.298632 21640 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:26.305625 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:26.291733 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:26.297122 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:26.292760 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:26.310467 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:26.311309 21110 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.316833 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:26.310032 21528 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.308895 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:26.312121 21619 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.315390 21111 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:26.324476 20999 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:26.323909 21106 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 1: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:26.323879 21028 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 1: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:26.338709 21619 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.350656 21611 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.351804 21619 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:26.364972 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 91638.2us
W20260709 12:16:26.369168 20999 consensus_peers.cc:597] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:26.373456 21528 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:26.388289 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 70390.7us
W20260709 12:16:26.389652 21076 leader_election.cc:343] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.383168 21640 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:16:26.387856 21533 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.088s
I20260709 12:16:26.491024 21619 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.500192 21229 tablet_bootstrap.cc:654] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.501926 21227 tablet_bootstrap.cc:492] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:26.505960 21227 ts_tablet_manager.cc:1403] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.265s	user 0.025s	sys 0.027s
I20260709 12:16:26.521464 21641 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.522034 21641 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.524084 21641 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.524735 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:26.534983 21660 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:26.535158 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf640 after lost signal to thread 19891
I20260709 12:16:26.535596 21660 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.537920 21660 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.540148 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:26.536120 21057 debug-util.cc:398] Leaking SignalData structure 0x7b080011e340 after lost signal to thread 20968
W20260709 12:16:26.541481 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800223260 after lost signal to thread 21060
W20260709 12:16:26.542414 21057 debug-util.cc:398] Leaking SignalData structure 0x7b080023ee00 after lost signal to thread 21136
W20260709 12:16:26.544066 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800291e20 after lost signal to thread 21211
W20260709 12:16:26.544662 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08002921c0 after lost signal to thread 21527
W20260709 12:16:26.554455 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800292140 after lost signal to thread 21559
I20260709 12:16:26.557736 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:26.558676 21184 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:26.566898 21177 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:26.577733 21227 raft_consensus.cc:359] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.578354 21227 raft_consensus.cc:385] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.578617 21227 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.579201 21227 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.579222 21002 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:16:26.572193 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800292340 after lost signal to thread 21579
I20260709 12:16:26.583494 21484 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.584033 21484 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.584427 21484 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:26.583420 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45576.8us
I20260709 12:16:26.585917 21529 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:26.584918 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08002923a0 after lost signal to thread 21582
I20260709 12:16:26.587167 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:26.591081 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800292400 after lost signal to thread 21587
I20260709 12:16:26.582993 21482 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:16:26.596413 21105 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 0.
I20260709 12:16:26.600117 21076 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:26.605341 21655 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.610005 21227 ts_tablet_manager.cc:1434] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.000s
I20260709 12:16:26.615418 21105 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.629776 21104 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:26.633296 21362 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.634373 21484 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.642071 21229 tablet_bootstrap.cc:492] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:26.642552 21229 ts_tablet_manager.cc:1403] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.356s	user 0.009s	sys 0.031s
I20260709 12:16:26.638262 20930 catalog_manager.cc:5697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.648304 21227 tablet_bootstrap.cc:492] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:26.650270 21229 raft_consensus.cc:359] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.650930 21229 raft_consensus.cc:385] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.651180 21229 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.667171 21229 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.692853 21227 tablet_bootstrap.cc:654] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.705621 21229 ts_tablet_manager.cc:1434] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:16:26.706704 21229 tablet_bootstrap.cc:492] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
W20260709 12:16:26.714414 21670 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:16:26.723242 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:26.727391 21103 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.733026 21577 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:26.741122 21484 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.743613 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:26.744231 21184 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.750597 21103 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:26.751363 21184 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:26.752410 21002 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:26.753284 21484 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.757823 20930 catalog_manager.cc:5697] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.757692 21484 raft_consensus.cc:697] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:26.762158 21484 consensus_queue.cc:237] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.763042 21227 tablet_bootstrap.cc:492] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:26.774266 21227 ts_tablet_manager.cc:1403] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.010s
I20260709 12:16:26.777093 21227 raft_consensus.cc:359] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.777791 21227 raft_consensus.cc:385] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.778079 21227 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.790983 21577 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.778792 21227 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.795189 21611 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.795641 21227 ts_tablet_manager.cc:1434] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:16:26.796644 21227 tablet_bootstrap.cc:492] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Bootstrap starting.
I20260709 12:16:26.795676 21611 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.767133 21229 tablet_bootstrap.cc:654] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.760871 20930 catalog_manager.cc:5697] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.799283 20930 catalog_manager.cc:5697] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 2, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.801187 20930 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.802045 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:26.805878 21611 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:26.808169 21528 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.816773 21609 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.817356 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:26.818760 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:26.819826 21614 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.819955 21227 tablet_bootstrap.cc:654] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.820996 21036 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.818722 21641 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:16:26.825608 20931 catalog_manager.cc:5697] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.828722 21614 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.845676 21105 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.848884 20934 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.851365 20934 catalog_manager.cc:5697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.855986 21641 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.866973 21614 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.876416 21229 tablet_bootstrap.cc:492] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:26.876941 21229 ts_tablet_manager.cc:1403] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.170s	user 0.009s	sys 0.000s
I20260709 12:16:26.877660 21641 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.885224 21614 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.889638 21105 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.892441 21229 raft_consensus.cc:359] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:26.893160 21229 raft_consensus.cc:385] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.893412 21229 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.894048 21229 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:26.993551 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 96795.8us
I20260709 12:16:27.000066 21227 tablet_bootstrap.cc:492] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: No bootstrap required, opened a new log
I20260709 12:16:27.000636 21227 ts_tablet_manager.cc:1403] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent bootstrapping tablet: real 0.204s	user 0.010s	sys 0.002s
I20260709 12:16:27.009982 21229 ts_tablet_manager.cc:1434] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.001s
I20260709 12:16:27.010964 21229 tablet_bootstrap.cc:492] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Bootstrap starting.
I20260709 12:16:27.013669 21453 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.018524 21227 raft_consensus.cc:359] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:27.020709 21227 raft_consensus.cc:385] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.020963 21227 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.021553 21227 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:27.035007 21227 ts_tablet_manager.cc:1434] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:16:27.060004 21229 tablet_bootstrap.cc:654] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:27.064020 21484 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:27.069514 21484 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:27.076232 21484 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:27.076732 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:27.079413 20982 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:27.080062 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:27.081800 21002 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:27.083006 21484 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:27.093073 20931 catalog_manager.cc:5697] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.117749 21229 tablet_bootstrap.cc:492] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: No bootstrap required, opened a new log
I20260709 12:16:27.118275 21229 ts_tablet_manager.cc:1403] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent bootstrapping tablet: real 0.108s	user 0.030s	sys 0.020s
I20260709 12:16:27.120911 21229 raft_consensus.cc:359] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:27.121592 21229 raft_consensus.cc:385] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:27.121887 21229 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Initialized, Role: FOLLOWER
I20260709 12:16:27.122565 21229 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:27.124898 21229 ts_tablet_manager.cc:1434] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:16:27.141496 21453 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.141994 21453 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:27.145274 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:27.145771 21036 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:27.146525 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:27.147680 21611 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:27.148115 21611 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.148432 21611 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.147710 21453 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:27.152849 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:27.153439 21184 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 0.
I20260709 12:16:27.155442 21611 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:27.159190 21611 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:27.159368 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:27.159859 21186 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.164017 21186 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:27.164922 21077 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:27.165628 21611 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:27.168871 21611 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:27.169667 21611 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:27.170928 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:27.171491 21035 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.206992 21036 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:27.214006 21035 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:27.238996 21577 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.243635 20930 catalog_manager.cc:5697] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.281128 21642 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.714861 21530 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.725395 21530 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:28.110832 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:28.147336 21699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:28.157346 21700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:28.166589 19888 server_base.cc:1061] running on GCE node
W20260709 12:16:28.167264 21703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:28.168553 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:28.168883 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:28.169157 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599388169136 us; error 0 us; skew 500 ppm
I20260709 12:16:28.170013 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:28.177088 19888 webserver.cc:533] Webserver started at http://127.19.108.4:38169/ using document root <none> and password file <none>
I20260709 12:16:28.177803 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:28.178133 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:28.178586 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:28.180181 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-3-root/instance:
uuid: "a1b891e53adc40a6a1ae813238321e93"
format_stamp: "Formatted at 2026-07-09 12:16:28 on dist-test-slave-0g1j"
I20260709 12:16:28.185472 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:28.190620 21708 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:28.191463 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:28.191829 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-3-root
uuid: "a1b891e53adc40a6a1ae813238321e93"
format_stamp: "Formatted at 2026-07-09 12:16:28 on dist-test-slave-0g1j"
I20260709 12:16:28.192175 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:28.214898 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:28.216701 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:28.218658 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:28.221879 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:28.222196 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:16:28.222550 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:28.222820 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:28.318331 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.4:35157
I20260709 12:16:28.318461 21771 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.4:35157 every 8 connection(s)
I20260709 12:16:28.345018 19888 auto_leader_rebalancer-test.cc:439] add a tserver: a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:28.359992 21772 heartbeater.cc:344] Connected to a master server at 127.19.108.62:42247
I20260709 12:16:28.360992 21772 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:28.361892 21772 heartbeater.cc:507] Master 127.19.108.62:42247 requested a full tablet report, sending...
I20260709 12:16:28.368045 20930 ts_manager.cc:194] Registered new tserver with Master: a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:28.369850 20930 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45550
I20260709 12:16:29.277184 21184 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:29.285840 21105 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:29.287590 21777 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:29.289383 21034 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:29.293643 21702 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:29.315353 21528 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
W20260709 12:16:29.324818 21150 consensus_peers.cc:597] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 861699cfca584c7b963879b6d12f2866. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.324535 21034 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.325178 21104 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.351217 20930 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.372814 21772 heartbeater.cc:499] Master 127.19.108.62:42247 was elected leader, sending a full tablet report...
I20260709 12:16:29.372020 21104 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:29.384630 21184 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:29.386300 21611 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:29.395480 21034 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:29.396849 21611 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:29.416081 21530 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.430238 21182 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
W20260709 12:16:29.434441 21075 consensus_peers.cc:597] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 92c5682e4a6f4eb6a687f13065840f5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.438419 21034 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.455592 20934 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.485844 21034 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:29.493489 21182 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:29.495270 21484 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:29.501068 21104 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:29.502569 21778 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:29.521159 21000 consensus_peers.cc:597] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6491ed44ddd40e88e8100b87d9eac5e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.523411 21484 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.529608 21105 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.531137 21186 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.552107 20931 catalog_manager.cc:5697] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.554299 21104 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:29.581414 21186 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:29.584721 21530 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:29.590492 21036 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:29.593191 21075 consensus_peers.cc:597] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2065378b47e42a29f6e7eb69f39f47c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.598255 21796 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:29.630091 21611 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.631922 21035 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.653100 20934 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.665138 21182 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:29.831409 21807 ts_tablet_manager.cc:933] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:29.837231 21807 tablet_copy_client.cc:323] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:29.853178 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet 92c5682e4a6f4eb6a687f13065840f5f from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:29.853885 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet 92c5682e4a6f4eb6a687f13065840f5f from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-92c5682e4a6f4eb6a687f13065840f5f
I20260709 12:16:29.862658 21121 tablet_copy_source_session.cc:215] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:29.867616 21807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c5682e4a6f4eb6a687f13065840f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.889401 21807 tablet_copy_client.cc:806] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:29.892355 21807 tablet_copy_client.cc:670] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:29.899498 21807 tablet_copy_client.cc:538] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:29.909719 21807 tablet_bootstrap.cc:492] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:29.926002 21810 ts_tablet_manager.cc:933] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:29.936748 21811 ts_tablet_manager.cc:933] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:16:29.969352 21810 tablet_copy_client.cc:323] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.3:36737
I20260709 12:16:29.973841 21811 tablet_copy_client.cc:323] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.1:42723
I20260709 12:16:29.981838 21807 tablet_bootstrap.cc:492] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:29.984658 21807 tablet_bootstrap.cc:492] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:29.985379 21807 ts_tablet_manager.cc:1403] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.076s	user 0.032s	sys 0.015s
I20260709 12:16:29.988687 21807 raft_consensus.cc:359] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:29.989594 21807 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:29.990329 21807 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:30.008095 21196 tablet_copy_service.cc:140] P 694635cc4a20455fbbec925e0a84a1ee: Received BeginTabletCopySession request for tablet 861699cfca584c7b963879b6d12f2866 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:48236)
I20260709 12:16:30.008719 21196 tablet_copy_service.cc:161] P 694635cc4a20455fbbec925e0a84a1ee: Beginning new tablet copy session on tablet 861699cfca584c7b963879b6d12f2866 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:48236: session id = a1b891e53adc40a6a1ae813238321e93-861699cfca584c7b963879b6d12f2866
I20260709 12:16:30.008157 21046 tablet_copy_service.cc:140] P 3ed9deaeb4014e9d87aeebbc6384f81f: Received BeginTabletCopySession request for tablet b6491ed44ddd40e88e8100b87d9eac5e from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:35652)
I20260709 12:16:30.116020 21046 tablet_copy_service.cc:161] P 3ed9deaeb4014e9d87aeebbc6384f81f: Beginning new tablet copy session on tablet b6491ed44ddd40e88e8100b87d9eac5e from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:35652: session id = a1b891e53adc40a6a1ae813238321e93-b6491ed44ddd40e88e8100b87d9eac5e
W20260709 12:16:30.116833 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 101455us
I20260709 12:16:30.131785 21818 ts_tablet_manager.cc:933] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:30.132076 21196 tablet_copy_source_session.cc:215] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:30.134805 21818 tablet_copy_client.cc:323] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:30.138593 21810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861699cfca584c7b963879b6d12f2866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:30.141763 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet f2065378b47e42a29f6e7eb69f39f47c from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:30.142338 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet f2065378b47e42a29f6e7eb69f39f47c from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-f2065378b47e42a29f6e7eb69f39f47c
I20260709 12:16:30.149755 21807 ts_tablet_manager.cc:1434] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.164s	user 0.012s	sys 0.000s
I20260709 12:16:30.150709 21121 tablet_copy_source_session.cc:215] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:30.163997 21818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2065378b47e42a29f6e7eb69f39f47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:30.166949 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-92c5682e4a6f4eb6a687f13065840f5f received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:30.167587 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-92c5682e4a6f4eb6a687f13065840f5f on tablet 92c5682e4a6f4eb6a687f13065840f5f with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:30.166730 21810 tablet_copy_client.cc:806] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:30.175711 21810 tablet_copy_client.cc:670] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:30.183971 21810 tablet_copy_client.cc:538] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:30.189574 21046 tablet_copy_source_session.cc:215] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:30.200125 21811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6491ed44ddd40e88e8100b87d9eac5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:30.210163 21818 tablet_copy_client.cc:806] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:30.211424 21818 tablet_copy_client.cc:670] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:30.216580 21810 tablet_bootstrap.cc:492] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:30.217882 21811 tablet_copy_client.cc:806] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:30.223196 21811 tablet_copy_client.cc:670] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:30.217963 21818 tablet_copy_client.cc:538] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:30.234656 21818 tablet_bootstrap.cc:492] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:30.235824 21811 tablet_copy_client.cc:538] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:30.243856 21811 tablet_bootstrap.cc:492] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:30.258409 21818 tablet_bootstrap.cc:492] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:30.259433 21818 tablet_bootstrap.cc:492] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:30.260569 21818 ts_tablet_manager.cc:1403] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.013s
I20260709 12:16:30.263423 21818 raft_consensus.cc:359] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:30.264272 21818 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:30.264940 21818 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:30.280596 21818 ts_tablet_manager.cc:1434] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:16:30.281255 21746 raft_consensus.cc:1217] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:30.290036 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-f2065378b47e42a29f6e7eb69f39f47c received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:30.290427 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-f2065378b47e42a29f6e7eb69f39f47c on tablet f2065378b47e42a29f6e7eb69f39f47c with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:30.303344 21811 tablet_bootstrap.cc:492] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:30.304329 21811 tablet_bootstrap.cc:492] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:30.305038 21811 ts_tablet_manager.cc:1403] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.011s
I20260709 12:16:30.307371 21810 tablet_bootstrap.cc:492] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:30.308327 21810 tablet_bootstrap.cc:492] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:30.309010 21810 ts_tablet_manager.cc:1403] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.015s
I20260709 12:16:30.308660 21811 raft_consensus.cc:359] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:30.309491 21811 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:30.310133 21811 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:30.313524 21811 ts_tablet_manager.cc:1434] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:16:30.318109 21810 raft_consensus.cc:359] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:30.319100 21810 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:30.319798 21810 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:30.322299 21810 ts_tablet_manager.cc:1434] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.004s
I20260709 12:16:30.326184 21046 tablet_copy_service.cc:342] P 3ed9deaeb4014e9d87aeebbc6384f81f: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-b6491ed44ddd40e88e8100b87d9eac5e received from {username='slave'} at 127.0.0.1:35652
I20260709 12:16:30.326589 21046 tablet_copy_service.cc:434] P 3ed9deaeb4014e9d87aeebbc6384f81f: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-b6491ed44ddd40e88e8100b87d9eac5e on tablet b6491ed44ddd40e88e8100b87d9eac5e with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:30.328823 21196 tablet_copy_service.cc:342] P 694635cc4a20455fbbec925e0a84a1ee: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-861699cfca584c7b963879b6d12f2866 received from {username='slave'} at 127.0.0.1:48236
I20260709 12:16:30.329214 21196 tablet_copy_service.cc:434] P 694635cc4a20455fbbec925e0a84a1ee: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-861699cfca584c7b963879b6d12f2866 on tablet 861699cfca584c7b963879b6d12f2866 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:30.333529 21746 raft_consensus.cc:1217] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:30.501359 21746 raft_consensus.cc:1217] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:30.634251 21746 raft_consensus.cc:1217] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:30.755226 21530 raft_consensus.cc:1064] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:30.764914 21530 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:30.779165 21182 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:30.781626 21746 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:30.782279 21611 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:30.783511 21796 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:30.796633 21036 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:30.806717 21797 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:30.827873 21830 raft_consensus.cc:1064] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:30.832973 21830 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:30.845798 21611 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:30.859155 21746 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:30.860929 21036 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:30.870368 21778 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:30.877308 21184 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:30.878695 21484 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:30.888243 20930 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.899641 21747 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:30.943320 21104 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:30.947418 21484 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:30.962121 21830 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:30.967541 21182 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:30.979341 21528 raft_consensus.cc:1064] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:30.981573 21528 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:30.982230 21186 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.001955 21747 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:16:31.069761 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 74237.2us
I20260709 12:16:31.079376 21744 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:31.081329 21786 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:31.085865 21611 raft_consensus.cc:1064] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:31.085750 21105 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.088982 21611 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:31.095815 21104 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:31.096434 21035 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:31.124873 21825 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:16:31.131474 21528 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:16:31.146394 21744 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:31.148110 21806 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:31.152695 21182 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:31.154798 21530 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:31.157614 21036 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:31.159202 21530 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:31.180961 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 83613.3us
I20260709 12:16:31.220329 20933 catalog_manager.cc:5697] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.227103 21611 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.237746 21034 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.243865 21744 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.249948 21036 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:31.255362 21104 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:31.286597 21744 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:31.286960 21032 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:31.288130 21796 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:31.289080 21744 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:31.290735 21778 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:31.293383 21182 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:31.296627 21806 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:31.298218 21484 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.299381 21806 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.305358 21778 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:31.305235 21746 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.309325 21528 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.316453 20920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b6491ed44ddd40e88e8100b87d9eac5e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:31.306128 21747 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.321947 21744 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.317301 21108 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.331523 20934 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.312124 20933 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.341305 21184 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.348176 21035 raft_consensus.cc:2955] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.352840 21182 raft_consensus.cc:2955] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.360179 21034 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.385859 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 92c5682e4a6f4eb6a687f13065840f5f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:31.397691 20931 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.404078 20931 catalog_manager.cc:5697] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.413440 21108 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:31.428926 21747 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:31.430878 21806 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:31.438812 21184 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:31.439563 21036 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:31.442514 21854 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:31.442214 21796 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.444322 21747 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.447700 21034 raft_consensus.cc:2955] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.469609 21747 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:31.471236 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2065378b47e42a29f6e7eb69f39f47c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:31.479840 21528 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:31.489714 21170 tablet_service.cc:1558] Processing DeleteTablet for tablet 92c5682e4a6f4eb6a687f13065840f5f with delete_type TABLET_DATA_TOMBSTONED (TS 694635cc4a20455fbbec925e0a84a1ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51888
I20260709 12:16:31.496229 21108 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:31.495486 21825 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.497117 20930 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.498694 21843 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:31.508518 21747 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.511317 21095 tablet_service.cc:1558] Processing DeleteTablet for tablet b6491ed44ddd40e88e8100b87d9eac5e with delete_type TABLET_DATA_TOMBSTONED (TS a62242aa80cd4affa87dc4a3cf6b64ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56396
I20260709 12:16:31.521862 21167 tablet_service.cc:1558] Processing DeleteTablet for tablet f2065378b47e42a29f6e7eb69f39f47c with delete_type TABLET_DATA_TOMBSTONED (TS 694635cc4a20455fbbec925e0a84a1ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51888
I20260709 12:16:31.524919 21108 raft_consensus.cc:2955] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.576225 20932 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:31.581473 21855 tablet_replica.cc:333] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:16:31.585827 21856 tablet_replica.cc:333] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:16:31.586540 20921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 861699cfca584c7b963879b6d12f2866 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:31.595347 21856 raft_consensus.cc:2243] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.596411 21856 raft_consensus.cc:2272] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.597173 21855 raft_consensus.cc:2243] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.597982 21855 raft_consensus.cc:2272] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.601257 21856 ts_tablet_manager.cc:1916] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:31.602110 21023 tablet_service.cc:1558] Processing DeleteTablet for tablet 861699cfca584c7b963879b6d12f2866 with delete_type TABLET_DATA_TOMBSTONED (TS 3ed9deaeb4014e9d87aeebbc6384f81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59982
I20260709 12:16:31.616019 21856 ts_tablet_manager.cc:1929] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:31.616645 21856 log.cc:1199] T b6491ed44ddd40e88e8100b87d9eac5e P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/wals/b6491ed44ddd40e88e8100b87d9eac5e
I20260709 12:16:31.618301 20918 catalog_manager.cc:5028] TS a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): tablet b6491ed44ddd40e88e8100b87d9eac5e (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:31.624349 21855 ts_tablet_manager.cc:1916] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:31.625690 21857 tablet_replica.cc:333] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:16:31.627292 21857 raft_consensus.cc:2243] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.627879 21857 raft_consensus.cc:2272] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.630800 21857 ts_tablet_manager.cc:1916] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:31.645136 21857 ts_tablet_manager.cc:1929] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:31.645610 21857 log.cc:1199] T 861699cfca584c7b963879b6d12f2866 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/wals/861699cfca584c7b963879b6d12f2866
I20260709 12:16:31.647234 20920 catalog_manager.cc:5028] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): tablet 861699cfca584c7b963879b6d12f2866 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:31.655851 21855 ts_tablet_manager.cc:1929] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:31.656365 21855 log.cc:1199] T 92c5682e4a6f4eb6a687f13065840f5f P 694635cc4a20455fbbec925e0a84a1ee: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/wals/92c5682e4a6f4eb6a687f13065840f5f
I20260709 12:16:31.657860 20921 catalog_manager.cc:5028] TS 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): tablet 92c5682e4a6f4eb6a687f13065840f5f (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:31.658016 21855 tablet_replica.cc:333] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:16:31.659403 21855 raft_consensus.cc:2243] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.660079 21855 raft_consensus.cc:2272] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.663434 21855 ts_tablet_manager.cc:1916] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:31.677613 21855 ts_tablet_manager.cc:1929] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:31.678066 21855 log.cc:1199] T f2065378b47e42a29f6e7eb69f39f47c P 694635cc4a20455fbbec925e0a84a1ee: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/wals/f2065378b47e42a29f6e7eb69f39f47c
I20260709 12:16:31.679397 20921 catalog_manager.cc:5028] TS 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): tablet f2065378b47e42a29f6e7eb69f39f47c (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:32.673799 21184 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:32.680183 21103 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:32.680938 21036 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:32.681192 21150 consensus_peers.cc:597] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11c217b90c5a4022be2281765e591c5a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:32.681924 21528 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:32.682673 21843 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:32.704429 21843 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.705801 21103 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.750712 20934 catalog_manager.cc:5697] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.757916 21186 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:32.761942 21036 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
W20260709 12:16:32.780669 21150 consensus_peers.cc:597] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81531ae383b1419ea24efbb10c3d2949. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:32.783913 21108 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:32.785619 21528 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:32.794773 21036 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:32.804945 21528 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:32.812625 21103 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.810755 21528 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.831440 21034 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.845264 21103 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:32.852599 20930 catalog_manager.cc:5697] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.872444 21184 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:32.872509 21075 consensus_peers.cc:597] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a039020e2b434452bdc6cf055df7cc8a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:32.872444 21034 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:32.873901 21806 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:32.878511 21806 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:32.893222 21853 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.899019 21034 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.907981 21103 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:32.915661 20932 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
W20260709 12:16:32.922914 21075 consensus_peers.cc:597] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8fa56a6078064852ac53dd912136460b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:32.924767 21035 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:32.926187 21875 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:32.928099 21184 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:32.930238 21184 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.941942 21853 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.948643 21806 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:32.953589 21035 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:32.964372 20934 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:32.977073 21184 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:33.183805 21879 ts_tablet_manager.cc:933] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:33.185914 21879 tablet_copy_client.cc:323] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.3:36737
I20260709 12:16:33.187611 21196 tablet_copy_service.cc:140] P 694635cc4a20455fbbec925e0a84a1ee: Received BeginTabletCopySession request for tablet 11c217b90c5a4022be2281765e591c5a from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:48236)
I20260709 12:16:33.188151 21196 tablet_copy_service.cc:161] P 694635cc4a20455fbbec925e0a84a1ee: Beginning new tablet copy session on tablet 11c217b90c5a4022be2281765e591c5a from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:48236: session id = a1b891e53adc40a6a1ae813238321e93-11c217b90c5a4022be2281765e591c5a
I20260709 12:16:33.201412 21881 ts_tablet_manager.cc:933] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:33.205596 21196 tablet_copy_source_session.cc:215] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:33.208990 21879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c217b90c5a4022be2281765e591c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:33.215626 21881 tablet_copy_client.cc:323] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.3:36737
I20260709 12:16:33.217398 21196 tablet_copy_service.cc:140] P 694635cc4a20455fbbec925e0a84a1ee: Received BeginTabletCopySession request for tablet 81531ae383b1419ea24efbb10c3d2949 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:48236)
I20260709 12:16:33.217969 21196 tablet_copy_service.cc:161] P 694635cc4a20455fbbec925e0a84a1ee: Beginning new tablet copy session on tablet 81531ae383b1419ea24efbb10c3d2949 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:48236: session id = a1b891e53adc40a6a1ae813238321e93-81531ae383b1419ea24efbb10c3d2949
I20260709 12:16:33.226624 21196 tablet_copy_source_session.cc:215] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:33.236039 21881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81531ae383b1419ea24efbb10c3d2949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:33.243294 21879 tablet_copy_client.cc:806] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:33.243978 21879 tablet_copy_client.cc:670] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:33.247881 21879 tablet_copy_client.cc:538] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:33.274585 21879 tablet_bootstrap.cc:492] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:33.286684 21881 tablet_copy_client.cc:806] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:33.287339 21881 tablet_copy_client.cc:670] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:33.291117 21881 tablet_copy_client.cc:538] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:33.297027 21879 tablet_bootstrap.cc:492] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.297915 21879 tablet_bootstrap.cc:492] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:33.298563 21879 ts_tablet_manager.cc:1403] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.006s
I20260709 12:16:33.299286 21881 tablet_bootstrap.cc:492] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:33.301877 21879 raft_consensus.cc:359] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:33.302740 21879 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:33.303397 21879 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:33.326869 21881 tablet_bootstrap.cc:492] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.328101 21881 tablet_bootstrap.cc:492] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:33.328876 21881 ts_tablet_manager.cc:1403] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.004s
I20260709 12:16:33.332248 21881 raft_consensus.cc:359] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:33.333204 21881 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:33.333906 21881 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:33.343571 21881 ts_tablet_manager.cc:1434] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:16:33.349251 21196 tablet_copy_service.cc:342] P 694635cc4a20455fbbec925e0a84a1ee: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-81531ae383b1419ea24efbb10c3d2949 received from {username='slave'} at 127.0.0.1:48236
I20260709 12:16:33.349706 21196 tablet_copy_service.cc:434] P 694635cc4a20455fbbec925e0a84a1ee: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-81531ae383b1419ea24efbb10c3d2949 on tablet 81531ae383b1419ea24efbb10c3d2949 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:33.364145 21888 ts_tablet_manager.cc:933] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:33.395716 21879 ts_tablet_manager.cc:1434] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.097s	user 0.026s	sys 0.050s
I20260709 12:16:33.506450 21888 tablet_copy_client.cc:323] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:33.533245 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet a039020e2b434452bdc6cf055df7cc8a from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:33.533802 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet a039020e2b434452bdc6cf055df7cc8a from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-a039020e2b434452bdc6cf055df7cc8a
I20260709 12:16:33.543596 21121 tablet_copy_source_session.cc:215] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:33.547381 21888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a039020e2b434452bdc6cf055df7cc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:33.564853 21888 tablet_copy_client.cc:806] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:33.565433 21888 tablet_copy_client.cc:670] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:33.569168 21888 tablet_copy_client.cc:538] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:33.585477 21888 tablet_bootstrap.cc:492] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:33.590975 21196 tablet_copy_service.cc:342] P 694635cc4a20455fbbec925e0a84a1ee: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-11c217b90c5a4022be2281765e591c5a received from {username='slave'} at 127.0.0.1:48236
I20260709 12:16:33.591456 21196 tablet_copy_service.cc:434] P 694635cc4a20455fbbec925e0a84a1ee: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-11c217b90c5a4022be2281765e591c5a on tablet 11c217b90c5a4022be2281765e591c5a with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:33.615177 21888 tablet_bootstrap.cc:492] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.616999 21888 tablet_bootstrap.cc:492] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:33.624907 21888 ts_tablet_manager.cc:1403] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.003s
I20260709 12:16:33.628767 21888 raft_consensus.cc:359] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:33.633533 21888 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:33.634675 21888 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:33.638684 21888 ts_tablet_manager.cc:1434] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:16:33.652999 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-a039020e2b434452bdc6cf055df7cc8a received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:33.653479 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-a039020e2b434452bdc6cf055df7cc8a on tablet a039020e2b434452bdc6cf055df7cc8a with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:33.660424 21879 ts_tablet_manager.cc:933] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:33.663496 21879 tablet_copy_client.cc:323] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:33.665319 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet 8fa56a6078064852ac53dd912136460b from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:33.665844 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet 8fa56a6078064852ac53dd912136460b from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-8fa56a6078064852ac53dd912136460b
I20260709 12:16:33.675999 21121 tablet_copy_source_session.cc:215] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:16:33.677192 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 50851.3us
I20260709 12:16:33.680819 21879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa56a6078064852ac53dd912136460b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:33.708515 21746 raft_consensus.cc:1217] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:33.728789 21879 tablet_copy_client.cc:806] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:33.729424 21879 tablet_copy_client.cc:670] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:33.733760 21879 tablet_copy_client.cc:538] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:33.742570 21879 tablet_bootstrap.cc:492] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:33.754200 21746 raft_consensus.cc:1217] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:33.765901 21879 tablet_bootstrap.cc:492] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.766834 21879 tablet_bootstrap.cc:492] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:33.767496 21879 ts_tablet_manager.cc:1403] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 12:16:33.770190 21879 raft_consensus.cc:359] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:33.771106 21879 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:33.771785 21879 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:33.774183 21879 ts_tablet_manager.cc:1434] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:33.776135 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-8fa56a6078064852ac53dd912136460b received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:33.776553 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-8fa56a6078064852ac53dd912136460b on tablet 8fa56a6078064852ac53dd912136460b with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:33.958223 21746 raft_consensus.cc:1217] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:34.122560 21746 raft_consensus.cc:1217] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:34.177747 21897 raft_consensus.cc:1064] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:34.179610 21897 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:34.186057 21746 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.187618 21104 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.187976 21036 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.189602 21864 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.190374 21892 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.191234 21528 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.214459 21897 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.223415 21747 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.233726 21108 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.245267 20930 catalog_manager.cc:5697] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.251345 21032 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.267385 21528 raft_consensus.cc:1064] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:34.269621 21528 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:34.285051 21746 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.285609 21108 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.287202 21032 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.286993 21897 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.297225 21528 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.299162 21892 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.323067 21864 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.325152 21036 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.329044 21104 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.339047 21177 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:34.350291 21746 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.355938 21744 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:34.358029 21036 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:34.358458 20931 catalog_manager.cc:5697] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.365654 21864 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:34.368583 21528 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:34.368956 21893 raft_consensus.cc:1064] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:34.393564 21893 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:34.408098 21917 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.409888 21746 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.417291 21177 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:34.423657 20932 catalog_manager.cc:5697] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.424770 21104 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:34.426059 21897 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:34.432880 21746 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:34.432649 21528 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.434438 21108 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.436830 21892 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:34.437449 21036 raft_consensus.cc:2955] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.442333 21746 raft_consensus.cc:2955] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.447079 20921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 81531ae383b1419ea24efbb10c3d2949 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:34.457149 21744 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.458487 21896 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.463522 21095 tablet_service.cc:1558] Processing DeleteTablet for tablet 11c217b90c5a4022be2281765e591c5a with delete_type TABLET_DATA_TOMBSTONED (TS a62242aa80cd4affa87dc4a3cf6b64ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56396
I20260709 12:16:34.463917 20934 catalog_manager.cc:5697] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:34.472879 21036 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.474460 21893 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.475590 20921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11c217b90c5a4022be2281765e591c5a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:34.477546 21177 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.484869 21023 tablet_service.cc:1558] Processing DeleteTablet for tablet 81531ae383b1419ea24efbb10c3d2949 with delete_type TABLET_DATA_TOMBSTONED (TS 3ed9deaeb4014e9d87aeebbc6384f81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59982
I20260709 12:16:34.484766 21896 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.487274 21919 tablet_replica.cc:333] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:16:34.488364 21919 raft_consensus.cc:2243] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.489042 21919 raft_consensus.cc:2272] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.489135 21922 tablet_replica.cc:333] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:16:34.491730 21922 raft_consensus.cc:2243] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.493888 21922 raft_consensus.cc:2272] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.494179 21919 ts_tablet_manager.cc:1916] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:34.504360 21922 ts_tablet_manager.cc:1916] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:34.512233 21893 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.516201 21036 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.521302 21177 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.533124 20934 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.533531 21744 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.536624 21919 ts_tablet_manager.cc:1929] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:34.543206 21919 log.cc:1199] T 11c217b90c5a4022be2281765e591c5a P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/wals/11c217b90c5a4022be2281765e591c5a
I20260709 12:16:34.546657 20918 catalog_manager.cc:5028] TS a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): tablet 11c217b90c5a4022be2281765e591c5a (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:34.553141 21922 ts_tablet_manager.cc:1929] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:34.553611 21922 log.cc:1199] T 81531ae383b1419ea24efbb10c3d2949 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/wals/81531ae383b1419ea24efbb10c3d2949
I20260709 12:16:34.555068 20920 catalog_manager.cc:5028] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): tablet 81531ae383b1419ea24efbb10c3d2949 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:34.567533 21108 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:34.573094 21744 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:34.574661 21875 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:34.575033 21036 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:34.576399 21853 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:34.588097 21744 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.588291 21893 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.592768 21032 raft_consensus.cc:2955] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.607620 20934 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.611588 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a039020e2b434452bdc6cf055df7cc8a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:16:34.616796 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0000 after lost signal to thread 19891
W20260709 12:16:34.617753 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0a40 after lost signal to thread 20968
W20260709 12:16:34.618793 21768 debug-util.cc:398] Leaking SignalData structure 0x7b0800271b40 after lost signal to thread 21060
W20260709 12:16:34.621919 21768 debug-util.cc:398] Leaking SignalData structure 0x7b080026f880 after lost signal to thread 21136
W20260709 12:16:34.622882 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4700 after lost signal to thread 21211
W20260709 12:16:34.627507 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9780 after lost signal to thread 21771
I20260709 12:16:34.633533 21170 tablet_service.cc:1558] Processing DeleteTablet for tablet a039020e2b434452bdc6cf055df7cc8a with delete_type TABLET_DATA_TOMBSTONED (TS 694635cc4a20455fbbec925e0a84a1ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51888
I20260709 12:16:34.635206 21924 tablet_replica.cc:333] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:16:34.637396 21924 raft_consensus.cc:2243] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.638155 21924 raft_consensus.cc:2272] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.645463 21924 ts_tablet_manager.cc:1916] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:34.663362 21924 ts_tablet_manager.cc:1929] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:34.663875 21924 log.cc:1199] T a039020e2b434452bdc6cf055df7cc8a P 694635cc4a20455fbbec925e0a84a1ee: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/wals/a039020e2b434452bdc6cf055df7cc8a
I20260709 12:16:34.666527 20921 catalog_manager.cc:5028] TS 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): tablet a039020e2b434452bdc6cf055df7cc8a (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:34.733266 21891 raft_consensus.cc:1064] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:34.738538 21891 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:34.763468 21744 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.767481 21893 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.777915 21186 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.780591 21891 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.790249 21036 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:34.794694 21893 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:34.825505 21893 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.831775 21186 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.855986 21744 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.862509 20932 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.873090 21036 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.889253 21108 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:34.904134 21744 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:34.904788 21186 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:34.905598 21893 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:34.906473 21896 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:34.913642 21896 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.916323 21746 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.921525 21186 raft_consensus.cc:2955] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.934343 20932 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:34.938689 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8fa56a6078064852ac53dd912136460b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:34.957593 21023 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa56a6078064852ac53dd912136460b with delete_type TABLET_DATA_TOMBSTONED (TS 3ed9deaeb4014e9d87aeebbc6384f81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59982
I20260709 12:16:34.958461 21922 tablet_replica.cc:333] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:16:34.967536 21922 raft_consensus.cc:2243] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:34.968242 21922 raft_consensus.cc:2272] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:34.971618 21922 ts_tablet_manager.cc:1916] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:34.983628 21922 ts_tablet_manager.cc:1929] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:34.984097 21922 log.cc:1199] T 8fa56a6078064852ac53dd912136460b P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/wals/8fa56a6078064852ac53dd912136460b
I20260709 12:16:34.986043 20920 catalog_manager.cc:5028] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): tablet 8fa56a6078064852ac53dd912136460b (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:36.032792 21177 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
W20260709 12:16:36.039253 21150 consensus_peers.cc:597] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cff4bd391fcd4a0e98a7359c8267ab60. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:36.042371 21108 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:36.042402 21035 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:36.044399 21897 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.045876 21528 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.057729 21528 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.060750 21036 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.066133 21104 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.076160 21108 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:36.074692 20932 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.084452 21177 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:36.085781 21891 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:36.086738 21075 consensus_peers.cc:597] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 097c05b85fe14dc38775d8347e0478fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:36.088300 21035 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:36.089709 21853 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.114341 21853 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.117602 21036 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.118873 21185 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.209781 21036 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:36.224080 20934 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.230484 21185 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:36.231647 21000 consensus_peers.cc:597] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2794b9a38ad54e088a7b3f884de8ef3d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:36.231933 21901 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.233203 21104 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:36.237933 21901 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.249899 21901 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.252313 21108 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.252128 21185 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.267797 20934 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.269518 21108 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
W20260709 12:16:36.287928 21075 consensus_peers.cc:597] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2afb5fda50b04769b30c8dfc6a46563e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:36.289809 21036 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:36.291060 21940 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.297012 21185 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:36.302137 21893 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.324051 21940 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.326417 21185 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.327093 21032 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:36.341845 20934 catalog_manager.cc:5697] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.627643 21954 ts_tablet_manager.cc:933] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:36.641520 21954 tablet_copy_client.cc:323] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:36.654742 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet 097c05b85fe14dc38775d8347e0478fe from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:36.655325 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet 097c05b85fe14dc38775d8347e0478fe from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-097c05b85fe14dc38775d8347e0478fe
I20260709 12:16:36.668121 21121 tablet_copy_source_session.cc:215] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:36.673548 21954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097c05b85fe14dc38775d8347e0478fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.694445 21957 ts_tablet_manager.cc:933] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:36.698592 21954 tablet_copy_client.cc:806] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:36.701126 21956 ts_tablet_manager.cc:933] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:16:36.701141 21954 tablet_copy_client.cc:670] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:36.714649 21956 tablet_copy_client.cc:323] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.1:42723
I20260709 12:16:36.719267 21046 tablet_copy_service.cc:140] P 3ed9deaeb4014e9d87aeebbc6384f81f: Received BeginTabletCopySession request for tablet 2794b9a38ad54e088a7b3f884de8ef3d from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:35652)
I20260709 12:16:36.719800 21046 tablet_copy_service.cc:161] P 3ed9deaeb4014e9d87aeebbc6384f81f: Beginning new tablet copy session on tablet 2794b9a38ad54e088a7b3f884de8ef3d from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:35652: session id = a1b891e53adc40a6a1ae813238321e93-2794b9a38ad54e088a7b3f884de8ef3d
I20260709 12:16:36.726636 21954 tablet_copy_client.cc:538] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:36.737277 21954 tablet_bootstrap.cc:492] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:36.754297 21046 tablet_copy_source_session.cc:215] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:36.757455 21957 tablet_copy_client.cc:323] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.3:36737
I20260709 12:16:36.757820 21956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2794b9a38ad54e088a7b3f884de8ef3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.759668 21196 tablet_copy_service.cc:140] P 694635cc4a20455fbbec925e0a84a1ee: Received BeginTabletCopySession request for tablet cff4bd391fcd4a0e98a7359c8267ab60 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:48236)
I20260709 12:16:36.760177 21196 tablet_copy_service.cc:161] P 694635cc4a20455fbbec925e0a84a1ee: Beginning new tablet copy session on tablet cff4bd391fcd4a0e98a7359c8267ab60 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:48236: session id = a1b891e53adc40a6a1ae813238321e93-cff4bd391fcd4a0e98a7359c8267ab60
I20260709 12:16:36.767370 21196 tablet_copy_source_session.cc:215] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:36.770833 21957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff4bd391fcd4a0e98a7359c8267ab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.781771 21956 tablet_copy_client.cc:806] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:36.782462 21956 tablet_copy_client.cc:670] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:36.788997 21956 tablet_copy_client.cc:538] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:36.804765 21954 tablet_bootstrap.cc:492] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.808899 21956 tablet_bootstrap.cc:492] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:36.811678 21954 tablet_bootstrap.cc:492] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:36.815393 21957 tablet_copy_client.cc:806] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:36.816015 21957 tablet_copy_client.cc:670] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:36.821257 21957 tablet_copy_client.cc:538] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:36.840143 21957 tablet_bootstrap.cc:492] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:36.812849 21954 ts_tablet_manager.cc:1403] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.005s
I20260709 12:16:36.857669 21954 raft_consensus.cc:359] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:36.858650 21954 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:36.859387 21954 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:36.866559 21956 tablet_bootstrap.cc:492] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.867576 21956 tablet_bootstrap.cc:492] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:36.868227 21956 ts_tablet_manager.cc:1403] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.000s
I20260709 12:16:36.871140 21956 raft_consensus.cc:359] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:36.871940 21956 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:36.872534 21956 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:36.898377 21957 tablet_bootstrap.cc:492] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.901290 21957 tablet_bootstrap.cc:492] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:36.901991 21957 ts_tablet_manager.cc:1403] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.007s
I20260709 12:16:36.904845 21957 raft_consensus.cc:359] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:36.905725 21957 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:36.906339 21957 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:36.908373 21957 ts_tablet_manager.cc:1434] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:36.909996 21196 tablet_copy_service.cc:342] P 694635cc4a20455fbbec925e0a84a1ee: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-cff4bd391fcd4a0e98a7359c8267ab60 received from {username='slave'} at 127.0.0.1:48236
I20260709 12:16:36.910379 21196 tablet_copy_service.cc:434] P 694635cc4a20455fbbec925e0a84a1ee: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-cff4bd391fcd4a0e98a7359c8267ab60 on tablet cff4bd391fcd4a0e98a7359c8267ab60 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:36.916033 21957 ts_tablet_manager.cc:933] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:36.923662 21956 ts_tablet_manager.cc:1434] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.004s
I20260709 12:16:36.925480 21046 tablet_copy_service.cc:342] P 3ed9deaeb4014e9d87aeebbc6384f81f: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-2794b9a38ad54e088a7b3f884de8ef3d received from {username='slave'} at 127.0.0.1:35652
I20260709 12:16:36.925905 21046 tablet_copy_service.cc:434] P 3ed9deaeb4014e9d87aeebbc6384f81f: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-2794b9a38ad54e088a7b3f884de8ef3d on tablet 2794b9a38ad54e088a7b3f884de8ef3d with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:36.926375 21954 ts_tablet_manager.cc:1434] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.071s	user 0.011s	sys 0.005s
I20260709 12:16:36.928573 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-097c05b85fe14dc38775d8347e0478fe received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:36.929011 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-097c05b85fe14dc38775d8347e0478fe on tablet 097c05b85fe14dc38775d8347e0478fe with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:36.935164 21957 tablet_copy_client.cc:323] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:36.937392 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet 2afb5fda50b04769b30c8dfc6a46563e from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:36.937902 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet 2afb5fda50b04769b30c8dfc6a46563e from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-2afb5fda50b04769b30c8dfc6a46563e
I20260709 12:16:36.945096 21121 tablet_copy_source_session.cc:215] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:36.948164 21957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afb5fda50b04769b30c8dfc6a46563e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:36.963032 21957 tablet_copy_client.cc:806] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:36.963656 21957 tablet_copy_client.cc:670] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:36.968158 21957 tablet_copy_client.cc:538] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:36.981622 21957 tablet_bootstrap.cc:492] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:37.009761 21957 tablet_bootstrap.cc:492] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:37.010782 21957 tablet_bootstrap.cc:492] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:37.011503 21957 ts_tablet_manager.cc:1403] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.008s
I20260709 12:16:37.015498 21957 raft_consensus.cc:359] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:37.016335 21957 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:37.017055 21957 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:37.019748 21957 ts_tablet_manager.cc:1434] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:16:37.021801 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-2afb5fda50b04769b30c8dfc6a46563e received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:37.022194 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-2afb5fda50b04769b30c8dfc6a46563e on tablet 2afb5fda50b04769b30c8dfc6a46563e with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:37.127453 21744 raft_consensus.cc:1217] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:37.165731 21747 raft_consensus.cc:1217] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:37.175324 21744 raft_consensus.cc:1217] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:37.356765 21747 raft_consensus.cc:1217] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:37.535708 21939 raft_consensus.cc:1064] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:37.537977 21939 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:37.543619 21747 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:37.545027 21185 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:37.546820 21036 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:37.547391 21940 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:16:37.550828 21941 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:37.553332 21952 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:37.623027 21972 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.624159 21185 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.631250 21032 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.648711 20930 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.655066 21744 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.672433 21897 raft_consensus.cc:1064] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:37.674661 21897 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:37.686398 21973 raft_consensus.cc:1064] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:37.688951 21973 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:37.715237 21747 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:37.719447 21103 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:37.720082 21185 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:37.722085 21953 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:37.727196 21950 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:37.729904 21950 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:37.740787 21110 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:37.746682 21744 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:37.748199 21974 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:37.751211 21744 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:37.758811 21972 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.764943 21034 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:37.765326 21746 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.769590 21940 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:37.790341 21034 raft_consensus.cc:2955] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.794818 20934 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:16:37.796808 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 44182.2us
I20260709 12:16:37.798424 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 097c05b85fe14dc38775d8347e0478fe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:16:37.807163 21986 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:16:37.809209 21987 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:37.843670 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 107700us
I20260709 12:16:37.845464 21110 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:37.844875 21953 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.849668 21930 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:37.853428 21747 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.866324 21185 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.895147 21170 tablet_service.cc:1558] Processing DeleteTablet for tablet 097c05b85fe14dc38775d8347e0478fe with delete_type TABLET_DATA_TOMBSTONED (TS 694635cc4a20455fbbec925e0a84a1ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51888
I20260709 12:16:37.920295 21104 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.921317 21991 tablet_replica.cc:333] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:16:37.917451 20931 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:37.931864 21941 raft_consensus.cc:1064] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:37.937831 21941 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:37.939045 21034 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:37.940030 21991 raft_consensus.cc:2243] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:37.939813 21972 consensus_queue.cc:1175] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 1 status { last_received { term: 1 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 2 } }
I20260709 12:16:37.945326 21991 raft_consensus.cc:2272] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:37.953687 21989 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.969233 21991 ts_tablet_manager.cc:1916] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:37.964166 21103 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:37.959849 21034 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:37.995048 21984 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:38.006217 21747 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:38.005944 21744 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.008759 21900 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:38.013907 21186 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:38.015823 21953 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:38.012298 20930 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.038187 21747 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:38.040287 21991 ts_tablet_manager.cc:1929] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:38.044473 21994 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.040151 21939 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:16:38.052687 21177 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:38.058724 21186 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.065196 21974 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:38.040720 21991 log.cc:1199] T 097c05b85fe14dc38775d8347e0478fe P 694635cc4a20455fbbec925e0a84a1ee: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/wals/097c05b85fe14dc38775d8347e0478fe
I20260709 12:16:38.079540 21746 raft_consensus.cc:2955] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.092489 20934 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.093266 21972 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.102512 21032 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.115087 20921 catalog_manager.cc:5028] TS 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): tablet 097c05b85fe14dc38775d8347e0478fe (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:38.115550 21095 tablet_service.cc:1558] Processing DeleteTablet for tablet 2794b9a38ad54e088a7b3f884de8ef3d with delete_type TABLET_DATA_TOMBSTONED (TS a62242aa80cd4affa87dc4a3cf6b64ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56396
I20260709 12:16:38.124169 21744 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.139379 21034 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.139660 20920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2794b9a38ad54e088a7b3f884de8ef3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:38.143297 20930 catalog_manager.cc:5697] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.155684 21999 tablet_replica.cc:333] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:16:38.156872 21999 raft_consensus.cc:2243] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.167141 21999 raft_consensus.cc:2272] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.161872 21177 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.190393 21999 ts_tablet_manager.cc:1916] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:38.205312 21103 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:38.207063 21999 ts_tablet_manager.cc:1929] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:38.207523 21999 log.cc:1199] T 2794b9a38ad54e088a7b3f884de8ef3d P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/wals/2794b9a38ad54e088a7b3f884de8ef3d
I20260709 12:16:38.210114 20918 catalog_manager.cc:5028] TS a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): tablet 2794b9a38ad54e088a7b3f884de8ef3d (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:38.213220 21177 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:38.214766 21744 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:38.214710 21941 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:38.216552 21972 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:38.224715 21941 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.229601 21177 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.233709 21744 raft_consensus.cc:2955] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.247212 20930 catalog_manager.cc:5697] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.249778 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2afb5fda50b04769b30c8dfc6a46563e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:38.275643 21023 tablet_service.cc:1558] Processing DeleteTablet for tablet 2afb5fda50b04769b30c8dfc6a46563e with delete_type TABLET_DATA_TOMBSTONED (TS 3ed9deaeb4014e9d87aeebbc6384f81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59982
I20260709 12:16:38.291604 22000 tablet_replica.cc:333] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:16:38.292680 22000 raft_consensus.cc:2243] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.293484 22000 raft_consensus.cc:2272] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.296656 22000 ts_tablet_manager.cc:1916] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:38.312875 22000 ts_tablet_manager.cc:1929] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:38.313344 22000 log.cc:1199] T 2afb5fda50b04769b30c8dfc6a46563e P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/wals/2afb5fda50b04769b30c8dfc6a46563e
I20260709 12:16:38.315825 20920 catalog_manager.cc:5028] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): tablet 2afb5fda50b04769b30c8dfc6a46563e (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:38.597800 21186 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:38.607014 21744 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:38.609652 21036 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:38.610679 21989 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:38.616120 21989 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:38.621017 21989 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.634684 21032 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.633273 21744 raft_consensus.cc:2955] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.662375 20921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cff4bd391fcd4a0e98a7359c8267ab60 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:38.669152 20930 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New cstate: current_term: 1 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:38.727622 21095 tablet_service.cc:1558] Processing DeleteTablet for tablet cff4bd391fcd4a0e98a7359c8267ab60 with delete_type TABLET_DATA_TOMBSTONED (TS a62242aa80cd4affa87dc4a3cf6b64ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56396
I20260709 12:16:38.772270 22003 tablet_replica.cc:333] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:16:38.776571 22003 raft_consensus.cc:2243] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.778571 22003 raft_consensus.cc:2272] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.790697 22003 ts_tablet_manager.cc:1916] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:38.825878 22003 ts_tablet_manager.cc:1929] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:38.826344 22003 log.cc:1199] T cff4bd391fcd4a0e98a7359c8267ab60 P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/wals/cff4bd391fcd4a0e98a7359c8267ab60
I20260709 12:16:38.828651 20918 catalog_manager.cc:5028] TS a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): tablet cff4bd391fcd4a0e98a7359c8267ab60 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:39.834499 21032 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:39.840317 21177 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:39.840407 21000 consensus_peers.cc:597] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e4624827ee54eb0ba008c640f0ffb6b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:39.840968 21104 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:39.841861 22006 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:39.842664 22002 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:39.850425 22006 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:39.854737 21186 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:39.857400 21104 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:39.872848 20933 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:39.881059 21104 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:39.889850 21177 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:39.891604 21075 consensus_peers.cc:597] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a806d7d80a64c98ad9053bacc618d37. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:39.892062 22004 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:39.894881 21032 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:39.896391 22004 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:39.901538 21940 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:39.903266 21177 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:39.923804 20930 catalog_manager.cc:5697] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:39.942466 21104 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:39.952200 21032 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:39.984500 21032 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:39.984728 21186 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:39.985097 21075 consensus_peers.cc:597] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5b9dc7576af431ea6e483cb2a8c04f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:39.985590 21940 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:39.986323 22018 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:39.993896 21940 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:39.996383 21032 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:40.001091 21186 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:40.011657 20930 catalog_manager.cc:5697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.013804 21104 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:40.032837 21032 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:40.033344 21075 consensus_peers.cc:597] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 066b481f21914e9aa6feafafc76db125. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:40.034158 21940 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:40.037206 21186 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:40.039431 21940 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:40.043447 22018 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:40.045617 21032 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:40.065930 21177 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:40.066215 20930 catalog_manager.cc:5697] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:40.343957 22025 ts_tablet_manager.cc:933] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:16:40.346112 22025 tablet_copy_client.cc:323] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.1:42723
I20260709 12:16:40.347734 21046 tablet_copy_service.cc:140] P 3ed9deaeb4014e9d87aeebbc6384f81f: Received BeginTabletCopySession request for tablet 0e4624827ee54eb0ba008c640f0ffb6b from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:35652)
I20260709 12:16:40.348276 21046 tablet_copy_service.cc:161] P 3ed9deaeb4014e9d87aeebbc6384f81f: Beginning new tablet copy session on tablet 0e4624827ee54eb0ba008c640f0ffb6b from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:35652: session id = a1b891e53adc40a6a1ae813238321e93-0e4624827ee54eb0ba008c640f0ffb6b
I20260709 12:16:40.356257 21046 tablet_copy_source_session.cc:215] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:40.359148 22025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4624827ee54eb0ba008c640f0ffb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:40.371623 22025 tablet_copy_client.cc:806] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:40.372246 22025 tablet_copy_client.cc:670] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:40.375646 22025 tablet_copy_client.cc:538] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:40.382247 22025 tablet_bootstrap.cc:492] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:40.394807 22027 ts_tablet_manager.cc:933] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:40.396942 22027 tablet_copy_client.cc:323] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:40.398903 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet 3a806d7d80a64c98ad9053bacc618d37 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:40.399432 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet 3a806d7d80a64c98ad9053bacc618d37 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-3a806d7d80a64c98ad9053bacc618d37
I20260709 12:16:40.401268 22025 tablet_bootstrap.cc:492] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:40.402112 22025 tablet_bootstrap.cc:492] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:40.402736 22025 ts_tablet_manager.cc:1403] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.001s
I20260709 12:16:40.405771 22025 raft_consensus.cc:359] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:40.406529 22025 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:40.407337 22025 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:40.420249 21121 tablet_copy_source_session.cc:215] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:40.435176 22027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a806d7d80a64c98ad9053bacc618d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:40.438378 22025 ts_tablet_manager.cc:1434] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.035s	user 0.013s	sys 0.014s
I20260709 12:16:40.448051 21046 tablet_copy_service.cc:342] P 3ed9deaeb4014e9d87aeebbc6384f81f: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-0e4624827ee54eb0ba008c640f0ffb6b received from {username='slave'} at 127.0.0.1:35652
I20260709 12:16:40.448516 21046 tablet_copy_service.cc:434] P 3ed9deaeb4014e9d87aeebbc6384f81f: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-0e4624827ee54eb0ba008c640f0ffb6b on tablet 0e4624827ee54eb0ba008c640f0ffb6b with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:40.453697 22027 tablet_copy_client.cc:806] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:40.454317 22027 tablet_copy_client.cc:670] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:40.471186 22025 ts_tablet_manager.cc:933] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:40.471292 22027 tablet_copy_client.cc:538] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:40.480909 22027 tablet_bootstrap.cc:492] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:40.484357 22025 tablet_copy_client.cc:323] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:40.485857 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet f5b9dc7576af431ea6e483cb2a8c04f7 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:40.486363 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet f5b9dc7576af431ea6e483cb2a8c04f7 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-f5b9dc7576af431ea6e483cb2a8c04f7
I20260709 12:16:40.507325 21121 tablet_copy_source_session.cc:215] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:40.514298 22025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b9dc7576af431ea6e483cb2a8c04f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:40.518127 22027 tablet_bootstrap.cc:492] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:40.519237 22027 tablet_bootstrap.cc:492] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:40.519876 22027 ts_tablet_manager.cc:1403] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.014s
I20260709 12:16:40.522797 22027 raft_consensus.cc:359] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:40.523640 22027 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:40.524291 22027 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:40.526696 22027 ts_tablet_manager.cc:1434] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:40.528398 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-3a806d7d80a64c98ad9053bacc618d37 received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:40.528831 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-3a806d7d80a64c98ad9053bacc618d37 on tablet 3a806d7d80a64c98ad9053bacc618d37 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:40.530418 22025 tablet_copy_client.cc:806] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:40.532032 22025 tablet_copy_client.cc:670] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:40.537708 22025 tablet_copy_client.cc:538] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:40.545187 22025 tablet_bootstrap.cc:492] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:40.562736 22025 tablet_bootstrap.cc:492] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:40.563634 22025 tablet_bootstrap.cc:492] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:40.564234 22025 ts_tablet_manager.cc:1403] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.001s
I20260709 12:16:40.567239 22025 raft_consensus.cc:359] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:40.567970 22025 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:40.568563 22025 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:40.573046 22025 ts_tablet_manager.cc:1434] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:16:40.575013 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-f5b9dc7576af431ea6e483cb2a8c04f7 received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:40.575410 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-f5b9dc7576af431ea6e483cb2a8c04f7 on tablet f5b9dc7576af431ea6e483cb2a8c04f7 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:40.592257 22025 ts_tablet_manager.cc:933] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:40.601643 22025 tablet_copy_client.cc:323] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:40.603071 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet 066b481f21914e9aa6feafafc76db125 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:40.603480 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet 066b481f21914e9aa6feafafc76db125 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-066b481f21914e9aa6feafafc76db125
I20260709 12:16:40.612234 21121 tablet_copy_source_session.cc:215] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:40.614516 22025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 066b481f21914e9aa6feafafc76db125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:40.626379 22025 tablet_copy_client.cc:806] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:40.626857 22025 tablet_copy_client.cc:670] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:40.629856 22025 tablet_copy_client.cc:538] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:40.635861 22025 tablet_bootstrap.cc:492] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:40.653017 22025 tablet_bootstrap.cc:492] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:40.653626 22025 tablet_bootstrap.cc:492] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:40.654080 22025 ts_tablet_manager.cc:1403] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 12:16:40.656368 22025 raft_consensus.cc:359] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:40.657137 22025 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:40.657719 22025 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:40.659762 22025 ts_tablet_manager.cc:1434] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:16:40.662089 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-066b481f21914e9aa6feafafc76db125 received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:40.662477 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-066b481f21914e9aa6feafafc76db125 on tablet 066b481f21914e9aa6feafafc76db125 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:40.763067 21744 raft_consensus.cc:1217] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:40.909461 21744 raft_consensus.cc:1217] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:41.000406 21744 raft_consensus.cc:1217] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:41.053113 21744 raft_consensus.cc:1217] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:41.292106 22018 raft_consensus.cc:1064] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:41.294123 22018 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:41.305553 21186 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.306037 21743 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.307302 21036 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.307612 21974 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:41.308588 22017 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:41.309381 21940 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:41.326740 21974 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.328388 21186 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.334342 21743 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.345418 20934 catalog_manager.cc:5697] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.348721 21032 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.358240 22037 raft_consensus.cc:1064] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:41.364043 22037 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:41.378104 21744 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.390761 22045 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:41.396083 21177 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.398489 22034 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:41.411369 21103 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.415467 22045 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:41.424099 22045 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.471329 21744 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.480201 21104 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.487231 22017 raft_consensus.cc:1064] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:41.489717 22017 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:41.514590 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 82946.3us
W20260709 12:16:41.571026 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 69999.3us
I20260709 12:16:41.577235 21747 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.585464 21186 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.586764 21028 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.586812 21940 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:41.591512 22055 raft_consensus.cc:1064] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:41.593842 22055 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:41.605815 21186 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.608961 21744 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.611033 22053 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:41.613840 21185 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.617652 21028 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:41.624094 22018 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:41.625190 22042 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:41.637941 22054 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:41.652887 21974 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:41.694420 21104 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:41.698560 20933 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.713284 21179 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:41.714663 22053 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.720203 21940 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.725752 21744 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:41.725802 21747 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.736266 21029 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:41.724391 21185 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.724687 22054 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:16:41.744415 21747 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:41.745290 21177 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:41.745682 22037 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:41.746572 22045 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:41.749985 20931 catalog_manager.cc:5697] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.753186 22045 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.760648 21177 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.762528 22017 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.765750 21186 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.761585 21032 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.768631 21974 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:41.762318 21028 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.756379 21179 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.792127 20920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e4624827ee54eb0ba008c640f0ffb6b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:41.771703 21744 raft_consensus.cc:2955] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.801605 20931 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:41.803176 20930 catalog_manager.cc:5697] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.805855 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a806d7d80a64c98ad9053bacc618d37 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:16:41.818626 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 50785.6us
I20260709 12:16:41.821763 21744 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.823593 21747 raft_consensus.cc:2955] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.830991 21023 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a806d7d80a64c98ad9053bacc618d37 with delete_type TABLET_DATA_TOMBSTONED (TS 3ed9deaeb4014e9d87aeebbc6384f81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59982
I20260709 12:16:41.852123 20930 catalog_manager.cc:5697] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.857215 21095 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e4624827ee54eb0ba008c640f0ffb6b with delete_type TABLET_DATA_TOMBSTONED (TS a62242aa80cd4affa87dc4a3cf6b64ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56396
I20260709 12:16:41.873380 22070 tablet_replica.cc:333] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:16:41.878228 22070 raft_consensus.cc:2243] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:41.878875 22070 raft_consensus.cc:2272] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:41.878960 22069 tablet_replica.cc:333] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:16:41.883113 22069 raft_consensus.cc:2243] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:41.883857 22069 raft_consensus.cc:2272] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:41.884511 22070 ts_tablet_manager.cc:1916] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:41.891939 22069 ts_tablet_manager.cc:1916] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:41.895872 21104 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:41.906932 21744 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:41.908854 22069 ts_tablet_manager.cc:1929] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:41.909472 22069 log.cc:1199] T 3a806d7d80a64c98ad9053bacc618d37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/wals/3a806d7d80a64c98ad9053bacc618d37
I20260709 12:16:41.909191 22067 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:41.916323 21186 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:41.930459 22070 ts_tablet_manager.cc:1929] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:41.931727 22067 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:41.932087 22070 log.cc:1199] T 0e4624827ee54eb0ba008c640f0ffb6b P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/wals/0e4624827ee54eb0ba008c640f0ffb6b
I20260709 12:16:41.935946 22042 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.941977 21743 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:41.942313 21186 raft_consensus.cc:2955] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:42.419325 20920 catalog_manager.cc:5028] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): tablet 3a806d7d80a64c98ad9053bacc618d37 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
W20260709 12:16:42.478720 20920 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 59412.3us
I20260709 12:16:42.438184 20918 catalog_manager.cc:5028] TS a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): tablet 0e4624827ee54eb0ba008c640f0ffb6b (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
W20260709 12:16:42.484455 20918 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 46309.9us
I20260709 12:16:42.485085 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 066b481f21914e9aa6feafafc76db125 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:42.948663 22071 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:42.950887 22071 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:42.953122 22071 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:42.974979 21940 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:42.975514 21940 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:42.977329 21940 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:42.981251 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.084436 22071 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:43.085134 22071 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:43.087982 22071 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:43.257334 22071 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:43.257931 22071 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:43.262475 22071 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:43.263247 22073 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.263854 22073 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:43.267040 22073 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:43.267915 22071 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:43.268460 22071 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.270350 22071 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.332165 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:43.337438 22071 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:43.337996 22071 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.340014 22071 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.353209 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.366631 21984 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:43.367180 21984 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.369930 21984 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.378471 21109 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:43.380300 22017 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:43.380817 22017 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.382422 22017 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:43.382485 22086 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:43.385828 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.386201 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.389595 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.392874 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.383051 22086 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.394934 22086 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.397200 20999 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:43.398147 22076 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:43.404119 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.409814 20931 catalog_manager.cc:5697] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:43.434777 22086 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.435339 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:43.420794 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.456744 22088 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.524295 22089 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.527067 21738 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.528978 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:43.527295 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:43.448019 22086 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.931874 22086 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.546125 22051 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:16:43.583469 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 147311us
I20260709 12:16:43.933665 22051 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.935788 22051 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:16:43.787405 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800292500 after lost signal to thread 19891
I20260709 12:16:43.935868 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:43.937101 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800291d60 after lost signal to thread 20968
W20260709 12:16:43.938179 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1140 after lost signal to thread 21060
I20260709 12:16:43.794096 22089 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:43.794100 22088 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:43.798157 22094 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.813007 20931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 75) took 1339 ms. Trace:
I20260709 12:16:43.939494 22094 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.819535 22052 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.824388 22095 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.827656 22096 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.941648 22094 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.941895 22096 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.940778 22089 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.944070 22096 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.832101 22097 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.944594 22088 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:43.834178 22098 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.944743 22097 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.945220 22098 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.843349 20930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49692 (request call id 165) took 1354 ms. Trace:
I20260709 12:16:43.853724 21984 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.865084 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1126) took 1362 ms. Trace:
I20260709 12:16:43.947711 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.867918 22102 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.948536 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.948776 22102 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:43.949165 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.949702 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.868811 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.868927 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.869642 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.951248 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.870649 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.953248 22081 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:43.871320 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.953737 22081 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.871958 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.872704 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.955862 22081 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:43.956316 22081 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:43.956770 22081 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.957281 22094 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.957756 22094 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:43.958547 22081 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:43.879858 22104 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.987985 22104 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.989720 21031 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:43.990232 22104 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.881944 22106 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.990950 22106 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.993055 22106 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.995563 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:43.883980 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.890786 22103 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:43.996800 22103 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.998936 22103 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.896777 21023 tablet_service.cc:1558] Processing DeleteTablet for tablet 066b481f21914e9aa6feafafc76db125 with delete_type TABLET_DATA_TOMBSTONED (TS 3ed9deaeb4014e9d87aeebbc6384f81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59982
I20260709 12:16:44.000909 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:43.907128 21974 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:43.932304 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:44.003407 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:43.875586 22101 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:44.004137 22101 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:44.006210 22101 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.959179 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.947521 20930 rpcz_store.cc:276] 0709 12:16:42.488698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.489053 (+   355us) service_pool.cc:224] Handling call
0709 12:16:43.843287 (+1354234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":964811,"reported_tablets":1}
I20260709 12:16:44.006973 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.941690 22095 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:44.009014 22095 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.947996 21179 rpcz_store.cc:276] 0709 12:16:42.503053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.864249 (+1361196us) service_pool.cc:224] Handling call
0709 12:16:43.864539 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:43.864737 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:43.864763 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:43.864807 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:43.864837 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:43.864894 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:43.865026 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:44.009512 22073 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:44.010057 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.010015 22073 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.940845 22052 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:44.012401 22052 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:44.009025 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.015159 22073 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:44.015666 22088 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.013818 22082 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:44.018150 22082 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.961434 22084 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:44.020236 22082 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:44.020789 22084 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:44.027693 22084 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:44.010080 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.962811 22083 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:44.034837 22083 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:44.037015 22083 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:43.963572 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800292600 after lost signal to thread 21136
I20260709 12:16:43.963884 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.040795 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:43.966229 22085 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:43.939756 20931 rpcz_store.cc:276] 0709 12:16:42.473256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.473389 (+   133us) service_pool.cc:224] Handling call
0709 12:16:43.812923 (+1339534us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:43.598495 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:43.599080 (+   585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:43.599109 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:16:43.599125 (+    16us) tablet.cc:662] Decoding operations
0709 12:16:43.599426 (+   301us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:43.599499 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:43.599530 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:43.599695 (+   165us) tablet.cc:701] Row locks acquired
0709 12:16:43.599710 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:16:43.599826 (+   116us) write_op.cc:270] Start()
0709 12:16:43.599933 (+   107us) write_op.cc:276] Timestamp: P: 1783599403599787 usec, L: 0
0709 12:16:43.599954 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:16:43.600585 (+   631us) log.cc:844] Serialized 532 byte log entry
0709 12:16:43.604003 (+  3418us) op_driver.cc:464] REPLICATION: finished
0709 12:16:43.605673 (+  1670us) write_op.cc:301] APPLY: starting
0709 12:16:43.605746 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:43.605836 (+    90us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:43.605940 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:43.606148 (+   208us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:43.606258 (+   110us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:16:43.606292 (+    34us) write_op.cc:312] APPLY: finished
0709 12:16:43.606488 (+   196us) log.cc:844] Serialized 22 byte log entry
0709 12:16:43.607134 (+   646us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:43.607210 (+    76us) write_op.cc:454] Released schema lock
0709 12:16:43.607243 (+    33us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:43.607501 (+   258us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:43.607528 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":157054,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1495,"apply.run_cpu_time_us":1330,"apply.run_wall_time_us":1823,"num_ops":1,"prepare.queue_time_us":786,"prepare.run_cpu_time_us":2973,"prepare.run_wall_time_us":2985,"raft.queue_time_us":757,"raft.run_cpu_time_us":1011,"raft.run_wall_time_us":1227,"replication_time_us":3927,"thread_start_us":2289,"threads_started":4,"wal-append.queue_time_us":1066}]]}
I20260709 12:16:43.967110 22097 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.968830 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:43.971212 21077 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:43.973731 22094 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:43.974423 21151 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.041535 22079 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:43.975419 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:43.976318 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:43.978859 22098 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.979305 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.051713 22097 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:43.981022 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.981681 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.982370 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.053308 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:43.983106 21984 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:43.983899 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:43.983899 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.984660 22102 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:44.057106 21984 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:43.984834 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.987090 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.032212 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.033481 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.034138 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:43.962746 22076 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:16:44.042721 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6540 after lost signal to thread 21211
W20260709 12:16:44.046185 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 75145.7us
I20260709 12:16:44.046820 21974 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:44.047408 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:44.047104 21744 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:16:44.064689 21057 debug-util.cc:398] Leaking SignalData structure 0x7b080024fda0 after lost signal to thread 21771
I20260709 12:16:44.048460 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:44.050567 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 76211.4us
I20260709 12:16:44.068104 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.069136 21151 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.069407 21149 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.044001 22085 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:44.060221 22076 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:44.070163 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.071024 22097 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.071681 22097 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.071875 22085 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:44.072250 22076 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:44.072468 22102 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.073102 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.073379 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:44.074357 22097 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.075191 22075 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:44.075693 22075 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:44.077723 22075 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:44.072136 22098 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.073808 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:44.079434 22098 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.080426 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.081102 22098 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.081838 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.082140 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:44.082887 22098 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.083621 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:44.083813 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:44.084106 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:44.085067 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.086009 22098 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.087075 21151 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.087713 22098 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.088683 21151 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.089346 22098 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.091432 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:44.092128 22085 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.097355 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5b9dc7576af431ea6e483cb2a8c04f7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:44.094831 20931 catalog_manager.cc:5697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:44.102103 21151 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.102859 22098 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.104035 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.107635 22098 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.112170 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.112995 22098 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.114750 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.116108 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.120085 21974 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:44.123499 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.124655 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.125039 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.126044 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.127116 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.127362 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.128722 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.128929 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.131224 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:44.131531 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.133122 21940 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.133807 22113 tablet_replica.cc:333] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:16:44.134734 22113 raft_consensus.cc:2243] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:44.135455 22113 raft_consensus.cc:2272] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:44.136256 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.137861 22075 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:44.138342 22075 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:44.141428 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.142315 22075 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:44.144256 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:44.145234 21170 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b9dc7576af431ea6e483cb2a8c04f7 with delete_type TABLET_DATA_TOMBSTONED (TS 694635cc4a20455fbbec925e0a84a1ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51888
I20260709 12:16:44.145345 22113 ts_tablet_manager.cc:1916] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:44.145527 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.147159 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.148330 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.151768 20999 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.152575 22085 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.152810 22098 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.154040 21151 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.154911 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.155735 22085 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.156041 22098 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.156957 20999 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.157764 22085 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.160199 22113 ts_tablet_manager.cc:1929] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:44.160673 22113 log.cc:1199] T 066b481f21914e9aa6feafafc76db125 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/wals/066b481f21914e9aa6feafafc76db125
I20260709 12:16:44.157320 21151 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.162329 20920 catalog_manager.cc:5028] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): tablet 066b481f21914e9aa6feafafc76db125 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:44.162549 22098 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.162969 21151 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.163662 22098 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.164031 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.164706 22098 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.165069 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.165233 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.166106 21151 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.167007 20999 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.167671 22097 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.165757 22098 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.168399 22114 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.167488 22085 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.169548 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.170131 22085 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.170368 22116 tablet_replica.cc:333] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:16:44.171290 20999 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.171546 22116 raft_consensus.cc:2243] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:44.171881 22114 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.172372 22116 raft_consensus.cc:2272] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:44.172883 20999 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.173449 22114 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.174274 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:44.176512 22116 ts_tablet_manager.cc:1916] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:44.177479 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:44.180115 20999 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.180843 22114 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.181910 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:44.182682 22088 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:44.184401 21034 raft_consensus.cc:2955] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:44.194260 22116 ts_tablet_manager.cc:1929] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:44.194777 22116 log.cc:1199] T f5b9dc7576af431ea6e483cb2a8c04f7 P 694635cc4a20455fbbec925e0a84a1ee: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/wals/f5b9dc7576af431ea6e483cb2a8c04f7
I20260709 12:16:44.196585 20921 catalog_manager.cc:5028] TS 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): tablet f5b9dc7576af431ea6e483cb2a8c04f7 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
W20260709 12:16:44.563088 21133 debug-util.cc:398] Leaking SignalData structure 0x7b0800087b20 after lost signal to thread 19891
W20260709 12:16:44.564046 21133 debug-util.cc:398] Leaking SignalData structure 0x7b08000840e0 after lost signal to thread 20968
W20260709 12:16:44.564973 21133 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7620 after lost signal to thread 21060
W20260709 12:16:44.565937 21133 debug-util.cc:398] Leaking SignalData structure 0x7b080029d4a0 after lost signal to thread 21136
W20260709 12:16:44.566699 21133 debug-util.cc:398] Leaking SignalData structure 0x7b08003171c0 after lost signal to thread 21211
W20260709 12:16:44.566931 21133 debug-util.cc:398] Leaking SignalData structure 0x7b080004df00 after lost signal to thread 21212
W20260709 12:16:44.567653 21133 debug-util.cc:398] Leaking SignalData structure 0x7b0800310780 after lost signal to thread 21771
W20260709 12:16:44.567850 21133 debug-util.cc:398] Leaking SignalData structure 0x7b0800310880 after lost signal to thread 21772
I20260709 12:16:45.206736 21034 consensus_queue.cc:237] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:45.233074 21181 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.235121 22085 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:45.236550 21000 consensus_peers.cc:597] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc9e2a2fa444400287e8c1f7e71cbf5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.238751 21109 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.244364 22085 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.257289 22075 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.259104 21181 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.269761 21108 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.293880 20930 catalog_manager.cc:5697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.297851 21108 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
W20260709 12:16:45.326407 21075 consensus_peers.cc:597] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36a88ddff51a4bcea630447226c59041. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.333180 21181 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.335135 22079 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.337584 21034 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.340914 22072 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.390054 22079 raft_consensus.cc:2955] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.390739 21027 raft_consensus.cc:2955] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.411348 20934 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
W20260709 12:16:45.488701 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 51169.2us
I20260709 12:16:45.514549 21027 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:45.552565 21181 raft_consensus.cc:2955] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.562438 21108 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:45.562961 21000 consensus_peers.cc:597] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be0e4a74d2d54b1e94234933e9f489c7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.564008 21182 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.564075 22138 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:45.565438 22084 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.583053 22137 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.584699 21177 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.585209 21108 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.600677 20931 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.607852 21027 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
W20260709 12:16:45.624800 21000 consensus_peers.cc:597] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa441bc31c5043668f08c6e72305c329. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:45.626214 21177 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.626464 21108 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:45.627558 22139 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.628401 22137 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.639554 22138 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.640725 21177 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.643666 21108 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.663012 20934 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:45.826706 22146 ts_tablet_manager.cc:933] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:16:45.853356 22146 tablet_copy_client.cc:323] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.1:42723
I20260709 12:16:45.854992 21046 tablet_copy_service.cc:140] P 3ed9deaeb4014e9d87aeebbc6384f81f: Received BeginTabletCopySession request for tablet bc9e2a2fa444400287e8c1f7e71cbf5f from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:35652)
I20260709 12:16:45.855544 21046 tablet_copy_service.cc:161] P 3ed9deaeb4014e9d87aeebbc6384f81f: Beginning new tablet copy session on tablet bc9e2a2fa444400287e8c1f7e71cbf5f from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:35652: session id = a1b891e53adc40a6a1ae813238321e93-bc9e2a2fa444400287e8c1f7e71cbf5f
I20260709 12:16:45.863829 21046 tablet_copy_source_session.cc:215] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:45.867043 22146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9e2a2fa444400287e8c1f7e71cbf5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:45.883257 22146 tablet_copy_client.cc:806] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:45.883857 22146 tablet_copy_client.cc:670] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:45.887884 22146 tablet_copy_client.cc:538] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:45.900125 22146 tablet_bootstrap.cc:492] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:45.934407 22146 tablet_bootstrap.cc:492] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:45.935441 22146 tablet_bootstrap.cc:492] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:45.936229 22146 ts_tablet_manager.cc:1403] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.004s
I20260709 12:16:45.939260 22146 raft_consensus.cc:359] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:45.940214 22146 raft_consensus.cc:740] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:45.940888 22146 consensus_queue.cc:260] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:45.950968 22146 ts_tablet_manager.cc:1434] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:16:45.955807 21046 tablet_copy_service.cc:342] P 3ed9deaeb4014e9d87aeebbc6384f81f: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-bc9e2a2fa444400287e8c1f7e71cbf5f received from {username='slave'} at 127.0.0.1:35652
I20260709 12:16:45.956218 21046 tablet_copy_service.cc:434] P 3ed9deaeb4014e9d87aeebbc6384f81f: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-bc9e2a2fa444400287e8c1f7e71cbf5f on tablet bc9e2a2fa444400287e8c1f7e71cbf5f with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:45.973006 22146 ts_tablet_manager.cc:933] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:45.981887 22146 tablet_copy_client.cc:323] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:45.983541 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet 36a88ddff51a4bcea630447226c59041 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:45.984069 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet 36a88ddff51a4bcea630447226c59041 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-36a88ddff51a4bcea630447226c59041
I20260709 12:16:45.991668 21121 tablet_copy_source_session.cc:215] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:45.994987 22146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a88ddff51a4bcea630447226c59041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:46.015774 22146 tablet_copy_client.cc:806] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:46.016376 22146 tablet_copy_client.cc:670] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:46.025848 22146 tablet_copy_client.cc:538] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:46.034422 22146 tablet_bootstrap.cc:492] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:46.061967 22146 tablet_bootstrap.cc:492] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:46.062893 22146 tablet_bootstrap.cc:492] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:46.063611 22146 ts_tablet_manager.cc:1403] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.011s
I20260709 12:16:46.066351 22146 raft_consensus.cc:359] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:46.067212 22146 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:46.067864 22146 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:46.070463 22146 ts_tablet_manager.cc:1434] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:16:46.072870 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-36a88ddff51a4bcea630447226c59041 received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:46.073261 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-36a88ddff51a4bcea630447226c59041 on tablet 36a88ddff51a4bcea630447226c59041 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:46.114881 22146 ts_tablet_manager.cc:933] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:16:46.134091 22146 tablet_copy_client.cc:323] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.1:42723
I20260709 12:16:46.135614 22148 ts_tablet_manager.cc:933] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:16:46.138031 21046 tablet_copy_service.cc:140] P 3ed9deaeb4014e9d87aeebbc6384f81f: Received BeginTabletCopySession request for tablet fa441bc31c5043668f08c6e72305c329 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:35652)
I20260709 12:16:46.138585 21046 tablet_copy_service.cc:161] P 3ed9deaeb4014e9d87aeebbc6384f81f: Beginning new tablet copy session on tablet fa441bc31c5043668f08c6e72305c329 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:35652: session id = a1b891e53adc40a6a1ae813238321e93-fa441bc31c5043668f08c6e72305c329
I20260709 12:16:46.159457 21046 tablet_copy_source_session.cc:215] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:46.164000 22146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa441bc31c5043668f08c6e72305c329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:46.181234 22148 tablet_copy_client.cc:323] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.1:42723
I20260709 12:16:46.194023 22146 tablet_copy_client.cc:806] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:46.194646 22146 tablet_copy_client.cc:670] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:46.198477 22146 tablet_copy_client.cc:538] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:46.206387 22146 tablet_bootstrap.cc:492] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:46.207404 21744 raft_consensus.cc:1217] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:46.214075 21046 tablet_copy_service.cc:140] P 3ed9deaeb4014e9d87aeebbc6384f81f: Received BeginTabletCopySession request for tablet be0e4a74d2d54b1e94234933e9f489c7 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:35652)
I20260709 12:16:46.214735 21046 tablet_copy_service.cc:161] P 3ed9deaeb4014e9d87aeebbc6384f81f: Beginning new tablet copy session on tablet be0e4a74d2d54b1e94234933e9f489c7 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:35652: session id = a1b891e53adc40a6a1ae813238321e93-be0e4a74d2d54b1e94234933e9f489c7
I20260709 12:16:46.222383 21046 tablet_copy_source_session.cc:215] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:46.225988 22148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0e4a74d2d54b1e94234933e9f489c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:46.260141 22148 tablet_copy_client.cc:806] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:46.260840 22148 tablet_copy_client.cc:670] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:46.265367 22148 tablet_copy_client.cc:538] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:46.271683 22148 tablet_bootstrap.cc:492] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:46.279268 22146 tablet_bootstrap.cc:492] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:46.280359 22146 tablet_bootstrap.cc:492] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:46.281018 22146 ts_tablet_manager.cc:1403] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.022s
I20260709 12:16:46.302007 22146 raft_consensus.cc:359] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:46.302860 22146 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:46.303592 22146 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:46.305924 22146 ts_tablet_manager.cc:1434] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:16:46.306398 22148 tablet_bootstrap.cc:492] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:46.307479 21046 tablet_copy_service.cc:342] P 3ed9deaeb4014e9d87aeebbc6384f81f: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-fa441bc31c5043668f08c6e72305c329 received from {username='slave'} at 127.0.0.1:35652
I20260709 12:16:46.307893 21046 tablet_copy_service.cc:434] P 3ed9deaeb4014e9d87aeebbc6384f81f: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-fa441bc31c5043668f08c6e72305c329 on tablet fa441bc31c5043668f08c6e72305c329 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:46.307973 22148 tablet_bootstrap.cc:492] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:46.308980 22148 ts_tablet_manager.cc:1403] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.018s
I20260709 12:16:46.312081 22148 raft_consensus.cc:359] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:46.313513 22148 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:46.316234 22148 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:46.318782 22148 ts_tablet_manager.cc:1434] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:16:46.320922 21046 tablet_copy_service.cc:342] P 3ed9deaeb4014e9d87aeebbc6384f81f: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-be0e4a74d2d54b1e94234933e9f489c7 received from {username='slave'} at 127.0.0.1:35652
I20260709 12:16:46.321332 21046 tablet_copy_service.cc:434] P 3ed9deaeb4014e9d87aeebbc6384f81f: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-be0e4a74d2d54b1e94234933e9f489c7 on tablet be0e4a74d2d54b1e94234933e9f489c7 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:46.524529 21744 raft_consensus.cc:1217] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:46.670109 21744 raft_consensus.cc:1217] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:46.705720 22139 raft_consensus.cc:1064] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:46.708218 22139 consensus_queue.cc:237] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:46.733611 21744 raft_consensus.cc:1217] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:46.751144 21744 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.752542 22159 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.774981 21181 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.775084 21108 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.776760 22137 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.778537 22137 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.796360 22138 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:46.814833 21181 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:46.815208 21108 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:46.835597 21744 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:46.832579 20934 catalog_manager.cc:5697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:46.871184 21034 consensus_queue.cc:237] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:46.897002 21181 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:46.898049 21744 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:46.898733 22138 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:46.901135 22138 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:46.906343 22137 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:46.913978 21181 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:46.917286 21744 raft_consensus.cc:2955] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:46.929639 20920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc9e2a2fa444400287e8c1f7e71cbf5f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:46.948925 20933 catalog_manager.cc:5697] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:46.961836 21095 tablet_service.cc:1558] Processing DeleteTablet for tablet bc9e2a2fa444400287e8c1f7e71cbf5f with delete_type TABLET_DATA_TOMBSTONED (TS a62242aa80cd4affa87dc4a3cf6b64ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56396
I20260709 12:16:46.985257 22168 tablet_replica.cc:333] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:16:47.032424 22168 raft_consensus.cc:2243] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:47.033219 22168 raft_consensus.cc:2272] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:47.036674 22168 ts_tablet_manager.cc:1916] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:47.046988 22168 ts_tablet_manager.cc:1929] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:47.047292 22168 log.cc:1199] T bc9e2a2fa444400287e8c1f7e71cbf5f P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/wals/bc9e2a2fa444400287e8c1f7e71cbf5f
I20260709 12:16:47.048584 20918 catalog_manager.cc:5028] TS a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): tablet bc9e2a2fa444400287e8c1f7e71cbf5f (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:47.099385 22131 raft_consensus.cc:1064] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:47.101908 22131 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:47.108222 22160 raft_consensus.cc:1064] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:47.110608 22160 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:47.113127 21744 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.115958 22079 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.126070 21034 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.124722 21177 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.129477 22079 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.131670 22079 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.141674 22079 raft_consensus.cc:2955] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.151561 21034 raft_consensus.cc:2955] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.156313 21744 raft_consensus.cc:2955] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.163384 20930 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.177207 21108 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:47.185657 21742 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.188367 22172 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.207701 21742 raft_consensus.cc:2955] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.206683 22172 raft_consensus.cc:2955] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.223802 21029 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.226600 22175 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.227329 20930 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.230669 21029 raft_consensus.cc:2955] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.240530 21742 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.243455 21170 tablet_service.cc:1558] Processing DeleteTablet for tablet 36a88ddff51a4bcea630447226c59041 with delete_type TABLET_DATA_TOMBSTONED (TS 694635cc4a20455fbbec925e0a84a1ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51888
I20260709 12:16:47.244621 22137 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.264897 21104 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.266462 22139 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.270620 21177 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.271979 22160 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.279219 22138 raft_consensus.cc:1064] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:47.280113 22176 tablet_replica.cc:333] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:16:47.281090 22176 raft_consensus.cc:2243] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:47.281683 22176 pending_rounds.cc:70] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: Trying to abort 1 pending ops.
I20260709 12:16:47.281497 22138 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:47.281991 22176 pending_rounds.cc:77] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305623171483525120 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "36a88ddff51a4bcea630447226c59041" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } } }
I20260709 12:16:47.283658 22176 raft_consensus.cc:2917] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:16:47.284049 22176 raft_consensus.cc:2889] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:16:47.284581 22176 raft_consensus.cc:2272] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:47.298398 22176 ts_tablet_manager.cc:1916] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:47.313300 20918 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36a88ddff51a4bcea630447226c59041 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:47.319231 22137 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.329068 21182 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.335604 22176 ts_tablet_manager.cc:1929] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:47.340934 22176 log.cc:1199] T 36a88ddff51a4bcea630447226c59041 P 694635cc4a20455fbbec925e0a84a1ee: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/wals/36a88ddff51a4bcea630447226c59041
I20260709 12:16:47.340410 21744 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.342834 20921 catalog_manager.cc:5028] TS 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): tablet 36a88ddff51a4bcea630447226c59041 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:47.352934 21106 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.356519 22159 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.361469 21108 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.362604 21177 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.360302 20934 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.366051 22159 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.374408 21744 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:47.376255 22159 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.405519 22159 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.413842 21742 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.423986 21182 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.445396 21029 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:47.454736 21744 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.457265 22137 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.460999 21104 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.465456 22160 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.453011 21108 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.467372 20931 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.474521 22139 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.490128 21106 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.491297 21740 raft_consensus.cc:2955] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.496605 20920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa441bc31c5043668f08c6e72305c329 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:47.525625 20930 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 3 to 4, VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) evicted. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.534222 21029 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:47.540263 21181 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.540453 21740 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:47.541993 22159 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.542835 22139 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.545308 21170 tablet_service.cc:1558] Processing DeleteTablet for tablet fa441bc31c5043668f08c6e72305c329 with delete_type TABLET_DATA_TOMBSTONED (TS 694635cc4a20455fbbec925e0a84a1ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51888
I20260709 12:16:47.546228 22176 tablet_replica.cc:333] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:16:47.547526 22176 raft_consensus.cc:2243] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:47.548228 22176 raft_consensus.cc:2272] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:47.556246 22138 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.565702 22176 ts_tablet_manager.cc:1916] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:47.567924 21740 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.568681 21182 raft_consensus.cc:2955] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:47.569933 20920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be0e4a74d2d54b1e94234933e9f489c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:47.596760 22176 ts_tablet_manager.cc:1929] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:47.597216 22176 log.cc:1199] T fa441bc31c5043668f08c6e72305c329 P 694635cc4a20455fbbec925e0a84a1ee: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/wals/fa441bc31c5043668f08c6e72305c329
I20260709 12:16:47.599800 20921 catalog_manager.cc:5028] TS 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): tablet fa441bc31c5043668f08c6e72305c329 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:47.609251 20931 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 4, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New cstate: current_term: 1 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:16:47.617729 20920 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet be0e4a74d2d54b1e94234933e9f489c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:16:47.621021 21095 tablet_service.cc:1558] Processing DeleteTablet for tablet be0e4a74d2d54b1e94234933e9f489c7 with delete_type TABLET_DATA_TOMBSTONED (TS a62242aa80cd4affa87dc4a3cf6b64ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56396
I20260709 12:16:47.636229 22185 tablet_replica.cc:333] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:16:47.637195 22185 raft_consensus.cc:2243] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:47.637981 22185 raft_consensus.cc:2272] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:47.640779 22185 ts_tablet_manager.cc:1916] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:47.656517 22185 ts_tablet_manager.cc:1929] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:47.656885 22185 log.cc:1199] T be0e4a74d2d54b1e94234933e9f489c7 P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/wals/be0e4a74d2d54b1e94234933e9f489c7
I20260709 12:16:47.658469 20918 catalog_manager.cc:5028] TS a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): tablet be0e4a74d2d54b1e94234933e9f489c7 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:16:48.377019 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.446149 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81f567d6458f4dddaa94452e04485030"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:16:48.446660 21104 raft_consensus.cc:606] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:48.458647 21029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:48.459239 21029 raft_consensus.cc:606] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:48.461479 21029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:48.461922 21029 raft_consensus.cc:606] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:48.464025 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db9d39844048444b8a7293196d1349e9"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:16:48.464399 21104 raft_consensus.cc:606] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:48.466368 21029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:48.466948 21029 raft_consensus.cc:606] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:48.468053 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:48.469566 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:48.470468 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.511102 22160 raft_consensus.cc:993] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:48.511574 22160 raft_consensus.cc:1081] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:48.515537 21177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:16:48.516135 21177 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.516536 21177 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.520048 22138 raft_consensus.cc:993] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:48.520434 22190 raft_consensus.cc:1081] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:48.521667 21181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:16:48.522140 21181 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.522389 21181 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.528169 21181 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:48.529934 21181 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:48.547222 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:48.547883 21106 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.552093 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:48.552697 21033 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.552973 21033 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:48.553699 21033 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:48.554744 21033 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.558283 21106 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:48.564612 21177 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:48.568317 21033 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:48.570304 21149 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:48.571077 21177 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:48.571985 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:48.572274 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:48.572674 21033 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.573035 21033 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:48.573833 21033 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:48.575065 21033 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.582397 22136 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.572856 21106 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.583580 21033 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:48.583555 22136 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:48.584718 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:48.585546 22097 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.585403 22136 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:48.589071 22097 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:48.590788 21106 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:48.591041 22097 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:48.604084 20931 catalog_manager.cc:5697] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 2 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.621749 22079 raft_consensus.cc:993] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:48.622188 22175 raft_consensus.cc:1081] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:48.623721 21033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db9d39844048444b8a7293196d1349e9"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:16:48.624200 21033 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.624529 21033 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.628715 20931 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 2 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.631222 21033 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:48.633486 21033 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:48.634675 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:48.638919 21177 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.641214 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:48.641769 21106 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.642050 21106 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:48.642812 21106 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:48.643841 21106 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.645164 21177 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:48.648029 21002 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:48.650225 22190 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.650938 22190 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:48.651793 22190 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:48.659575 21106 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:48.701550 20931 catalog_manager.cc:5697] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.740154 21106 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
W20260709 12:16:48.749753 21075 consensus_peers.cc:597] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f86692ab0d642a990d934ba6bd6493f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:48.750890 21033 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:48.752254 21177 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:48.755716 22079 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.758410 22079 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:48.916289 22202 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:16:49.142504 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 372026us
I20260709 12:16:49.166690 21027 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.169250 21028 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.205461 22136 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:49.221447 22204 raft_consensus.cc:993] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:49.220036 22207 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.222254 22204 raft_consensus.cc:1081] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:49.205310 22205 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:16:49.228523 21742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:33006
I20260709 12:16:49.229499 21742 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.229884 21742 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:49.249106 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 49278.1us
I20260709 12:16:49.267817 21104 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.292604 21106 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.302165 21184 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.303865 21181 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.320467 21742 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:49.325234 22215 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:49.326262 22136 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.336441 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:49.337180 21027 raft_consensus.cc:3055] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:49.337558 21027 raft_consensus.cc:740] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:49.338490 21027 consensus_queue.cc:260] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:49.339562 21027 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.352274 21027 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:49.353901 21711 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:49.353575 21036 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.408123 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:49.408792 21177 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.394821 21742 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:49.460366 22221 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:49.465770 21177 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
W20260709 12:16:49.471688 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:49.474053 22220 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:16:49.474646 22138 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:49.508615 22175 raft_consensus.cc:993] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:49.514797 22175 raft_consensus.cc:1081] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:49.520298 21032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81f567d6458f4dddaa94452e04485030"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:16:49.520876 21032 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.522751 21032 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.525514 22227 ts_tablet_manager.cc:933] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:49.524490 21105 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.531490 22138 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.534206 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.534749 20931 catalog_manager.cc:5697] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.538784 22227 tablet_copy_client.cc:323] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:49.543803 22221 raft_consensus.cc:697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:16:49.546861 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet 0f86692ab0d642a990d934ba6bd6493f from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:49.550017 21032 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:49.550701 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet 0f86692ab0d642a990d934ba6bd6493f from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-0f86692ab0d642a990d934ba6bd6493f
I20260709 12:16:49.557533 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:49.558027 21103 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:49.558290 21103 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:49.559293 21032 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:49.561929 21103 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:49.563191 21103 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:49.564265 22175 consensus_queue.cc:1175] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:16:49.559191 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:49.566552 21177 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.570420 21121 tablet_copy_source_session.cc:215] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:49.537422 21109 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:49.572938 21177 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:49.575052 21002 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:49.576229 22160 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:49.576684 22160 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:49.576856 22227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f86692ab0d642a990d934ba6bd6493f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:49.578526 21103 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:49.579718 22160 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:49.596792 22221 consensus_queue.cc:237] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:49.635911 22227 tablet_copy_client.cc:806] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:49.649732 22227 tablet_copy_client.cc:670] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
W20260709 12:16:49.653506 21075 consensus_peers.cc:597] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f16c07bcae284f65a7c0ee0375e00769. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:49.656037 21181 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.656507 21036 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.659638 22175 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.661345 22175 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.665181 22227 tablet_copy_client.cc:538] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:49.684623 22206 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.689546 21183 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.697117 20934 catalog_manager.cc:5697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:49.716616 22227 tablet_bootstrap.cc:492] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:49.740492 21109 consensus_queue.cc:237] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:49.778106 21036 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.791072 21181 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.791581 21028 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:49.792979 22216 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:49.795512 21075 consensus_peers.cc:597] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aaaf493e892d4ee9839b45b601fc8400. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:49.801896 21109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:16:49.802546 21109 raft_consensus.cc:606] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:49.803520 22207 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:49.900453 22216 raft_consensus.cc:2955] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.908715 21028 raft_consensus.cc:2955] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.918753 21181 raft_consensus.cc:2955] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.922302 22227 tablet_bootstrap.cc:492] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:49.923305 22227 tablet_bootstrap.cc:492] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:49.923998 22227 ts_tablet_manager.cc:1403] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.208s	user 0.035s	sys 0.055s
I20260709 12:16:49.927031 22227 raft_consensus.cc:359] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:49.926622 20930 catalog_manager.cc:5697] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:49.932471 22227 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:49.933271 20930 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.933267 22227 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:49.942967 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:55908
I20260709 12:16:49.942710 21028 consensus_queue.cc:237] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:49.943490 21177 raft_consensus.cc:606] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:49.944996 22227 ts_tablet_manager.cc:1434] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 12:16:49.948323 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-0f86692ab0d642a990d934ba6bd6493f received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:49.948758 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-0f86692ab0d642a990d934ba6bd6493f on tablet 0f86692ab0d642a990d934ba6bd6493f with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:49.949559 21102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:16:49.950119 21102 raft_consensus.cc:606] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:49.957396 21036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:49.957899 21036 raft_consensus.cc:606] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:49.961315 21036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:49.961824 21036 raft_consensus.cc:606] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:49.962978 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:49.964362 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:49.965183 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.976858 21102 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.978811 22190 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:49.981518 21000 consensus_peers.cc:597] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40fd334874764b26ba28ac382c4199f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:49.982455 21181 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.980844 20930 catalog_manager.cc:5697] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:49.987932 22190 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:50.006314 21028 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:50.010017 22221 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:16:50.045269 22138 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:50.052151 21102 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:50.054356 21181 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:50.090751 21177 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:50.091925 22190 raft_consensus.cc:993] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:50.092402 22190 raft_consensus.cc:1081] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:50.095551 21177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:16:50.096092 21177 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:50.096450 21177 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.099769 22229 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:50.101012 21109 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:50.104768 22138 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:50.108510 20930 catalog_manager.cc:5697] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index -1 to 2, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:16:50.107434 21177 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:50.171829 21177 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:16:50.193943 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9980 after lost signal to thread 19891
W20260709 12:16:50.195530 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f92e0 after lost signal to thread 20968
W20260709 12:16:50.205401 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3bc0 after lost signal to thread 21060
W20260709 12:16:50.209326 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3620 after lost signal to thread 21136
W20260709 12:16:50.212170 21768 debug-util.cc:398] Leaking SignalData structure 0x7b080030c100 after lost signal to thread 21211
W20260709 12:16:50.213181 21768 debug-util.cc:398] Leaking SignalData structure 0x7b0800327220 after lost signal to thread 21771
I20260709 12:16:50.238593 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:50.239266 21102 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.246309 21102 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:50.248845 22190 raft_consensus.cc:993] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:50.249396 22190 raft_consensus.cc:1081] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
W20260709 12:16:50.280124 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 129905us
I20260709 12:16:50.304159 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:50.304710 21036 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:50.304999 21036 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:50.320505 21036 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:50.328830 21036 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.328559 22227 ts_tablet_manager.cc:933] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:50.340731 21149 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:50.353089 22191 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:50.353538 22191 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:50.355674 21036 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:50.360001 21746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:33006
I20260709 12:16:50.360539 21746 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:50.360881 21746 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.369863 22191 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:50.392354 22260 raft_consensus.cc:993] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:50.396632 21746 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:50.398576 21746 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:50.455722 21181 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:50.458251 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 154483us
I20260709 12:16:50.470432 22272 ts_tablet_manager.cc:933] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:16:50.472193 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 153060us
I20260709 12:16:50.458094 22192 raft_consensus.cc:1081] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:50.533447 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:50.538861 21106 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:50.549983 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 78631.4us
I20260709 12:16:50.537273 22261 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
W20260709 12:16:50.605168 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54105.7us
I20260709 12:16:50.605453 22227 tablet_copy_client.cc:323] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
W20260709 12:16:50.625813 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 151458us
I20260709 12:16:50.662155 22274 raft_consensus.cc:993] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:50.663535 22274 raft_consensus.cc:1081] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:50.664498 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet aaaf493e892d4ee9839b45b601fc8400 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:50.665010 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet aaaf493e892d4ee9839b45b601fc8400 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-aaaf493e892d4ee9839b45b601fc8400
I20260709 12:16:50.675662 21738 raft_consensus.cc:1217] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:16:50.676491 22276 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:16:50.693480 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.698144 21035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:16:50.689567 21738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:32994
I20260709 12:16:50.701159 21738 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:50.701555 21738 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.706663 21106 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:50.698663 21035 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:50.707356 21035 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.738971 21741 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:50.740458 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:50.741539 22280 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:50.742055 22280 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:16:50.743007 22280 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:50.757903 21121 tablet_copy_source_session.cc:215] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:50.759339 22261 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:50.760800 22259 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:50.761191 22259 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:50.762003 22259 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:50.765241 21035 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:50.767167 22281 ts_tablet_manager.cc:933] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:16:50.743057 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:50.767755 22259 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.769248 20934 catalog_manager.cc:5697] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 2 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.784416 21035 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:50.768460 22227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaaf493e892d4ee9839b45b601fc8400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:50.794201 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:50.797822 22079 raft_consensus.cc:993] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:50.798403 22079 raft_consensus.cc:1081] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:50.794795 21185 raft_consensus.cc:3055] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:50.799329 21185 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:50.822297 22272 tablet_copy_client.cc:323] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.2:37643
I20260709 12:16:50.842422 21185 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:50.868180 21034 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:50.884961 22278 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:50.890770 22281 tablet_copy_client.cc:323] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.1:42723
I20260709 12:16:50.905719 21185 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.944514 21046 tablet_copy_service.cc:140] P 3ed9deaeb4014e9d87aeebbc6384f81f: Received BeginTabletCopySession request for tablet 40fd334874764b26ba28ac382c4199f8 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:35652)
I20260709 12:16:50.945179 21046 tablet_copy_service.cc:161] P 3ed9deaeb4014e9d87aeebbc6384f81f: Beginning new tablet copy session on tablet 40fd334874764b26ba28ac382c4199f8 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:35652: session id = a1b891e53adc40a6a1ae813238321e93-40fd334874764b26ba28ac382c4199f8
I20260709 12:16:50.952582 21185 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:50.979698 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:50.981424 21104 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.979164 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:50.986963 21121 tablet_copy_service.cc:140] P a62242aa80cd4affa87dc4a3cf6b64ec: Received BeginTabletCopySession request for tablet f16c07bcae284f65a7c0ee0375e00769 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:45970)
I20260709 12:16:50.987586 21121 tablet_copy_service.cc:161] P a62242aa80cd4affa87dc4a3cf6b64ec: Beginning new tablet copy session on tablet f16c07bcae284f65a7c0ee0375e00769 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:45970: session id = a1b891e53adc40a6a1ae813238321e93-f16c07bcae284f65a7c0ee0375e00769
W20260709 12:16:50.997489 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 149403us
I20260709 12:16:51.025739 22190 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:51.054873 22190 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:51.056100 21046 tablet_copy_source_session.cc:215] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:51.055943 22190 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:51.068926 21104 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:51.073762 21121 tablet_copy_source_session.cc:215] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:51.086977 21104 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:51.087985 20933 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.110316 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:51.136246 22272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16c07bcae284f65a7c0ee0375e00769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:51.097586 21738 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:51.152151 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 204323us
I20260709 12:16:51.154997 22268 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 12:16:51.168179 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 199066us
I20260709 12:16:51.187769 21743 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:51.195677 21029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:16:51.196273 21029 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:51.196656 21029 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.201828 22206 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:51.221391 21738 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:51.247942 21030 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:51.265501 22281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fd334874764b26ba28ac382c4199f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:51.333173 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 126381us
I20260709 12:16:51.335988 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:51.336660 21031 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.338335 22227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32994 (request call id 321) took 1028 ms. Trace:
I20260709 12:16:51.375794 21106 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.375129 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:51.368242 22227 rpcz_store.cc:276] 0709 12:16:50.309806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.309913 (+   107us) service_pool.cc:224] Handling call
0709 12:16:50.343791 (+ 33878us) ts_tablet_manager.cc:934] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
0709 12:16:50.767302 (+423511us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:16:51.085643 (+318341us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:51.094367 (+  8724us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:16:51.337610 (+243243us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:16:51.337878 (+   268us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:51.338204 (+   326us) ts_tablet_manager.cc:989] Replica registered.
0709 12:16:51.338258 (+    54us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":57200,"tablet-copy.queue_time_us":1718,"thread_start_us":185922,"threads_started":1}
I20260709 12:16:51.400269 21029 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:51.403771 21035 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:51.405951 21029 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:51.401882 21031 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:51.384150 21027 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.407243 22227 tablet_copy_client.cc:806] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:51.408167 22227 tablet_copy_client.cc:670] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:51.429394 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:51.430269 22280 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:51.434137 21105 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:51.434540 21105 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:51.449537 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:51.459033 21184 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.455258 21105 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:51.468647 21105 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.477488 21103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:16:51.478140 21103 raft_consensus.cc:606] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:16:51.490125 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 53291us
I20260709 12:16:51.492385 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:51.492970 21106 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:51.493244 21106 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:51.494012 21106 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:51.521164 21106 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.541770 22316 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 12:16:51.553380 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 99424.3us
I20260709 12:16:51.543341 22280 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:16:51.553635 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 171727us
I20260709 12:16:51.560586 21106 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:51.560880 21184 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:51.565750 21105 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
W20260709 12:16:51.566201 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 58336.6us
I20260709 12:16:51.571723 22314 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:51.578052 22227 tablet_copy_client.cc:538] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:51.580070 21103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fa56a6078064852ac53dd912136460b"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:16:51.604915 21103 raft_consensus.cc:606] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:51.580552 22280 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:51.587330 20934 catalog_manager.cc:5697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 2, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:51.597332 22289 raft_consensus.cc:1064] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
W20260709 12:16:51.561515 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 73764.7us
I20260709 12:16:51.608542 21002 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:16:51.612455 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:51.619969 22274 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:16:51.664637 21183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:55908
I20260709 12:16:51.643309 22160 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:51.669668 21183 raft_consensus.cc:606] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:51.671631 20931 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.676625 22160 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:51.677516 22160 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:51.679504 22272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32994 (request call id 322) took 1369 ms. Trace:
I20260709 12:16:51.679935 22272 rpcz_store.cc:276] 0709 12:16:50.310114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.311468 (+  1354us) service_pool.cc:224] Handling call
0709 12:16:50.470746 (+159278us) ts_tablet_manager.cc:934] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
0709 12:16:50.669973 (+199227us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9c88a0ac 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a3caa 00007fcb9c8a3bd2 00007fcba4908131
0709 12:16:51.097108 (+427135us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:16:51.430509 (+333401us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:51.430618 (+   109us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:16:51.678640 (+248022us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:16:51.678940 (+   300us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:51.679255 (+   315us) ts_tablet_manager.cc:989] Replica registered.
0709 12:16:51.679411 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":33164,"spinlock_wait_cycles":9802112,"tablet-copy.queue_time_us":148379,"thread_start_us":447995,"threads_started":2}
I20260709 12:16:51.681381 22272 tablet_copy_client.cc:806] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:51.681922 22272 tablet_copy_client.cc:670] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
W20260709 12:16:51.625197 22289 raft_consensus.cc:1068] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Unable to promote non-voter a1b891e53adc40a6a1ae813238321e93: Service unavailable: leader transfer in progress
I20260709 12:16:51.688241 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:51.688912 21027 raft_consensus.cc:606] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:51.695160 22272 tablet_copy_client.cc:538] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:51.695748 22227 tablet_bootstrap.cc:492] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
W20260709 12:16:51.696542 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 74654.9us
I20260709 12:16:51.699440 21186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:55908
I20260709 12:16:51.699941 21186 raft_consensus.cc:606] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:51.705631 22274 raft_consensus.cc:993] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:51.706049 22274 raft_consensus.cc:1081] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:51.707618 21186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:16:51.708079 21186 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:51.708374 21186 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.711156 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:51.712695 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:51.713397 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:51.723101 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 147442us
I20260709 12:16:51.729687 22272 tablet_bootstrap.cc:492] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:51.762528 21186 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:51.772294 21103 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:51.775177 21027 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:51.804675 22281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33006 (request call id 150) took 1204 ms. Trace:
I20260709 12:16:51.805135 22281 rpcz_store.cc:276] 0709 12:16:50.607673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.618933 (+ 11260us) service_pool.cc:224] Handling call
0709 12:16:50.768266 (+149333us) ts_tablet_manager.cc:934] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
0709 12:16:51.263172 (+494906us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:16:51.534317 (+271145us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:51.537133 (+  2816us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:16:51.803916 (+266783us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:16:51.804211 (+   295us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:51.804551 (+   340us) ts_tablet_manager.cc:989] Replica registered.
0709 12:16:51.804613 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":64514,"tablet-copy.queue_time_us":112945,"thread_start_us":98193,"threads_started":2}
I20260709 12:16:51.821300 21186 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:51.824601 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:51.825150 21106 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:51.825415 21106 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:51.786680 22298 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:16:51.807333 22281 tablet_copy_client.cc:806] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:51.833987 21106 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:51.835078 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:51.839648 21034 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.841709 21106 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.844396 22281 tablet_copy_client.cc:670] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
W20260709 12:16:51.840394 22274 consensus_queue.cc:1175] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" responder_term: 1 status { last_received { term: 1 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 2 } }
I20260709 12:16:51.856498 21034 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:51.866117 21106 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:51.872301 21151 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:16:51.873163 22191 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:51.873627 22191 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:51.874519 22191 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:51.881268 22281 tablet_copy_client.cc:538] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:51.881161 22261 raft_consensus.cc:993] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:51.883713 22261 raft_consensus.cc:1081] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:51.900744 21181 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:51.919605 21743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:33006
I20260709 12:16:51.920148 21743 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:51.920490 21743 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.938375 22259 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:51.922762 20933 catalog_manager.cc:5697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:51.945566 22278 raft_consensus.cc:993] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:51.945993 22278 raft_consensus.cc:1081] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:51.956359 21027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:16:51.956928 21027 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:51.957304 21027 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:51.988207 22079 raft_consensus.cc:993] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:51.990302 22079 raft_consensus.cc:1081] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:52.002504 21740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fa56a6078064852ac53dd912136460b"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:32994
I20260709 12:16:52.003134 21740 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:52.003481 21740 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.998971 22281 tablet_bootstrap.cc:492] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:16:52.029289 21027 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:52.037637 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:52.038252 21105 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.044618 21027 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:52.045392 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:52.045967 21186 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:52.046269 21186 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:52.052079 21186 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:52.055356 21186 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:52.065236 21105 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:16:52.068131 20999 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:52.068802 22160 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:52.052035 20933 catalog_manager.cc:5697] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 2 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:52.077251 22160 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:52.078114 22160 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:52.084261 21030 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:52.108044 21186 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:16:52.104923 22315 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:16:52.134321 21743 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:52.193020 22271 raft_consensus.cc:993] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:52.193485 22271 raft_consensus.cc:1081] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:52.175650 21740 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:52.188279 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 54255.5us
I20260709 12:16:52.218680 21106 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:52.222586 21030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:16:52.223167 21030 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:52.223518 21030 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.229743 22298 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:52.236022 21030 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:52.243180 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:52.243439 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:52.243818 21109 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.243162 22272 tablet_bootstrap.cc:492] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:52.251802 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:52.266270 21034 raft_consensus.cc:3055] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:52.266577 21034 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:52.250483 21105 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:52.253723 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:52.268648 21103 raft_consensus.cc:3055] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:52.268972 21103 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:52.254453 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:52.248023 22272 tablet_bootstrap.cc:492] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:52.275839 22272 ts_tablet_manager.cc:1403] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.546s	user 0.030s	sys 0.009s
I20260709 12:16:52.254951 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:52.277540 21180 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.279919 21181 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:52.280269 21181 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:52.285949 21186 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.287611 21103 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:52.258567 22227 tablet_bootstrap.cc:492] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:52.291497 21103 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.289120 21181 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:52.293943 21034 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:52.296636 21034 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.253144 21740 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:52.307708 21034 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:52.312363 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:52.313207 22314 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:52.313668 22314 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:16:52.314492 22314 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:52.317795 22333 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.147s	user 0.000s	sys 0.003s
I20260709 12:16:52.318531 22272 raft_consensus.cc:359] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:52.319383 22272 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:52.320024 22272 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:52.322518 21185 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:52.328152 21180 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:52.332381 21109 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:52.337175 21186 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:52.251933 21743 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:52.247139 21030 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:52.344233 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:52.349188 22160 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:52.355901 21103 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:52.338969 22299 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:16:52.345422 21712 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:52.361306 22315 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:52.361804 22160 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:52.362080 22336 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:52.361832 22315 raft_consensus.cc:697] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:16:52.364046 22160 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:52.364566 22315 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:52.432502 21103 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:16:52.441038 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 69766.2us
I20260709 12:16:52.446696 21181 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.453635 22227 tablet_bootstrap.cc:492] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:52.490182 21181 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:52.493412 22272 ts_tablet_manager.cc:1434] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.217s	user 0.009s	sys 0.000s
I20260709 12:16:52.549593 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-f16c07bcae284f65a7c0ee0375e00769 received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:52.552418 21034 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:16:52.550033 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-f16c07bcae284f65a7c0ee0375e00769 on tablet f16c07bcae284f65a7c0ee0375e00769 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:52.573117 21180 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:52.566165 22227 ts_tablet_manager.cc:1403] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.871s	user 0.019s	sys 0.040s
I20260709 12:16:52.622102 21109 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:52.625443 22269 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.189s
W20260709 12:16:52.708338 22343 log.cc:927] Time spent T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
W20260709 12:16:52.724418 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 71085.6us
I20260709 12:16:52.702009 22227 raft_consensus.cc:359] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:52.734918 22227 raft_consensus.cc:740] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:52.735605 22227 consensus_queue.cc:260] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:52.738343 22227 ts_tablet_manager.cc:1434] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.153s	user 0.007s	sys 0.000s
I20260709 12:16:52.745868 21738 raft_consensus.cc:1217] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:52.746104 22281 tablet_bootstrap.cc:492] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:52.747162 22281 tablet_bootstrap.cc:492] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:16:52.751363 22281 ts_tablet_manager.cc:1403] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.776s	user 0.038s	sys 0.040s
I20260709 12:16:52.751703 20931 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 2 to 3, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 3 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:52.778812 21740 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Advancing to term 2
I20260709 12:16:52.778998 21121 tablet_copy_service.cc:342] P a62242aa80cd4affa87dc4a3cf6b64ec: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-aaaf493e892d4ee9839b45b601fc8400 received from {username='slave'} at 127.0.0.1:45970
I20260709 12:16:52.779405 21121 tablet_copy_service.cc:434] P a62242aa80cd4affa87dc4a3cf6b64ec: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-aaaf493e892d4ee9839b45b601fc8400 on tablet aaaf493e892d4ee9839b45b601fc8400 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:52.813232 22267 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 12:16:52.843375 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 164649us
W20260709 12:16:52.847020 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 146640us
I20260709 12:16:52.863022 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:52.876091 21738 raft_consensus.cc:1217] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:52.876461 22281 raft_consensus.cc:359] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:52.877272 22281 raft_consensus.cc:740] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:16:52.877897 22281 consensus_queue.cc:260] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:52.854190 22278 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:16:52.885744 21183 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:16:52.971370 22358 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:16:53.079162 22281 ts_tablet_manager.cc:1434] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.309s	user 0.006s	sys 0.002s
I20260709 12:16:53.080451 22339 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:16:53.080454 22315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.024s
W20260709 12:16:53.103929 22315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.001s	sys 0.024s
I20260709 12:16:53.149178 21740 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 LEARNER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:16:53.156548 20934 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:53.160753 21108 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:53.160778 21109 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:53.163201 21186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:55908
I20260709 12:16:53.163774 21186 raft_consensus.cc:606] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
W20260709 12:16:53.174860 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 48230.9us
I20260709 12:16:53.163167 20934 catalog_manager.cc:5697] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:53.191547 22268 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:16:53.308946 21032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:53.309646 21032 raft_consensus.cc:606] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:53.264386 21183 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:53.313416 22370 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:16:53.317472 22341 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:16:53.319053 22366 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:16:53.322455 22269 raft_consensus.cc:993] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:53.323009 22269 raft_consensus.cc:1081] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
W20260709 12:16:53.329563 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 72448.7us
I20260709 12:16:53.327056 21108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:16:53.330122 21108 raft_consensus.cc:606] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:53.336501 21740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:32986
I20260709 12:16:53.337088 21740 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:16:53.341944 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 67409.9us
I20260709 12:16:53.345359 21740 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.366973 22323 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:16:53.369549 22351 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:16:53.387758 21032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:53.388365 21032 raft_consensus.cc:606] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:53.416754 21183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:55908
I20260709 12:16:53.417382 21183 raft_consensus.cc:606] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:53.418702 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:53.421339 21742 raft_consensus.cc:1217] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:16:53.462114 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:53.463835 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:53.464972 22207 raft_consensus.cc:1064] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:53.467509 21740 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.486966 22207 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.491189 21740 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:53.495688 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:53.484933 22079 raft_consensus.cc:1064] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:53.496232 21186 raft_consensus.cc:3055] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:53.496541 21186 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:53.497197 21186 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.498118 21186 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.498214 22079 consensus_queue.cc:237] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.503331 20931 catalog_manager.cc:5697] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 2, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:53.523531 21186 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:53.530189 22261 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:16:53.536499 21712 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:53.570180 22336 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:53.570678 22336 raft_consensus.cc:697] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:16:53.577785 22336 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.599870 21746 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:53.601143 22308 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:53.605588 22278 raft_consensus.cc:993] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:53.606070 22278 raft_consensus.cc:1081] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:53.607586 22268 raft_consensus.cc:1064] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:53.609862 22268 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.614411 22298 raft_consensus.cc:993] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:53.614907 22298 raft_consensus.cc:1081] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:53.620579 21741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:33006
I20260709 12:16:53.621153 21741 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:53.621510 21741 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.623569 21186 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:53.625437 21740 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 LEARNER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:16:53.633425 21032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:16:53.633848 21032 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:53.634167 21032 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.641279 21108 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:16:53.643352 21032 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.645445 21032 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:53.647112 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:53.647662 21180 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:53.647953 21180 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:53.648562 21180 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.649578 21180 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.651670 22345 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:53.674142 21032 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:16:53.679888 22278 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:53.683701 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:16:53.684332 21738 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.703635 21180 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:53.711772 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:16:53.722097 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 51989.7us
W20260709 12:16:53.724841 22383 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:16:53.729883 21029 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.756757 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:16:53.767526 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 52582us
I20260709 12:16:53.767168 21741 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.664249 22207 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:16:53.799536 21033 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:53.795816 22261 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:53.801779 21046 tablet_copy_service.cc:342] P 3ed9deaeb4014e9d87aeebbc6384f81f: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-40fd334874764b26ba28ac382c4199f8 received from {username='slave'} at 127.0.0.1:35652
I20260709 12:16:53.916595 21029 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
W20260709 12:16:53.919209 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 196456us
I20260709 12:16:53.915069 22261 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:53.917011 21046 tablet_copy_service.cc:434] P 3ed9deaeb4014e9d87aeebbc6384f81f: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-40fd334874764b26ba28ac382c4199f8 on tablet 40fd334874764b26ba28ac382c4199f8 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:53.921795 22175 raft_consensus.cc:993] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:53.931250 22345 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:53.932350 21741 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:53.976869 21741 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 1 LEARNER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:53.977532 22261 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:53.984364 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:54.001071 21180 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.009233 21180 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:54.003427 22214 raft_consensus.cc:1081] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
W20260709 12:16:54.091641 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 167688us
W20260709 12:16:54.136817 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 44453.2us
W20260709 12:16:54.232110 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 312265us
W20260709 12:16:54.232745 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 281962us
W20260709 12:16:54.234395 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 314535us
I20260709 12:16:54.262996 22267 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.269179 22267 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:54.250716 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 295791us
I20260709 12:16:54.329108 21741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:32994
I20260709 12:16:54.329768 21741 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:54.330209 21741 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.329581 22301 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.359678 22316 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:16:54.369184 21030 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:54.417059 22259 raft_consensus.cc:993] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:54.417579 22259 raft_consensus.cc:1081] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:54.401525 21028 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:16:54.421124 22395 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 12:16:54.426692 21738 consensus_meta.cc:287] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
I20260709 12:16:54.427071 21738 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:54.480786 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:54.442194 21741 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:54.443298 22267 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:54.488969 21029 raft_consensus.cc:3055] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.489475 21029 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:54.489670 21746 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.490348 21029 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:54.491374 21029 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.478308 22356 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:54.493423 22356 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:54.493005 22318 consensus_queue.cc:1059] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:16:54.525789 21029 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:54.526858 22274 raft_consensus.cc:3055] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.527256 22274 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:54.528093 22274 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:54.502372 22356 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:54.436275 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 74488.2us
W20260709 12:16:54.567888 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 210454us
I20260709 12:16:54.528476 20934 catalog_manager.cc:5697] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 2, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.600669 22346 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:54.609395 22268 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:54.618147 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:54.644716 21741 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:54.646927 22259 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:54.644948 22396 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:54.647497 22259 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:54.613543 22278 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:54.648305 22396 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:54.652861 22268 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:54.654064 22190 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:54.654649 22381 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:54.660703 22204 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:54.600972 21712 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:54.669454 21180 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:54.632330 22207 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 12:16:54.681964 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 310729us
I20260709 12:16:54.670262 21183 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:54.636054 22346 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:54.665262 22274 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.671021 22356 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:16:54.678896 22379 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:54.669323 22278 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:54.707439 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:54.711369 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:54.708359 22337 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:54.714242 21027 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:16:54.702447 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 137673us
I20260709 12:16:54.690414 22190 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:54.778512 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:54.748270 22379 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:54.679126 22204 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:54.675441 22381 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
W20260709 12:16:54.841449 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.855695 22345 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:54.856329 22345 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:54.812319 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:54.779299 22259 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:54.863725 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:54.882169 22337 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:16:54.885349 21029 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:54.888944 22415 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:16:54.891407 22396 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:54.892468 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:54.864583 22345 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:16:54.908619 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 98827.8us
W20260709 12:16:54.915725 22393 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:16:54.923534 22426 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:54.924082 22426 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:54.927872 21743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:33006
I20260709 12:16:54.928464 21743 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:54.928835 21743 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.874889 22400 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:16:55.352097 21029 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
W20260709 12:16:55.020452 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 81120.3us
W20260709 12:16:55.048300 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.180743 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.182319 21747 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:55.352075 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:55.340399 22274 consensus_meta.cc:287] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.632s	user 0.001s	sys 0.006s
W20260709 12:16:55.085765 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 201335us
I20260709 12:16:55.355635 22337 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.184863 22408 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:55.257923 22346 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:55.225769 22323 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:55.370144 21711 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:55.132030 22374 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:55.309077 22204 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:55.308393 22375 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:55.256822 22190 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:55.377326 21104 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:54.936568 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:54.935310 22278 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:55.354132 22268 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:55.310374 22379 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:54.935835 21743 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.389179 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:55.365454 22412 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:55.391846 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:55.424930 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54875.9us
I20260709 12:16:55.425397 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:55.382277 22396 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:55.383363 22417 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:55.409008 22346 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:55.455483 22427 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.423138 22381 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:55.439352 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:55.475669 21180 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.492672 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:55.456452 22278 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.430800 22214 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:16:55.391608 22408 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:55.530524 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.409881 22374 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:55.559615 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.432289 22323 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:55.567444 22323 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:55.444619 22375 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:55.570247 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.570948 21180 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:55.573518 21180 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:16:55.578648 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 186555us
I20260709 12:16:55.581460 21186 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:55.528864 22427 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:16:55.530505 22381 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:55.490461 22396 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.575915 22375 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:55.493707 22346 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:55.465655 22417 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:55.584213 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 227861us
I20260709 12:16:55.613858 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.618083 21739 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.618676 21743 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:55.570789 22267 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:55.610345 22381 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:55.620540 22350 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:55.466120 22412 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:55.530596 22278 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.620349 22267 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.614414 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.574765 22316 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:16:55.621100 22350 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:55.625900 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.614699 22190 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:55.640736 22420 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:55.646430 22434 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:55.647053 22434 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.649859 22434 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:55.651010 22434 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:55.627229 22268 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.654328 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:55.654927 21034 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:55.651880 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.667619 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:55.671101 22426 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:55.671197 21179 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.672742 22278 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:55.673200 22424 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:55.675532 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:55.643735 22190 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.674604 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:55.666790 22396 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:55.656993 22268 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.662804 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:55.657608 22420 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.676923 22379 raft_consensus.cc:1064] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:16:55.673694 22424 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.736908 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.685103 21739 raft_consensus.cc:2393] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 2: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:16:55.661325 22427 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:55.760874 22441 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:16:55.687394 22412 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:55.684412 22350 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:55.763803 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 127617us
I20260709 12:16:55.731544 22408 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:16:55.765074 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 122212us
I20260709 12:16:55.768505 21000 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:55.766499 22346 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:55.784534 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 160642us
W20260709 12:16:55.787361 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 127961us
I20260709 12:16:55.770812 22267 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:55.790268 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:55.793068 22442 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:55.793262 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:55.793430 22268 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:55.777925 22190 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:55.797233 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.796170 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:55.798725 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.799688 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:55.793597 22442 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:55.790197 22346 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:55.874285 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.783221 22379 consensus_queue.cc:237] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:56.002339 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 164081us
I20260709 12:16:55.804991 22420 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.070691 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:55.811014 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:56.166373 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:56.173542 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:56.177172 21027 raft_consensus.cc:606] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:56.137651 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:56.135710 22420 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:16:56.195852 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.189167 22190 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.210268 22190 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.166910 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:56.212359 22190 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:56.213383 22439 consensus_queue.cc:1059] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 12:16:56.157050 22323 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:56.249128 22453 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.256369 22424 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.281087 22453 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.287344 22416 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.263998 22420 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.277361 22323 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:56.225337 22412 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:56.287917 22416 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.351691 22416 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.364333 22420 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.366273 22323 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.368965 22453 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:16:56.382350 21179 consensus_meta.cc:287] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.001s
I20260709 12:16:56.383105 21179 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
W20260709 12:16:56.401186 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.406454 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:56.407191 21027 raft_consensus.cc:606] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:56.415469 22420 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.416047 22420 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.417297 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:56.418141 21744 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:56.423729 22416 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.424258 22420 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:56.424794 22416 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.426545 22420 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.428242 22420 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.430430 22416 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:56.400060 22190 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.431716 22190 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:56.433687 22190 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.435257 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81f567d6458f4dddaa94452e04485030"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:16:56.435269 21000 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:56.435952 21027 raft_consensus.cc:606] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:56.439007 22439 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.439433 22439 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.439847 22439 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.406508 22442 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:56.493314 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 874) took 1106 ms. Trace:
I20260709 12:16:56.493834 21029 rpcz_store.cc:276] 0709 12:16:55.386618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.386725 (+   107us) service_pool.cc:224] Handling call
0709 12:16:55.386997 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:55.572548 (+185551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:55.572578 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:55.572620 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:55.572649 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.493012 (+920363us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54000c44d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:56.493059 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.493214 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426296576}
I20260709 12:16:56.496326 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 1531) took 1316 ms. Trace:
I20260709 12:16:56.499172 21186 rpcz_store.cc:276] 0709 12:16:55.180016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.180327 (+   311us) service_pool.cc:224] Handling call
0709 12:16:56.496084 (+1315757us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540015cf54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:16:56.496238 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519234432}
W20260709 12:16:56.502643 22419 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 1.762s	user 0.020s	sys 0.026s
I20260709 12:16:56.503947 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 912) took 2200 ms. Trace:
I20260709 12:16:56.504292 21107 rpcz_store.cc:276] 0709 12:16:54.303673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.317100 (+ 13427us) service_pool.cc:224] Handling call
0709 12:16:54.350313 (+ 33213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:54.350663 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:54.350688 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:54.351615 (+   927us) log.cc:844] Serialized 556 byte log entry
0709 12:16:54.619821 (+268206us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:54.619867 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:54.620007 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:56.501153 (+1881146us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b2400169e68. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c72d9c4 00007fcb9c72bacb 00007fcb9c8e6dc9 00007fcb9c8e6a55 00007fcb9c8e609d 00007fcb9f51810e 00007fcb9f52f88c 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221
0709 12:16:56.503549 (+  2396us) raft_consensus.cc:1685] finished
0709 12:16:56.503569 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.503795 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16218368,"thread_start_us":256645,"threads_started":1,"wal-append.queue_time_us":352529}
I20260709 12:16:56.522316 22381 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:56.541886 21074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.007s	sys 0.009s
I20260709 12:16:56.538380 22427 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:16:56.542198 21002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.005s	sys 0.009s
W20260709 12:16:56.561192 21002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.006s	sys 0.009s
W20260709 12:16:56.560842 21074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.007s	sys 0.010s
W20260709 12:16:56.547772 21152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.012s
W20260709 12:16:56.562071 21152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.005s	sys 0.012s
W20260709 12:16:56.563594 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 802759us
W20260709 12:16:56.571689 21150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.015s
W20260709 12:16:56.572031 21150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.000s	sys 0.015s
W20260709 12:16:56.575103 21034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.028s
I20260709 12:16:56.604195 22440 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:56.604795 22440 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.605634 21741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 194) took 1922 ms. Trace:
W20260709 12:16:56.607148 21034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.010s	sys 0.028s
I20260709 12:16:56.609752 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:56.615787 22458 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.616346 22458 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.617589 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:56.618230 21743 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:56.618621 22458 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:56.606082 21741 rpcz_store.cc:276] 0709 12:16:54.683136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.687421 (+  4285us) service_pool.cc:224] Handling call
0709 12:16:56.604801 (+1917380us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5800004598. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:16:56.605058 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:56.605238 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:56.605265 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:56.605311 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:56.605347 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.605412 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.605543 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3803520}
I20260709 12:16:56.619185 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:56.574172 22427 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:56.623539 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 46146.3us
I20260709 12:16:56.624960 22456 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:56.625101 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:56.625483 22456 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:56.625797 22406 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:56.630344 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:56.631868 22409 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.632369 22409 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.634492 22409 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:56.621587 22440 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:56.621644 22408 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:56.641386 21002 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:56.622980 22453 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.658197 22446 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:56.650435 22416 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.647282 22440 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:56.665005 22461 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.646629 22406 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.665553 22461 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.673429 22461 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.674443 22455 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.648227 22408 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:56.678442 22451 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:16:56.654439 22453 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:56.679832 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 928) took 1298 ms. Trace:
I20260709 12:16:56.669414 22440 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:56.674584 22439 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.667966 22416 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.675081 22455 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:56.661557 22446 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:56.964263 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 1600) took 1042 ms. Trace:
I20260709 12:16:56.747248 22460 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.775380 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 876) took 1387 ms. Trace:
I20260709 12:16:56.969344 21028 rpcz_store.cc:276] 0709 12:16:55.922124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.004175 (+ 82051us) service_pool.cc:224] Handling call
0709 12:16:56.946962 (+942787us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b5800003698. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:16:56.947200 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:56.947386 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:56.947418 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:56.953708 (+  6290us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:56.962412 (+  8704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.964047 (+  1635us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.964195 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10516864}
I20260709 12:16:56.876426 22462 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:16:56.830749 21077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.019s	sys 0.062s
I20260709 12:16:56.874099 22079 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:56.775789 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:56.880406 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.947114 22468 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.968425 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:56.968538 21110 rpcz_store.cc:276] 0709 12:16:55.381788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.381904 (+   116us) service_pool.cc:224] Handling call
0709 12:16:55.383306 (+  1402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:55.642083 (+258777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:55.642109 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:55.642146 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:55.642171 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.679590 (+1037419us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b540041ffd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:56.679629 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.679757 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594737920}
W20260709 12:16:56.771755 21104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 62) took 2049 ms (client timeout 1978 ms). Trace:
W20260709 12:16:56.971135 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 329799us
I20260709 12:16:56.975162 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1040) took 1551 ms. Trace:
W20260709 12:16:56.973194 21077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.019s	sys 0.074s
I20260709 12:16:56.806015 21737 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:56.900207 22467 raft_consensus.cc:993] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:56.975829 21106 rpcz_store.cc:276] 0709 12:16:55.427134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.427418 (+   284us) service_pool.cc:224] Handling call
0709 12:16:56.775647 (+1348229us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b5800187b98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:16:56.975106 (+199459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3807616}
I20260709 12:16:56.757395 22456 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.932762 22190 raft_consensus.cc:3055] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:56.933053 22397 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.976984 22079 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:56.970127 22455 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:56.879364 22353 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:56.980940 21739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32986 (request call id 198) took 1185 ms. Trace:
W20260709 12:16:56.976432 21104 rpcz_store.cc:269] 0709 12:16:54.705372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.705471 (+    99us) service_pool.cc:224] Handling call
0709 12:16:56.754285 (+2048814us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b5400240c54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:16:56.754388 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341938560}
I20260709 12:16:56.988910 21746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 178) took 2079 ms. Trace:
I20260709 12:16:56.989324 21746 rpcz_store.cc:276] 0709 12:16:54.909607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.359816 (+450209us) service_pool.cc:224] Handling call
0709 12:16:55.364474 (+  4658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:55.370564 (+  6090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:55.370593 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:55.370634 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:55.370663 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.986736 (+1616073us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b540005e954. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:56.986781 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.988858 (+  2077us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13581056}
I20260709 12:16:56.807193 22417 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:56.991701 22308 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:56.992175 22308 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:56.993182 22079 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:56.993693 22079 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:56.730787 22427 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.991065 22426 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.688766 22312 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:56.970701 22446 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.972786 21032 rpcz_store.cc:276] 0709 12:16:55.387736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.387833 (+    97us) service_pool.cc:224] Handling call
0709 12:16:56.774696 (+1386863us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b5800003698. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:16:56.774913 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:56.775084 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:56.775108 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:56.775148 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:56.775178 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.775228 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.775327 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19359104}
I20260709 12:16:56.752395 22430 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.003001 22430 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.747937 22406 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:56.807476 22408 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.004858 22420 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.996344 22426 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.007736 22426 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.759572 22453 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.007900 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.003670 22430 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.008549 21746 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEARNER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:16:56.995354 22308 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:56.988242 22353 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.002856 22346 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:56.988387 21739 rpcz_store.cc:276] 0709 12:16:55.795814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.800675 (+  4861us) service_pool.cc:224] Handling call
0709 12:16:56.968247 (+1167572us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x7b5800004598. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:16:56.980860 (+ 12613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183326976}
I20260709 12:16:56.966759 22412 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:56.989089 22190 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:57.020848 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:57.009444 22079 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.007920 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.008392 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.011790 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.012374 21737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 183) took 2075 ms. Trace:
I20260709 12:16:57.014142 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.017282 22274 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.018105 21712 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:57.019055 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.022742 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:56.990460 22462 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.017850 22397 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.139969 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1165) took 1644 ms. Trace:
I20260709 12:16:57.162329 22175 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.146803 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.025274 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.152148 22191 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:56.975857 22468 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.162097 21182 rpcz_store.cc:276] 0709 12:16:55.481974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.482938 (+   964us) service_pool.cc:224] Handling call
0709 12:16:56.498875 (+1015937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:56.499071 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:56.499096 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:56.499139 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:56.499166 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:56.499218 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:57.119706 (+620488us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540015cf50. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:16:57.119839 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330470272}
I20260709 12:16:57.061339 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:57.118530 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 97751.3us
I20260709 12:16:57.131331 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.133008 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.129540 21027 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.061898 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.157158 21032 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:57.167761 21028 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:57.170572 22191 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.176337 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:16:57.176873 22389 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.020340 22467 raft_consensus.cc:1081] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:57.170763 22175 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.140192 22335 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.019770 22420 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:57.178298 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:57.179333 21177 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:57.181953 22079 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.150264 22436 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.167878 22439 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:57.179710 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:57.079362 22416 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.173663 21034 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:57.192126 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:57.078709 22456 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:16:57.187765 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.181136 22406 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.151898 22417 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.152024 22455 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:57.176229 21151 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:57.141542 22453 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:57.140034 22278 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:57.026160 21183 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 1.
I20260709 12:16:57.141002 22473 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.193758 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.196674 22175 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.197520 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:57.199504 22444 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.207244 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.184268 22427 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.210093 22175 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.209327 21181 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:57.035133 22412 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.188689 22308 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.208077 21744 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:57.190958 21739 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.182874 22429 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:16:57.181514 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 163446us
I20260709 12:16:57.210657 21177 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:57.200387 22405 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.021894 22312 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:57.194427 21709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.978s (SENT) [suppressed 2 similar messages]
I20260709 12:16:57.195304 22374 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.206437 22455 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.210573 22175 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.209815 22456 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.183260 22389 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.254236 21106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:16:57.264477 21106 raft_consensus.cc:606] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:57.157517 21737 rpcz_store.cc:276] 0709 12:16:54.936922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.958035 (+ 21113us) service_pool.cc:224] Handling call
0709 12:16:55.086122 (+128087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:56.987010 (+1900888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.012103 (+ 25093us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540006de54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:57.012321 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3928702848}
I20260709 12:16:57.170325 22274 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.193831 22335 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.267009 22335 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.267581 22465 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.219135 22353 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:57.248294 22462 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.249816 22412 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:57.198936 22420 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.202548 22406 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.256412 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.219332 22397 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.206169 22417 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:57.360492 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 103878us
I20260709 12:16:57.209442 22278 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.241212 22468 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.208341 22453 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.325577 22354 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.252581 22259 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:16:57.325187 22213 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.244534 22437 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.246102 22416 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:57.253305 22191 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.346092 22335 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:57.201375 22190 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.326069 22440 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.257694 22350 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.243309 22308 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.263808 22427 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:16:57.365121 21105 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:57.263597 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.243628 22444 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.202775 22436 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.268146 22465 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.269410 22429 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.360101 22435 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.372731 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.616237 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.618614 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.620090 21177 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:57.622555 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:57.632680 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:57.623104 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 222897us
I20260709 12:16:57.623376 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.514379 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.625411 22437 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.377568 22430 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.627214 22406 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.627524 22190 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.627972 22456 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.640792 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.497602 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.338915 22160 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:57.513743 22474 raft_consensus.cc:993] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:57.541316 22381 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:57.470613 22379 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:57.699445 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.367105 22323 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.479935 22382 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:57.317595 22405 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.600526 22278 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:57.528219 22267 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:57.625954 22453 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:16:57.417098 22354 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.705603 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.414522 22462 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.375006 22353 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.633116 22335 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.627205 22465 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.527030 22390 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:57.624562 22350 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:57.712890 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 351179us
I20260709 12:16:57.638316 22417 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.693081 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.686028 22455 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:57.703372 22160 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.760696 21109 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:57.640547 22374 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:57.763115 22382 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.772440 22353 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.779925 21033 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:57.763360 22267 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.780906 22350 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.769282 22462 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.781783 22390 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.783068 22462 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.776825 21075 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:57.700312 22439 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.416463 21179 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 1.
I20260709 12:16:57.632906 22416 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.772212 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.754002 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.777048 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.764009 22354 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.764801 22375 raft_consensus.cc:1081] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:16:57.786579 20934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 111) took 3251 ms. Trace:
I20260709 12:16:57.778546 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.791770 22436 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.793323 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:57.788985 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 152438us
I20260709 12:16:57.769840 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:57.793988 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 193894us
I20260709 12:16:57.793877 21185 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:57.770377 22312 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.739122 22379 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.731987 22381 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.800953 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.685004 22213 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.777428 22429 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.755812 22323 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.780912 22353 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.802325 21185 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
W20260709 12:16:57.775852 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 581400us
I20260709 12:16:57.805289 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.827308 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.827908 21182 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:57.827983 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.828179 22308 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.829118 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.829607 22335 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.830192 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.797895 21712 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:57.788180 22406 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.800537 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.809998 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.799746 22436 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.841230 21034 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:57.790385 20934 rpcz_store.cc:276] 0709 12:16:54.525088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.525542 (+   454us) service_pool.cc:224] Handling call
0709 12:16:57.776637 (+3251095us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:55.111438 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:55.111972 (+   534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:55.112010 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:16:55.112026 (+    16us) tablet.cc:662] Decoding operations
0709 12:16:55.112325 (+   299us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:55.112378 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:55.112404 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:55.112590 (+   186us) tablet.cc:701] Row locks acquired
0709 12:16:55.112603 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:16:55.112731 (+   128us) write_op.cc:270] Start()
0709 12:16:55.112828 (+    97us) write_op.cc:276] Timestamp: P: 1783599415112689 usec, L: 0
0709 12:16:55.112850 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:16:55.113451 (+   601us) log.cc:844] Serialized 532 byte log entry
0709 12:16:55.661208 (+547757us) op_driver.cc:464] REPLICATION: finished
0709 12:16:55.805184 (+143976us) write_op.cc:301] APPLY: starting
0709 12:16:55.827472 (+ 22288us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:56.068196 (+240724us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:56.157645 (+ 89449us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:56.222575 (+ 64930us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:56.222738 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:16:56.222782 (+    44us) write_op.cc:312] APPLY: finished
0709 12:16:56.223025 (+   243us) log.cc:844] Serialized 22 byte log entry
0709 12:16:56.223195 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:56.223276 (+    81us) write_op.cc:454] Released schema lock
0709 12:16:56.223312 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:56.223699 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:56.223724 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2234,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":128526,"apply.run_cpu_time_us":3030,"apply.run_wall_time_us":421328,"num_ops":1,"prepare.queue_time_us":491514,"prepare.run_cpu_time_us":56090,"prepare.run_wall_time_us":351136,"raft.queue_time_us":11886,"raft.run_cpu_time_us":8404,"raft.run_wall_time_us":148080,"replication_time_us":530301,"spinlock_wait_cycles":2000640,"thread_start_us":587576,"threads_started":4,"wal-append.queue_time_us":447803,"wal-append.run_cpu_time_us":10663,"wal-append.run_wall_time_us":1667552}]]}
I20260709 12:16:57.802235 21107 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:16:57.813673 22405 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.814493 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.826433 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.846167 21185 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:57.840677 22406 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:57.847378 22406 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.831645 21029 raft_consensus.cc:2410] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:16:57.843847 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.846995 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.849037 21185 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:57.849304 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.849779 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.801236 22390 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.794554 22439 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.850358 21185 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:16:57.815596 22389 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:57.852265 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.854971 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.858953 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.788584 22427 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:57.830776 21178 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:58.230901 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.165133 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.225919 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.952256 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.236397 21185 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:58.175436 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.912985 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.236125 21180 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:58.237493 21035 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:58.182698 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.055110 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:16:57.955534 21739 consensus_meta.cc:287] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.000s
W20260709 12:16:58.119547 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.163985 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:57.953725 22175 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.236477 21029 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:57.940470 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.234158 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.243345 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.244320 21149 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:58.175412 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:57.991108 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 95261.1us
I20260709 12:16:58.253744 21033 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 2: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:58.175249 22312 consensus_queue.cc:1059] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:16:57.941411 22213 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:58.256542 22465 raft_consensus.cc:3055] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:16:58.254315 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 90428.5us
I20260709 12:16:58.105886 22259 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.257324 22487 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.257776 22487 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:58.161010 22430 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:58.258162 22487 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.197362 22426 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.258333 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.162076 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:58.259366 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.261502 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:57.855988 22418 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:58.265776 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.920769 22390 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.253175 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:58.266458 21033 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 2: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:58.254595 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:58.053483 21712 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:57.937000 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.254777 22175 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.257414 22259 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:58.067276 22261 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.197201 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.259873 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.257519 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.261907 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.197438 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 1607) took 1879 ms. Trace:
I20260709 12:16:57.949245 22389 raft_consensus.cc:993] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:58.161465 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:57.939190 22274 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.265308 21747 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:57.880802 22420 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.054718 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:58.256505 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 316104us
I20260709 12:16:58.277984 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:57.940670 22471 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:57.944104 22379 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:57.949605 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.264551 22418 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:57.943048 22323 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:58.404851 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.329814 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.278918 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:58.351478 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 96930.4us
I20260709 12:16:58.498191 21036 rpcz_store.cc:276] 0709 12:16:56.318365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.017256 (+698891us) service_pool.cc:224] Handling call
0709 12:16:57.017522 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.183891 (+166369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.183919 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.183956 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.183994 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.197205 (+1013211us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54000811d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:58.197255 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.197377 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382206336}
I20260709 12:16:58.499326 22175 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:58.518294 21029 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 1.
I20260709 12:16:58.519735 20999 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.510890 21744 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:58.497784 21027 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:57.848227 22436 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:58.253983 22416 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:57.872686 22437 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.250561 22381 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:58.257045 22465 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:58.413575 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:58.411978 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 48950us
I20260709 12:16:58.300559 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.325115 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.519804 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.254660 22411 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.337991 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:58.511495 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.520714 22175 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.521518 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.270386 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.279058 22439 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:58.516070 21031 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 1.
I20260709 12:16:58.523905 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.264711 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.412506 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.516239 22389 raft_consensus.cc:1081] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:16:58.250792 21739 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:58.414436 22469 raft_consensus.cc:993] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:58.630021 22469 raft_consensus.cc:1081] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Signalling peer a1b891e53adc40a6a1ae813238321e93 to start an election
I20260709 12:16:58.631482 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.634361 22267 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.635097 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.634511 22308 raft_consensus.cc:2955] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:58.497370 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.407706 22445 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.325040 22455 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:16:58.518913 22190 consensus_meta.cc:287] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.833s	user 0.003s	sys 0.007s
I20260709 12:16:58.484457 22382 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:58.525470 22420 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.610818 21033 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 1.
W20260709 12:16:58.518450 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 465023us
I20260709 12:16:58.335580 22374 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:58.531069 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:16:58.530068 22323 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.321382 22390 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:58.530802 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.531986 21180 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:58.618474 21028 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:58.619060 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.650346 21181 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
W20260709 12:16:58.623560 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 285647us
I20260709 12:16:58.643916 22420 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.629487 21739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33006 (request call id 193) took 1457 ms. Trace:
I20260709 12:16:58.641754 22445 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:58.655722 21181 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:16:58.519749 22261 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:58.638990 21746 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:58.613538 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 82181.4us
I20260709 12:16:58.639945 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:58.624938 21107 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:58.640857 22259 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.624619 22432 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.644683 21075 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:58.646750 21035 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
W20260709 12:16:58.649055 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 118320us
I20260709 12:16:58.667752 20999 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.669078 20999 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.651759 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.517328 22471 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:58.642776 21743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
 from {username='slave'} at 127.0.0.1:33006
I20260709 12:16:58.659497 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.660420 21181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81f567d6458f4dddaa94452e04485030"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:16:58.651302 22190 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.654564 22420 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.652596 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.658030 22445 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.645478 22455 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:58.646472 22374 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:58.675873 20999 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:58.661201 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.644912 22465 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:58.653791 21739 rpcz_store.cc:276] 0709 12:16:57.172270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.176089 (+  3819us) service_pool.cc:224] Handling call
0709 12:16:58.629426 (+1453337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:58.672797 22335 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:58.674764 22274 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.693257 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.680773 21743 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.674491 22382 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:58.689370 22496 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:16:58.690153 22497 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:16:58.672683 22411 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.698411 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.701762 21033 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:58.684023 22418 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:58.688654 22190 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.698375 21743 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.712886 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.713168 22436 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:58.713373 22190 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:58.713809 22190 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.715080 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.715116 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 944) took 1334 ms. Trace:
W20260709 12:16:58.716692 22477 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.943s	user 0.004s	sys 0.002s
I20260709 12:16:58.717315 21712 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:58.717924 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1533) took 1587 ms. Trace:
I20260709 12:16:58.718289 21186 rpcz_store.cc:276] 0709 12:16:57.130069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.132034 (+  1965us) service_pool.cc:224] Handling call
0709 12:16:57.132496 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:57.168832 (+ 36336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.168859 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:57.171251 (+  2392us) log.cc:844] Serialized 556 byte log entry
0709 12:16:57.263055 (+ 91804us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:57.263078 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.263132 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:58.716078 (+1452946us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:16:58.717663 (+  1585us) raft_consensus.cc:1685] finished
0709 12:16:58.717683 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.717870 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26855680,"thread_start_us":91583,"threads_started":1,"wal-append.queue_time_us":535735}
I20260709 12:16:58.719740 22465 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.723435 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.730419 22259 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.716825 21103 rpcz_store.cc:276] 0709 12:16:57.380573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.380698 (+   125us) service_pool.cc:224] Handling call
0709 12:16:57.380989 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.781100 (+400111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.781128 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.781168 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.781196 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.714883 (+933687us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b5400180954. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:58.714928 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.715057 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919724288}
I20260709 12:16:58.733788 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:58.734468 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.734802 21181 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.735960 21181 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.692822 22274 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:58.739022 22274 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.740099 22458 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.740517 22458 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.740828 22458 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.731247 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.735337 21103 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:58.695741 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.753679 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:58.731293 22382 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.775660 22435 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.775513 22382 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:58.776183 22435 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.777560 22418 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.780405 22418 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:58.780668 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.781505 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 954) took 1026 ms. Trace:
I20260709 12:16:58.777387 22335 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.782153 22335 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:58.782822 22494 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.621s	user 0.001s	sys 0.000s
I20260709 12:16:58.789490 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.792274 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.798951 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 943) took 1429 ms. Trace:
I20260709 12:16:58.802623 21106 rpcz_store.cc:276] 0709 12:16:57.369560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.370148 (+   588us) service_pool.cc:224] Handling call
0709 12:16:57.370371 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.432599 (+ 62228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.432633 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.432680 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.432711 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.798715 (+1366004us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b5400137ed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:58.798760 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.798894 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103817600}
I20260709 12:16:58.803889 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.799610 21105 rpcz_store.cc:276] 0709 12:16:57.754684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.780370 (+1025686us) service_pool.cc:224] Handling call
0709 12:16:58.781414 (+  1044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:58.811619 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.787622 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.812587 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.812956 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.791709 22444 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.801028 21110 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:58.814106 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:58.814445 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 958) took 1008 ms. Trace:
I20260709 12:16:58.814769 21110 rpcz_store.cc:276] 0709 12:16:57.806511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.791999 (+985488us) service_pool.cc:224] Handling call
0709 12:16:58.814391 (+ 22392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:58.815359 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.815578 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.816574 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.819993 22426 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:58.824584 22426 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.828109 21000 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:16:58.828255 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 94529.5us
I20260709 12:16:58.828598 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.828984 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.828815 22160 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:58.830392 21105 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:58.755646 21103 raft_consensus.cc:2376] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2. Re-sending same reply.
I20260709 12:16:58.832624 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.833336 21111 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
W20260709 12:16:58.835721 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 94174.8us
W20260709 12:16:58.840548 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.849407 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 947) took 1369 ms. Trace:
I20260709 12:16:58.853020 22160 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.853370 21111 rpcz_store.cc:276] 0709 12:16:57.480035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.834084 (+1354049us) service_pool.cc:224] Handling call
0709 12:16:58.834412 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:58.848679 (+ 14267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.848713 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:58.848762 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:58.848796 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.849233 (+   437us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.849354 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:58.852272 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 946) took 1381 ms. Trace:
I20260709 12:16:58.855059 21103 rpcz_store.cc:276] 0709 12:16:57.471161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.851564 (+1380403us) service_pool.cc:224] Handling call
0709 12:16:58.851839 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:58.851992 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.852014 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:58.852049 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:58.852074 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.852131 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.852220 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:58.855670 22160 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.856184 22160 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:58.856635 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 64) took 1071 ms. Trace:
I20260709 12:16:58.827140 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.858210 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.856977 21103 rpcz_store.cc:276] 0709 12:16:57.785662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.855887 (+1070225us) service_pool.cc:224] Handling call
0709 12:16:58.856169 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:58.856324 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.856357 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:58.856420 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:58.856448 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.856495 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.856589 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:58.797133 22501 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:16:58.863938 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.864567 21033 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
W20260709 12:16:58.863781 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 190658us
I20260709 12:16:58.865475 21103 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:58.857735 22204 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:58.798569 21737 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:58.873216 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.868527 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.874050 21033 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:58.871528 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.874869 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.872550 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:58.866973 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 190004us
I20260709 12:16:58.872807 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.876315 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.877266 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:58.878509 22354 consensus_meta.cc:287] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 1.078s	user 0.011s	sys 0.005s
I20260709 12:16:58.879074 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.880175 22471 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.871747 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.881788 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.878907 22354 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:58.730969 22259 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:58.883798 21181 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:58.885124 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.886961 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.909988 21029 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:58.883824 21105 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:58.919081 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.919202 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.919735 21034 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:58.919991 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 951) took 1283 ms. Trace:
I20260709 12:16:58.920594 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.921144 21034 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:58.883154 22455 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:58.922116 22390 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:58.922274 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.922859 21027 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:58.921890 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.925437 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:58.920353 21104 rpcz_store.cc:276] 0709 12:16:57.636184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.918952 (+1282768us) service_pool.cc:224] Handling call
0709 12:16:58.919924 (+   972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:58.927196 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:16:58.869261 22406 consensus_meta.cc:287] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 1.021s	user 0.012s	sys 0.006s
I20260709 12:16:58.922772 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:16:58.858810 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 141565us
I20260709 12:16:58.926529 21105 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
W20260709 12:16:58.929385 21151 connection.cc:256] RPC call timeout handler was delayed by -1.6700500770000417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 12:16:58.936709 21151 connection.cc:256] RPC call timeout handler was delayed by -1.6340500769999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:16:58.937045 21151 connection.cc:256] RPC call timeout handler was delayed by -1.5899500770001396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 12:16:58.926062 21034 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:58.937158 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 68) took 1025 ms. Trace:
I20260709 12:16:58.932703 22160 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.933218 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.934073 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.938441 21032 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:58.939123 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:58.930823 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.871219 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.945425 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.939241 22160 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.933422 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:58.929320 21027 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:58.879432 22335 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:58.870052 22204 raft_consensus.cc:697] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:58.869583 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.869671 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:58.940330 21105 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:58.940510 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.951212 21032 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:58.872925 22374 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:58.947414 21033 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:58.946574 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.949397 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.966602 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.967772 20999 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.968900 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.903648 22505 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:58.953665 21746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 420) took 1740 ms. Trace:
I20260709 12:16:58.965330 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.971580 21746 rpcz_store.cc:276] 0709 12:16:57.213142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.213256 (+   114us) service_pool.cc:224] Handling call
0709 12:16:58.636199 (+1422943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:58.660933 (+ 24734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.953457 (+292524us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400582fd0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:16:58.953603 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3271799680}
I20260709 12:16:58.970901 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.972316 21032 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 1.
I20260709 12:16:58.973744 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.974505 22160 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.974799 21034 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:16:58.976033 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:58.976881 22381 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:58.977788 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55074.8us
I20260709 12:16:58.979194 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:58.977802 22512 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.977826 20999 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:58.980167 22512 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:58.980553 22512 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.981539 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.932281 22382 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.983824 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:58.980786 22379 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:58.985360 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 942) took 1616 ms. Trace:
I20260709 12:16:58.934567 22469 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:58.986931 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:58.941236 22390 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:58.985136 22433 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.989825 22204 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:58.990401 22335 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.982553 22411 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.982410 22439 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.982468 22455 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.991436 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.972575 21030 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:58.967826 22323 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.992362 22379 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:16:59.043634 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 105956us
I20260709 12:16:58.986299 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 956) took 1196 ms. Trace:
I20260709 12:16:59.044322 21111 rpcz_store.cc:276] 0709 12:16:57.785125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.854414 (+1069289us) service_pool.cc:224] Handling call
0709 12:16:58.854715 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:58.905131 (+ 50416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.917322 (+ 12191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:58.933979 (+ 16657us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:58.936799 (+  2820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.943366 (+  6567us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.981197 (+ 37831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:58.967502 22261 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:58.936517 22406 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.049135 22406 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:16:58.991313 22502 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:16:59.043653 22323 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:59.050395 22323 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:59.036140 22490 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.845s	user 0.002s	sys 0.000s
I20260709 12:16:59.038182 21032 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 1.
I20260709 12:16:59.051285 21109 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:59.032366 22449 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.986177 21031 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:16:59.020593 22444 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.023149 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.028141 22471 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.025887 22485 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:59.045475 21151 connection.cc:256] RPC call timeout handler was delayed by -1.5035500769999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260709 12:16:59.030056 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.046790 22379 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.051776 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:58.992520 21108 rpcz_store.cc:276] 0709 12:16:57.369316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.369725 (+   409us) service_pool.cc:224] Handling call
0709 12:16:57.369992 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:57.781471 (+411479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:57.781498 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:57.781534 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:57.781566 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.985154 (+1203588us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54002530d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:58.985198 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.985310 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945925376}
I20260709 12:16:59.060118 21108 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:16:59.037330 22418 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:16:59.056758 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 145432us
W20260709 12:16:59.062281 21151 connection.cc:256] RPC call timeout handler was delayed by -1.2443500770000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:16:59.062734 21151 connection.cc:256] RPC call timeout handler was delayed by -1.2398500770000283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 12:16:58.980657 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 47321.1us
I20260709 12:16:58.986788 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.063594 21032 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:59.069113 21032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:16:58.980027 21076 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:59.056143 22175 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.070477 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.058151 21034 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
W20260709 12:16:59.052006 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 65184.5us
I20260709 12:16:59.063225 21711 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.071604 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.030458 22469 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.065356 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.065689 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.070912 21106 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:59.052984 22449 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:59.066638 22483 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:59.054684 22444 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.083046 21077 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:59.082042 22175 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.057461 22471 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:59.084824 21711 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:16:59.060532 22467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.041s	sys 0.038s
W20260709 12:16:59.086149 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 106195us
I20260709 12:16:59.087657 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.059278 22485 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.088953 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:16:59.093781 22487 consensus_meta.cc:287] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.004s
I20260709 12:16:59.095746 22487 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.085675 22259 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.101166 22175 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.101658 22175 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:59.101243 21076 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:59.102221 22175 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:59.103847 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 111766us
I20260709 12:16:59.073017 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.052083 22390 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:16:59.084034 22449 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.080314 22261 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.091136 22485 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.108220 21076 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:59.109993 21183 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 2: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:59.086961 22444 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.111835 21177 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:59.119328 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:59.107745 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 139237us
I20260709 12:16:58.937510 21036 rpcz_store.cc:276] 0709 12:16:57.911699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.526937 (+615238us) service_pool.cc:224] Handling call
0709 12:16:58.527248 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:58.527444 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:16:58.674467 (+147023us) log.cc:844] Serialized 14 byte log entry
0709 12:16:58.936874 (+262407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:58.936919 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:58.936953 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.937019 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.937111 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1360,"prepare.queue_time_us":235020,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":48102,"raft.queue_time_us":1454,"thread_start_us":401980,"threads_started":2}
I20260709 12:16:59.285694 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.287441 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.289794 21036 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:59.291690 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.283650 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.297560 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.137801 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:16:59.300336 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 162488us
I20260709 12:16:59.301059 21031 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:59.301743 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:59.280934 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.303527 21030 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:59.304972 21076 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:59.312175 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:16:59.312492 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 229400us
I20260709 12:16:59.313747 21077 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:59.313954 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.224933 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 959) took 1231 ms. Trace:
I20260709 12:16:59.315411 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.317576 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.310305 21036 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:59.318946 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.320438 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.321703 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.315399 21103 rpcz_store.cc:276] 0709 12:16:57.993479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.864955 (+871476us) service_pool.cc:224] Handling call
0709 12:16:58.865209 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:58.865381 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:59.063153 (+197772us) log.cc:844] Serialized 14 byte log entry
0709 12:16:59.224642 (+161489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:59.224689 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:59.224728 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.224788 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:59.224884 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5813,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":161192,"threads_started":1,"wal-append.queue_time_us":188644}
I20260709 12:16:59.324565 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.325701 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.229717 21110 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
W20260709 12:16:59.234608 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 149852us
I20260709 12:16:59.333240 21149 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:59.333963 21711 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.211592 22175 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:59.227483 22190 consensus_meta.cc:287] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.012s
W20260709 12:16:59.366670 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 53050us
I20260709 12:16:59.216076 22335 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:59.373158 22335 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.137094 22354 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.227222 22406 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.086571 22416 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.380981 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.380898 22416 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:16:59.251055 22420 consensus_meta.cc:287] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.020s
I20260709 12:16:59.382627 20930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49682 (request call id 216) took 2205 ms. Trace:
I20260709 12:16:59.382778 22420 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.383229 20930 rpcz_store.cc:276] 0709 12:16:57.176875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.177039 (+   164us) service_pool.cc:224] Handling call
0709 12:16:59.382287 (+2205248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336960,"reported_tablets":4}
I20260709 12:16:59.385059 22525 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.385623 22525 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.386094 22525 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.122139 22426 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:59.391805 21743 consensus_meta.cc:287] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.037s
I20260709 12:16:59.392355 22426 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.393364 22426 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.393791 22426 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:59.394261 21742 raft_consensus.cc:2955] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:16:59.398078 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.214913 22436 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:16:59.245982 22445 consensus_meta.cc:287] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.012s
I20260709 12:16:59.401124 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:16:59.401877 22335 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.206580 22444 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.248704 22449 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:59.103770 22467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.042s	sys 0.038s
I20260709 12:16:59.251325 22469 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:59.409929 22435 consensus_meta.cc:287] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.006s
I20260709 12:16:59.091598 22471 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.429546 22527 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.123056 22499 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:59.251802 22512 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.439473 22499 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.441056 22512 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.401177 22445 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.090364 22509 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.443626 22445 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.125555 22510 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.326793 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.445428 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.351394 22528 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:59.349226 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:59.352752 22274 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.613s	user 0.014s	sys 0.010s
I20260709 12:16:59.363517 22465 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:59.238479 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:16:59.449882 21034 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:59.363888 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 156233us
I20260709 12:16:59.451097 22510 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.451231 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 65) took 1664 ms. Trace:
I20260709 12:16:59.451685 21106 rpcz_store.cc:276] 0709 12:16:57.788242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.860815 (+1072573us) service_pool.cc:224] Handling call
0709 12:16:58.861079 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.073967 (+212888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.413139 (+339172us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400369cd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:59.451037 (+ 37898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482031872}
I20260709 12:16:59.453171 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.363883 22521 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.453976 22521 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:59.454399 22521 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.454548 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.455138 22465 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.456043 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.457281 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.457423 22465 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.457958 22436 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:59.458559 22436 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.363835 22519 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:59.458768 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.459142 22519 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:59.459683 22519 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.367921 22190 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.392208 21743 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.375144 22511 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:59.465087 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:16:59.465404 22483 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.465512 22511 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.465827 21744 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:59.466094 22511 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.394198 22426 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.409756 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:59.416648 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 69) took 1611 ms. Trace:
I20260709 12:16:59.406625 22449 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.419752 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:59.420151 21740 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.418535 21027 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:16:59.420785 21111 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.428124 22420 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.428853 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:16:59.429240 21183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 1544) took 2209 ms (client timeout 1922 ms). Trace:
W20260709 12:16:59.435415 22458 consensus_meta.cc:287] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.008s
I20260709 12:16:59.437230 21181 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.442745 21184 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:16:59.429997 22308 consensus_meta.cc:287] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.780s	user 0.009s	sys 0.018s
I20260709 12:16:59.469378 21109 rpcz_store.cc:276] 0709 12:16:57.805195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.254759 (+449564us) service_pool.cc:224] Handling call
0709 12:16:59.416214 (+1161455us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54002535d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:16:59.416469 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814633728}
I20260709 12:16:59.449322 22528 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.461345 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.451610 22510 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.470134 22274 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.481663 22503 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.482110 22503 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:16:59.482471 22503 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:59.474524 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 64959us
W20260709 12:16:59.475262 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55735.1us
I20260709 12:16:59.475696 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.476212 22323 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.475236 22458 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.477370 21028 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 2: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:59.477905 22190 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.479627 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.461272 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:16:59.471993 21183 rpcz_store.cc:269] 0709 12:16:57.219656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.253566 (+ 33910us) service_pool.cc:224] Handling call
0709 12:16:58.161335 (+907769us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86feee 000000000036eb39 00007fcba48e31e0 00007fcba49ac0c4 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:16:59.428803 (+1267468us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54003fc354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:16:59.429035 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386696448}
I20260709 12:16:59.410662 22435 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:16:59.478894 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 57300.8us
I20260709 12:16:59.481665 21178 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.487053 21105 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.491884 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:16:59.491954 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 158470us
I20260709 12:16:59.480792 22528 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.484262 22465 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.493523 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.488420 22499 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.492913 21743 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.511756 22382 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:16:59.517688 22458 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.471797 22527 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.519960 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.520852 21110 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:59.511397 22274 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:16:59.494338 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 177993us
I20260709 12:16:59.528724 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:16:59.530572 21104 raft_consensus.cc:606] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:59.531868 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:59.534173 22420 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:59.534710 20999 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.536545 20999 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.518153 22379 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.539531 22382 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.540196 22467 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.529242 22435 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.537714 22433 consensus_queue.cc:1059] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:59.550462 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:59.555471 22487 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.559111 22389 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:59.558868 22485 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.570098 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1186) took 1164 ms. Trace:
I20260709 12:16:59.570479 21178 rpcz_store.cc:276] 0709 12:16:58.406096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.634011 (+227915us) service_pool.cc:224] Handling call
0709 12:16:59.450818 (+816807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.491671 (+ 40853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.569878 (+ 78207us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54003fc350. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:16:59.570023 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830527232}
I20260709 12:16:59.572134 22323 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.572504 22436 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.573766 21108 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:59.574648 22390 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.575642 21108 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.576998 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:59.577283 22406 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:16:59.571178 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 45309.2us
W20260709 12:16:59.561800 21737 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.690s	user 0.005s	sys 0.013s
I20260709 12:16:59.568557 21030 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.569518 22389 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.568342 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:59.573789 22379 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.578424 21077 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:59.578301 22436 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:16:59.588697 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 99676.2us
I20260709 12:16:59.591555 22213 consensus_queue.cc:1059] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:59.592622 22213 raft_consensus.cc:3055] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.592953 22213 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:16:59.585528 22406 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.594024 22390 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.600488 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.600525 22390 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:59.609068 21711 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:16:59.586921 22389 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.611194 22274 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.619165 22274 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.619606 22274 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.616894 20934 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 2, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.614028 22525 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.614638 20933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49692 (request call id 194) took 3976 ms. Trace:
I20260709 12:16:59.616544 22527 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.611707 22485 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.622712 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:16:59.624291 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:59.627238 20933 rpcz_store.cc:276] 0709 12:16:55.637729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.637872 (+   143us) service_pool.cc:224] Handling call
0709 12:16:57.168691 (+1530819us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fe090 00007fcb9f99cf3a 00007fcba5752e9c 00007fcba585104e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc 00007fcba3d11392 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:16:59.614463 (+2445772us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1206691,"reported_tablets":2,"spinlock_wait_cycles":290540288}
I20260709 12:16:59.607297 22390 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:59.660015 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 58020.1us
W20260709 12:16:59.660631 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 70710.4us
W20260709 12:16:59.661319 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 123235us
I20260709 12:16:59.608023 22323 raft_consensus.cc:3055] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:59.677281 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:16:59.678202 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:59.684026 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:59.687553 22511 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.690307 21103 raft_consensus.cc:2393] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:59.666710 22323 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:59.691704 22323 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.696847 22511 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.697435 22525 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.697538 22406 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.697829 22426 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.679591 22420 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.698789 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:16:59.593842 22213 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.707947 22426 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.708431 22471 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.705329 22420 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:59.714752 22420 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.715831 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.716081 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.716562 21107 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.717388 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.718431 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.709821 22487 consensus_queue.cc:1059] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:59.692739 22323 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.709975 22432 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:16:59.719426 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 141141us
I20260709 12:16:59.724037 21102 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.724615 22487 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:59.725265 22487 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.727074 22499 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:59.727463 22499 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:59.727783 22471 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.727486 22432 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.728484 22432 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:59.728415 22499 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.729667 22499 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.729465 22432 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.727626 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.730743 21108 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
W20260709 12:16:59.733525 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 65431.7us
I20260709 12:16:59.732290 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.735934 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.744136 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.746688 21105 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.747519 22268 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:59.750234 21107 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
W20260709 12:16:59.753577 21184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 1570) took 1504 ms (client timeout 1986 ms). Trace:
W20260709 12:16:59.754017 21184 rpcz_store.cc:269] 0709 12:16:58.248981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.249094 (+   113us) service_pool.cc:224] Handling call
0709 12:16:59.753332 (+1504238us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b540015ed54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:16:59.753504 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146161920}
I20260709 12:16:59.751399 22175 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.743237 21711 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:16:59.756340 22534 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:16:59.757792 20999 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.759233 22487 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.761381 21178 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:59.758745 22190 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:59.763043 22374 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.763434 22374 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:59.764369 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.764266 22374 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.765728 22374 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.757072 22485 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:16:59.767469 22485 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.760308 22503 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.781054 22519 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.783200 21104 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:59.783313 22503 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.769356 22406 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.769830 22190 consensus_queue.cc:1059] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:59.784734 22190 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.784616 22420 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.766322 22520 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.785377 22485 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.785545 22520 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:16:59.785931 22520 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.773231 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.775089 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.776242 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:59.777402 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.778852 21177 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.778983 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.780352 22521 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.741463 22213 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.780712 21149 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:59.791687 21181 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:16:59.786765 21105 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.773201 21184 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:59.790313 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 53236.9us
I20260709 12:16:59.794220 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.794907 21179 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:59.795004 21077 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:59.795233 21185 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
W20260709 12:16:59.795233 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 192484us
I20260709 12:16:59.796650 22175 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:59.797065 22175 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.797417 22175 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:59.786713 22190 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:59.798539 22190 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.796875 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.799795 22316 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.799937 22190 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.759413 21182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:16:59.789858 21737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 206) took 1264 ms. Trace:
I20260709 12:16:59.801177 21709 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.801266 21182 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.804029 21182 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.792398 22416 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:59.784929 22274 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:16:59.807721 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 66051.4us
I20260709 12:16:59.802919 22316 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.812381 21106 raft_consensus.cc:2393] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:59.792920 22432 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.815260 22175 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.796221 22420 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.743444 22510 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.839087 22467 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:59.840250 22467 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.840611 22467 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:59.842695 21110 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:59.842584 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.845045 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.854789 21104 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.863489 22175 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.868204 21111 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.867641 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.876175 21185 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:59.867585 22374 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:16:59.877244 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.878311 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.882180 22175 consensus_queue.cc:1059] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:16:59.862370 22485 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:59.886166 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.890690 21110 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:59.891248 22521 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.891609 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.892231 21030 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.893565 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:59.895063 22175 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:59.895393 22175 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.895680 22175 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.897285 21077 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:16:59.899818 22316 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:59.900290 22274 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.884554 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.901055 21178 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:59.896796 21182 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.902160 21149 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:16:59.898259 22519 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.910552 21182 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.911187 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.912571 22528 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.912628 22390 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:16:59.888841 22485 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:16:59.914737 21107 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:59.915145 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.917011 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.899781 22426 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:16:59.920363 21034 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:59.921803 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.908736 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:16:59.924258 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.924933 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.915854 22274 raft_consensus.cc:2764] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:16:59.925776 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.917327 22316 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.917855 22485 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.909614 22389 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.928610 21182 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:59.920545 22374 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:59.925731 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.933844 22455 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:59.934703 22175 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.931610 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:59.940302 21103 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:16:59.941005 21027 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.927462 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.942355 21111 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:59.943701 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.930378 21183 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.944737 22175 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:16:59.918285 22435 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:16:59.935563 22455 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.949371 21182 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:59.947441 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:16:59.948570 21178 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:59.952518 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.951519 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.954154 21028 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:59.954442 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.955003 21029 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.943109 22374 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:59.956094 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.952456 22512 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:59.959388 21032 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.959802 21032 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.959944 21182 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:16:59.943344 22190 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:16:59.949431 22455 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:16:59.930315 22467 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.954080 22469 consensus_queue.cc:1059] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:16:59.963483 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:16:59.963701 22467 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.964190 21033 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 2: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:16:59.964561 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:16:59.965098 21182 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:16:59.952387 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:16:59.967916 22379 raft_consensus.cc:3055] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.969249 22379 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:59.970196 22379 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.971321 22379 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.960120 22433 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:16:59.969322 22455 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.968535 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:16:59.975159 22439 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.976516 22439 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:16:59.976687 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:16:59.979079 22512 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.979482 22439 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.980927 22439 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.965618 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.982688 21107 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:16:59.983330 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:16:59.992796 21027 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:16:59.998684 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:00.000800 22374 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:16:59.989459 21030 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:16:59.987227 22390 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:16:59.991721 22503 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.005924 21029 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:00.010375 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.013144 21742 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.014150 22316 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.014640 21032 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.017601 21183 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:00.018532 21032 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:00.019068 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:59998 (request call id 1645) took 1139 ms. Trace:
I20260709 12:17:00.019462 22433 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:00.019392 21032 rpcz_store.cc:276] 0709 12:16:58.879570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.067476 (+187906us) service_pool.cc:224] Handling call
0709 12:16:59.955164 (+887688us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b5800003698. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba4970a40 00007fcba495c1e9 00007fcba495bc85 00007fcb9dee0254
0709 12:17:00.018953 (+ 63789us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11647232}
I20260709 12:16:59.994263 22520 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.020097 22433 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.022148 22520 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:00.022881 22433 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:00.024667 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.024912 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.025589 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.024084 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.029686 22528 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:16:59.995980 22455 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.994530 22458 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.031383 22389 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:00.034291 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.036101 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:00.037075 21027 raft_consensus.cc:2368] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3.
I20260709 12:17:00.038916 21027 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:00.039722 21742 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:00.040371 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.040938 21032 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.041271 21032 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:00.041958 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:00.012254 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:00.043260 21109 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:00.040923 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.045805 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.048039 21746 raft_consensus.cc:1240] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.048380 21077 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:00.049906 21032 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.051666 22175 consensus_queue.cc:1059] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:00.049729 21030 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:00.052028 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:00.054340 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.052680 22175 raft_consensus.cc:3055] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.055276 22175 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:00.047027 22436 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:00.005723 22190 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 12:17:00.056854 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 46672.7us
I20260709 12:17:00.057025 21746 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:00.057641 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:00.058641 21032 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.059096 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.061378 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:00.052062 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:00.061892 21746 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.053539 22389 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:00.049031 22520 consensus_queue.cc:1059] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:17:00.054566 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:00.064160 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.069583 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:00.070236 22389 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:00.071033 22175 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.074770 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:00.075040 22175 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.075330 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.063529 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:16:59.802157 21737 rpcz_store.cc:276] 0709 12:16:58.525840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.633279 (+107439us) service_pool.cc:224] Handling call
0709 12:16:58.798053 (+164774us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b5800004598. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86feee 000000000036eb39 00007fcba48e31e0 00007fcba49ac0c4 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:16:58.798227 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:58.798448 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:59.608013 (+809565us) log.cc:844] Serialized 14 byte log entry
0709 12:16:59.741422 (+133409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:59.744742 (+  3320us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:59.787670 (+ 42928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.789650 (+  1980us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:59.789786 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":867,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":6449664,"thread_start_us":43947,"threads_started":1,"wal-append.queue_time_us":138222}
I20260709 12:17:00.076169 22268 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.082183 22268 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:00.082983 22511 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:00.083073 22268 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.077455 21077 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:00.062054 22436 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:00.073680 21076 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:00.074115 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.084615 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:00.083575 22433 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:00.083570 22511 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:00.091384 22267 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:00.103858 22267 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:00.104779 22267 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.105876 22267 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:00.107510 22420 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:00.107707 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.109148 22420 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:00.113189 22420 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.114368 22420 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.095127 22268 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.070977 22485 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:17:00.070149 22213 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.115849 21184 raft_consensus.cc:1240] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:17:00.102680 22436 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.103359 22529 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:00.118767 22529 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:00.098994 22416 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.119357 22485 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:00.119673 22529 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.120822 22529 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.097798 22308 raft_consensus.cc:3055] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.121699 22308 raft_consensus.cc:740] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:00.122476 22308 consensus_queue.cc:260] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.123834 22308 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.124486 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:00.125626 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:00.127936 21711 leader_election.cc:400] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3.
I20260709 12:17:00.112095 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:00.128605 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:00.129081 22520 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:00.130030 22520 consensus_queue.cc:1059] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:00.130796 22527 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:00.131189 22527 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:00.132001 22527 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.078956 22389 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.133083 22527 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.116876 21036 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:00.117692 22175 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:00.118049 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 44428.8us
I20260709 12:17:00.108395 22511 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.130726 21104 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.137210 22512 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.138127 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:00.128775 21109 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:00.136720 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:00.126572 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:00.143483 21029 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:00.094552 21032 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:00.148725 21109 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:00.149184 22175 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:00.150652 21711 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:00.151708 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.153307 21178 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.157115 22520 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.159341 21711 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:00.166437 22175 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.169703 21076 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:00.149946 22274 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:00.171402 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 94022.8us
I20260709 12:17:00.172657 22316 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:00.173513 21108 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.175021 20933 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:00.183576 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.158650 22420 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.184396 21746 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:00.173499 22444 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:00.188807 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:00.190286 22512 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:00.190788 22512 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:00.191176 21000 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.191660 22512 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.193554 21000 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.194047 22379 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.195871 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.196375 21182 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.202083 21150 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.199321 22316 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:00.204166 21177 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:00.204718 22439 consensus_queue.cc:1059] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:00.204969 22458 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:00.200193 20933 catalog_manager.cc:5697] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 4, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:00.205493 22439 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.206118 22439 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:00.199568 22471 raft_consensus.cc:993] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:17:00.212596 21182 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
W20260709 12:17:00.214071 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.214494 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.215193 22418 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.215225 22505 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:00.216421 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:00.218925 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:00.218940 22510 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:00.220198 22519 raft_consensus.cc:1081] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:17:00.218255 22190 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:17:00.221539 22190 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:00.221937 22190 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:00.223642 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:00.163642 22520 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:17:00.225450 21027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:17:00.226015 21027 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:00.226779 21027 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.230027 22483 raft_consensus.cc:3055] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:00.230397 22483 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:00.230599 21742 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:00.231230 22483 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.233286 21102 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:00.237751 21106 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:00.238685 21709 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:00.238008 21109 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:00.239269 22426 raft_consensus.cc:3055] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:00.239632 22426 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:00.240068 21709 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.240741 21107 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.240895 22416 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:00.241307 21709 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.241989 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.243831 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:00.245608 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:00.246872 22469 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:00.212225 22439 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:00.236647 22389 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.247587 21002 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.252657 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.229646 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.262938 21150 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.264142 21104 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:00.264314 22432 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.250340 22379 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.241357 22416 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:00.252621 22467 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.252521 22520 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.264218 22528 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.266064 22420 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.220414 22316 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.267611 22323 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.320219 22323 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:00.320622 22323 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:00.320922 21103 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.320978 22323 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.325667 22416 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.253767 22458 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 12:17:00.331403 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 83884us
W20260709 12:17:00.303630 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 126269us
W20260709 12:17:00.375255 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 122660us
I20260709 12:17:00.341650 21027 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.345391 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:00.382277 21182 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 2: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:00.339952 21077 connection.cc:256] RPC call timeout handler was delayed by -1.3223932159999094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 12:17:00.384225 21036 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.382855 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:00.329452 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 88212.2us
I20260709 12:17:00.333050 22267 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.381903 22483 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.393005 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.394166 21103 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:00.340445 22418 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.397523 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:00.406984 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.407444 21179 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.410424 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:00.411586 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.413800 21746 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.415248 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.418323 21177 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:00.428995 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:00.432200 21181 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:00.433204 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.420565 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:00.432504 21186 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:00.434015 21104 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:00.395704 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.435173 21027 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:00.434425 21104 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:00.436146 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:00.436700 21746 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.330219 22439 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.437839 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.442647 21111 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:00.436353 21104 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.429514 22550 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:00.395841 22418 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:00.433446 22458 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:00.462059 21746 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:00.446637 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.448556 22550 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:00.435608 22406 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:00.458472 22458 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:00.485373 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 47623.1us
I20260709 12:17:00.430404 22551 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:17:00.487605 21186 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:00.488171 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.491346 21002 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.484982 22550 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.503023 21182 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:00.503958 21742 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.504382 22458 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.505759 22513 consensus_queue.cc:1059] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:00.506860 22513 raft_consensus.cc:3055] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:00.507181 22513 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:00.507896 22513 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.508991 22513 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.505759 22554 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.527532 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.528479 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.529379 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.530021 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.531411 22389 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:00.532677 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.530572 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.539037 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:00.540477 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 105443us
I20260709 12:17:00.523008 22426 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.547871 22426 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.491412 21709 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:17:00.552619 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 64791.6us
I20260709 12:17:00.553630 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.555032 22527 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:00.555670 22527 raft_consensus.cc:697] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:00.556594 22527 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.559634 22267 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.560281 22267 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:00.524716 22323 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.562624 22323 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:00.523598 22190 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:00.573221 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.585366 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.586040 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.587312 21177 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:00.560611 22267 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:00.652843 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 156189us
I20260709 12:17:00.562639 22550 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:00.564134 22190 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.526829 22554 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.171s
I20260709 12:17:00.652067 22267 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.566965 22418 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:00.651023 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 94814.3us
I20260709 12:17:00.712816 22420 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:00.737180 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 196063us
W20260709 12:17:00.735759 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 287916us
I20260709 12:17:00.704607 22467 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.854072 21077 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:00.735770 22560 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:00.851642 22551 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:00.934412 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 395588us
W20260709 12:17:00.935369 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 188700us
I20260709 12:17:00.936059 21077 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:00.920531 22560 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:00.940184 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.940620 22213 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:00.947012 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.947296 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 155524us
W20260709 12:17:00.951694 22555 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 12:17:00.987267 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.987847 22433 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:00.988291 22433 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:00.985649 22560 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.988866 22528 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:00.989303 22528 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:00.989645 22528 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.936736 22455 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:00.991287 22455 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:00.988647 22433 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.993408 22455 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:00.987210 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 47098us
I20260709 12:17:00.994462 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:00.995357 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.996464 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:00.997537 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.000347 21182 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.988607 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:00.986095 22467 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:01.004456 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.004791 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.005559 22505 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.006251 22505 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.006124 22467 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.006634 22505 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:00.873253 22566 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:17:00.957922 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.967353 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.969494 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:00.972188 22550 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.015462 22550 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.016070 22550 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:01.016590 22550 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.973467 22563 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:00.936893 22568 consensus_queue.cc:1059] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:17:01.017704 22469 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:01.018044 22469 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.020547 22467 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:00.981504 21177 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:00.981890 22190 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:01.024106 22190 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.005483 22511 raft_consensus.cc:3055] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.025338 22511 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:01.026000 22190 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:00.928645 22389 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.026131 22511 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:00.986090 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.027326 22511 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.986634 22213 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:00.955797 21104 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.029042 22213 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.030282 22568 raft_consensus.cc:3055] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.030584 22568 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.031530 22568 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.032276 21742 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:17:01.032652 21742 pending_rounds.cc:85] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: Aborting all ops after (but not including) 4
I20260709 12:17:01.032605 22568 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.033026 21742 pending_rounds.cc:107] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:17:01.033331 21742 raft_consensus.cc:2889] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:00.928681 22551 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:01.007069 22505 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.034133 22551 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.008620 21151 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.002668 22433 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.030611 21105 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:01.036787 22455 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.037175 22455 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:01.037523 22455 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.038422 22433 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.039141 22418 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.043081 22426 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:01.018755 22469 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.052934 22526 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:00.998538 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:01.067678 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 59168.6us
I20260709 12:17:01.068710 21151 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.069830 22190 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:01.070617 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 72147.1us
I20260709 12:17:01.072925 22529 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:01.074064 22379 raft_consensus.cc:3055] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.074448 22379 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.076526 21184 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 3. Ops: []
I20260709 12:17:01.075277 22379 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.077114 22379 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:01.078933 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.080673 21182 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:01.087297 22455 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.087662 22562 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.088574 22562 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.089373 22562 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.090689 22562 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.091063 22439 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.093449 22458 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.096546 22455 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
W20260709 12:17:01.102602 22574 log.cc:927] Time spent T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.151s	user 0.002s	sys 0.002s
I20260709 12:17:01.103565 22551 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.105590 22551 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:01.110793 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.113143 21151 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.087349 22420 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:17:01.113953 22455 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.114372 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.116531 21109 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.111912 21002 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:01.120664 22190 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:01.121080 22190 raft_consensus.cc:697] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.123423 21105 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.123575 21103 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:01.132887 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:01.133999 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.132853 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.127732 22323 consensus_queue.cc:1059] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:17:01.138947 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.139783 21186 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:01.139634 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:01.140110 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:01.140591 21184 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.144073 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:01.145202 21182 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.142979 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:01.138273 22455 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.153373 22190 consensus_queue.cc:237] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.187940 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:01.151818 22455 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:01.143687 22420 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:17:01.160656 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:01.206007 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.207409 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.209259 22485 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.209638 22485 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:01.209975 22485 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.149897 22267 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:01.218676 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 342245us
I20260709 12:17:01.219385 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.219458 21182 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
W20260709 12:17:01.221880 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.202680 22455 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.199417 22439 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:01.226219 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.225678 21036 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.230254 21036 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.230756 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.232771 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.221403 22568 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:01.234241 22568 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.234941 22267 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.236218 22568 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.240247 21036 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.238401 22439 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.243024 22560 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.243430 22439 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:01.220690 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:01.244591 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:01.244935 22560 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.247794 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.248757 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.249595 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.221103 22418 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.247341 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.253973 21104 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:01.244962 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.261533 21032 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.261888 21036 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:01.263307 21184 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:01.223338 22323 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:01.264740 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.264905 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.265882 21031 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.266081 21110 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.267447 21036 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.271632 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.272660 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.221496 22505 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.274392 21106 raft_consensus.cc:2393] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:01.272218 21033 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:01.281698 21027 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:01.284891 21028 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.263861 22526 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:01.287130 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.289654 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.285637 21036 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:01.291335 21036 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:01.287415 21027 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.252938 22576 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:01.268023 22426 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.295611 21031 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:01.265393 22267 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:01.299392 21029 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:01.305620 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.306761 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.308601 21106 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:01.273494 22529 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:01.311194 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.311268 21032 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 2: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:01.318068 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.320820 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.321231 21031 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.289155 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:01.322926 21034 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:01.323760 22485 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.325250 22528 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.326638 21178 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:01.300122 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.330711 21032 raft_consensus.cc:2410] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:01.300413 22554 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:17:01.274588 22323 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.346532 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.348212 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.313346 22426 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.350745 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.305457 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.353044 22589 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:01.353578 22589 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.355643 22323 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.357890 21030 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.357996 22528 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.362905 22471 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:01.363021 22389 consensus_queue.cc:1059] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:01.363885 22471 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:01.364509 22389 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.364779 22529 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.364871 22389 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:01.365331 22529 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.364789 22471 raft_consensus.cc:3055] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.366067 22471 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:01.366834 22471 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.367920 22471 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.368134 22469 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.369818 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.370384 21103 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:01.337327 22578 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:01.371253 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.372679 21034 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:01.364930 22521 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.373760 22521 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:01.374526 22521 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.375630 22521 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.376782 22505 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.374454 22529 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:01.379985 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.309607 22526 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:01.365808 22389 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.382315 22559 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:01.379612 22589 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.382737 22526 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.383144 22444 consensus_queue.cc:1059] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:01.385157 22444 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.385517 22444 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:01.386312 22444 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.371222 22578 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.384068 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.389403 22551 raft_consensus.cc:3055] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:01.389796 22551 raft_consensus.cc:740] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.389963 21102 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:01.383279 22436 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:17:01.391144 20933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49682 (request call id 217) took 1700 ms. Trace:
I20260709 12:17:01.387637 22444 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.392729 22563 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.393235 22563 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.393657 22551 consensus_queue.cc:260] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.395147 22551 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.387748 22550 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:01.395910 22550 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.396474 22578 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:01.382905 22389 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.396772 22550 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.397675 22563 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.399049 22513 consensus_queue.cc:1059] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:01.399339 22559 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:01.400430 22513 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.400542 22436 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:01.350208 21737 raft_consensus.cc:2393] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:01.316120 22267 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.403215 22267 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.406126 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.406505 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.407328 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:01.408488 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.393040 22213 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.409736 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:01.411602 22213 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:01.411778 21110 raft_consensus.cc:1240] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:01.404107 20930 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:01.335892 22549 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:17:01.413990 22426 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.311044 22585 consensus_queue.cc:1059] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:17:01.415205 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:01.305812 22576 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.413870 20930 catalog_manager.cc:5697] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 2 to 3, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 3 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.335701 22418 consensus_queue.cc:1059] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:17:01.400797 22513 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:01.414471 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:01.416509 22418 raft_consensus.cc:3055] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.386418 20934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49666 (request call id 196) took 2772 ms. Trace:
I20260709 12:17:01.418365 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.347216 21035 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:01.419500 21036 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:01.417440 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.427708 21032 raft_consensus.cc:2393] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 2: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:01.331009 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 122271us
I20260709 12:17:01.420905 21033 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:01.420778 21027 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:01.420836 20999 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:01.421253 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.415512 22585 raft_consensus.cc:3055] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.423981 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.427754 21103 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:01.433027 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.434183 21031 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:01.333827 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 69893.9us
I20260709 12:17:01.397874 22550 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.437469 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.436156 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.416875 22418 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:01.438194 21184 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:01.413888 22485 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.439174 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:01.434986 22433 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:01.437245 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.439826 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.441066 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.453469 21178 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:01.400581 22559 consensus_queue.cc:1059] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:17:01.432960 22585 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:01.455147 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54964.8us
I20260709 12:17:01.456984 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.457798 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.464341 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.464852 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:01.465081 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.466799 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.469245 22485 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:01.470049 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:01.470296 22418 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.471498 22418 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.475410 22559 raft_consensus.cc:3055] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.475814 22559 raft_consensus.cc:740] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:01.476591 22559 consensus_queue.cc:260] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.477764 22559 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.452116 22529 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:01.480170 21076 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:01.482712 22213 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:01.482980 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.483693 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.484633 22549 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:01.486102 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.486867 21111 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:01.487952 21106 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:01.476961 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.489241 21110 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:01.492586 20999 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.451220 22323 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.506278 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.507812 21027 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:01.391538 20933 rpcz_store.cc:276] 0709 12:16:59.691096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.691274 (+   178us) service_pool.cc:224] Handling call
0709 12:17:01.391048 (+1699774us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:00.440598 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:00.499049 (+ 58451us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:00.500241 (+  1192us) write_op.cc:435] Acquired schema lock
0709 12:17:00.517099 (+ 16858us) tablet.cc:662] Decoding operations
0709 12:17:00.554189 (+ 37090us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:00.554235 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:00.554263 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:00.554537 (+   274us) tablet.cc:701] Row locks acquired
0709 12:17:00.554555 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:17:00.554683 (+   128us) write_op.cc:270] Start()
0709 12:17:00.554791 (+   108us) write_op.cc:276] Timestamp: P: 1783599420554640 usec, L: 0
0709 12:17:00.554813 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:17:00.974166 (+419353us) spinlock_profiling.cc:243] Waited 9.25 ms on lock 0x7b540012b720. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f911520 00007fcb9f99ab42 00007fcb9f98ff67 00007fcb9f98fda4 00007fcba33ca581 00007fcba33c9d58 00007fcba33ce9f1 00007fcba33ce9a9 00007fcba33ce939 00007fcba33ce901
0709 12:17:00.974787 (+   621us) log.cc:844] Serialized 1037 byte log entry
0709 12:17:01.356088 (+381301us) op_driver.cc:464] REPLICATION: finished
0709 12:17:01.371537 (+ 15449us) write_op.cc:301] APPLY: starting
0709 12:17:01.371613 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:01.371728 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:01.371752 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:01.372129 (+   377us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:01.372286 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:01.372324 (+    38us) write_op.cc:312] APPLY: finished
0709 12:17:01.372513 (+   189us) log.cc:844] Serialized 29 byte log entry
0709 12:17:01.373222 (+   709us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:01.373306 (+    84us) write_op.cc:454] Released schema lock
0709 12:17:01.373341 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:01.376862 (+  3521us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:01.376889 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7159,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":15227,"apply.run_cpu_time_us":1559,"apply.run_wall_time_us":5289,"num_ops":2,"prepare.queue_time_us":207580,"prepare.run_cpu_time_us":14758,"prepare.run_wall_time_us":545953,"replication_time_us":801137,"spinlock_wait_cycles":21270912}]]}
I20260709 12:17:01.416878 22513 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:01.514139 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 56412.3us
I20260709 12:17:01.455749 22433 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.516875 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.519219 22190 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.504326 22323 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:01.520183 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.532209 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.518043 22578 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:01.536069 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.451442 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:01.538658 21002 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.539295 22190 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.421478 20934 rpcz_store.cc:276] 0709 12:16:58.614338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.614489 (+   151us) service_pool.cc:224] Handling call
0709 12:16:58.844134 (+229645us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b5400002490. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c8700b2 00007fcba57e9759 00007fcba5781a76 00007fcba5752d58 00007fcba585104e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc
0709 12:17:01.386346 (+2542212us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:59.810528 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:59.887207 (+ 76679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:59.887259 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:16:59.887293 (+    34us) tablet.cc:662] Decoding operations
0709 12:16:59.887725 (+   432us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:59.887801 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:59.887834 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:59.888112 (+   278us) tablet.cc:701] Row locks acquired
0709 12:16:59.888159 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:16:59.888312 (+   153us) write_op.cc:270] Start()
0709 12:16:59.891730 (+  3418us) write_op.cc:276] Timestamp: P: 1783599419888261 usec, L: 0
0709 12:16:59.891778 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 12:16:59.892462 (+   684us) log.cc:844] Serialized 532 byte log entry
0709 12:17:00.340134 (+447672us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9c88a0ac 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b
0709 12:17:00.525166 (+185032us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b1800108ac0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:00.982757 (+457591us) op_driver.cc:464] REPLICATION: finished
0709 12:17:01.327006 (+344249us) write_op.cc:301] APPLY: starting
0709 12:17:01.327103 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:01.327219 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:01.327256 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:01.327548 (+   292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:01.327755 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:17:01.327813 (+    58us) write_op.cc:312] APPLY: finished
0709 12:17:01.355032 (+ 27219us) log.cc:844] Serialized 22 byte log entry
0709 12:17:01.355219 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:01.355291 (+    72us) write_op.cc:454] Released schema lock
0709 12:17:01.355342 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:01.355687 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:01.355704 (+    17us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f99132a 00007fcb9f916f14 00007fcb9f916ec3 00007fcb9f916e38 00007fcb9f916df3 00007fcb9f9160dc 00007fcb9f93fe16 00007fcb9f927cbb 00007fcb9f91239d 00007fcb9f915d75
0709 12:17:01.355715 (+    11us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54737,"reported_tablets":6,"spinlock_wait_cycles":6015872,"child_traces":[["op",{"apply.queue_time_us":332702,"apply.run_cpu_time_us":2060,"apply.run_wall_time_us":28689,"num_ops":1,"prepare.queue_time_us":132667,"prepare.run_cpu_time_us":15191,"prepare.run_wall_time_us":578408,"raft.queue_time_us":733650,"raft.run_cpu_time_us":12900,"raft.run_wall_time_us":428618,"replication_time_us":1090812,"spinlock_wait_cycles":179287680,"thread_start_us":963544,"threads_started":4,"wal-append.queue_time_us":518558}]]}
W20260709 12:17:01.547607 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.549013 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:01.511020 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 51265.8us
I20260709 12:17:01.547546 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.549333 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.527751 22323 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.526800 22379 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.553630 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.553848 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.544281 22563 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.540436 22267 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.515080 22455 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.566634 22190 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.546312 22528 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:01.551733 21111 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:01.566725 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.566938 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:01.569556 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.572908 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.574954 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:01.575011 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.554195 22513 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.552034 22570 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:01.504376 20918 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f16c07bcae284f65a7c0ee0375e00769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a62242aa80cd4affa87dc4a3cf6b64ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:01.566064 22578 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.577186 20999 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:01.585369 22433 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.587023 22585 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.588037 22585 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.567729 22316 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:01.564127 22529 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:01.565635 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 114114us
I20260709 12:17:01.580896 21108 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:01.590552 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:01.597287 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.612532 22190 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.613406 22190 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.613772 22190 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.620514 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:01.590335 22563 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.592759 22505 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:01.627556 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.631287 22190 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.593676 22316 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:01.612094 20918 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 125746us
I20260709 12:17:01.619630 22528 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:01.624926 22439 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.625383 22379 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:01.625447 22566 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.633677 22505 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.645175 22190 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.623939 22570 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.635874 22316 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:01.614883 22529 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.634670 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.640663 21030 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:17:01.649289 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 192361us
I20260709 12:17:01.643545 22549 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.660284 21746 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:01.663153 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:01.663580 21184 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.647920 22505 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.682950 22549 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.685140 22549 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.646377 22426 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.691713 22426 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.693724 22426 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.696647 22458 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:17:01.665437 22554 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.700032 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.700661 21182 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:01.702179 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.672977 22455 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.651391 22379 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.704303 21035 raft_consensus.cc:2410] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:01.705014 22379 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.675138 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.704273 21108 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:01.648676 22528 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.712329 22528 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.677701 22570 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.713637 22323 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.714077 22563 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:01.678623 22591 log.cc:927] Time spent T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:17:01.687753 21002 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.716235 22316 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.717633 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.718079 22439 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:01.718246 21031 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:01.720865 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:01.723106 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54692.7us
I20260709 12:17:01.723831 21028 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:01.724774 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.691220 22529 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.697775 22520 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:01.670449 21184 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:01.730028 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:01.727582 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:01.723976 22316 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.739140 22563 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.650377 22566 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.733086 22549 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:01.748622 22426 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:01.748970 22455 raft_consensus.cc:2764] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:01.763273 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.758571 22444 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.764292 22585 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:01.757637 22551 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:01.723687 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:01.762683 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:01.767329 22426 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.785600 21030 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:01.787642 22551 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:01.788666 22551 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.796094 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.791422 22426 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:01.800711 22505 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.802956 22588 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.803730 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.804286 21108 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.793299 22527 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.806641 22527 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.807003 22527 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.777622 22444 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.816970 22444 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:01.768527 22549 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.818985 22549 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.784516 22418 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.820900 22589 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:01.821313 22589 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:01.825850 21182 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:01.827083 21102 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
W20260709 12:17:01.791894 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 68275.4us
I20260709 12:17:01.830016 22416 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:01.830567 22416 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.832343 22563 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:01.833123 22416 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.835407 22566 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.836481 20930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49692 (request call id 195) took 1126 ms. Trace:
I20260709 12:17:01.840855 21030 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:01.843009 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.851436 21184 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:01.843649 22323 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:01.822142 22589 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:01.862130 21108 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:01.858135 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.856035 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.872016 21184 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:01.871795 21035 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
W20260709 12:17:01.875824 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 79782.5us
I20260709 12:17:01.877569 21151 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.879699 21149 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:01.891803 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:01.892479 21027 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
W20260709 12:17:01.893158 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.856204 22576 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:01.855499 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:01.866180 22505 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:01.875087 22455 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.902773 21151 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:01.845661 22426 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:01.896865 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:01.909865 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:01.844584 20930 rpcz_store.cc:276] 0709 12:17:00.710507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.710680 (+   173us) service_pool.cc:224] Handling call
0709 12:17:00.983919 (+273239us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fe090 00007fcb9f99cf3a 00007fcba5752e9c 00007fcba585104e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc 00007fcba3d11392 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:01.836411 (+852492us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:01.465901 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:01.466381 (+   480us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:01.466411 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:17:01.466429 (+    18us) tablet.cc:662] Decoding operations
0709 12:17:01.466817 (+   388us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:01.466894 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:01.466922 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:01.467212 (+   290us) tablet.cc:701] Row locks acquired
0709 12:17:01.467229 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:17:01.467347 (+   118us) write_op.cc:270] Start()
0709 12:17:01.467447 (+   100us) write_op.cc:276] Timestamp: P: 1783599421467312 usec, L: 0
0709 12:17:01.467478 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:17:01.468029 (+   551us) log.cc:844] Serialized 918 byte log entry
0709 12:17:01.579621 (+111592us) op_driver.cc:464] REPLICATION: finished
0709 12:17:01.620431 (+ 40810us) write_op.cc:301] APPLY: starting
0709 12:17:01.626396 (+  5965us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:01.639929 (+ 13533us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:01.642607 (+  2678us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:01.688855 (+ 46248us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:01.689014 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:01.689057 (+    43us) write_op.cc:312] APPLY: finished
0709 12:17:01.689248 (+   191us) log.cc:844] Serialized 29 byte log entry
0709 12:17:01.689408 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:01.689498 (+    90us) write_op.cc:454] Released schema lock
0709 12:17:01.689535 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:01.689888 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:01.689913 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19944,"reported_tablets":6,"spinlock_wait_cycles":621995904,"child_traces":[["op",{"apply.queue_time_us":2830,"apply.run_cpu_time_us":1934,"apply.run_wall_time_us":69434,"num_ops":2,"prepare.queue_time_us":10590,"prepare.run_cpu_time_us":2367,"prepare.run_wall_time_us":2367,"replication_time_us":101345}]]}
I20260709 12:17:01.913987 22316 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:01.914397 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.899701 22455 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:01.907212 22528 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:01.956120 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 76482.4us
I20260709 12:17:01.978767 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:01.900910 21178 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:01.980132 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:01.983739 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 73935.5us
W20260709 12:17:01.910946 21077 leader_election.cc:336] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.686s (SENT)
I20260709 12:17:01.914491 22585 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.005049 21108 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:02.005080 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:02.008275 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:02.008610 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:02.007959 20931 catalog_manager.cc:5697] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 2 to 3, term changed from 1 to 3, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to <none>, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:02.008983 21740 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:02.009779 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:02.010411 22600 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.010712 21151 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:02.006460 21077 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:02.005683 21110 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:02.009877 22418 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.010411 21107 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:02.006589 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:02.013700 21104 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:01.919196 22588 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.005402 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:02.021024 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:01.955780 22455 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.012270 20931 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.984694 22589 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.012392 21737 raft_consensus.cc:2393] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:01.980001 22590 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:01.918591 22316 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:02.062638 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.052670 21034 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:01.985061 22594 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.065007 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:02.065647 21104 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:02.051396 21110 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.014657 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:02.094105 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:02.099465 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.106474 21110 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:02.055226 22308 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.057222 22420 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.108513 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:02.107743 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:02.116216 21104 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:02.117355 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:02.121877 21110 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
W20260709 12:17:02.116158 22607 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:17:02.126749 22510 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:02.127137 22510 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.127466 22510 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:02.128144 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 217799us
W20260709 12:17:02.129287 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:02.129804 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.095589 22594 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:02.132300 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 126964us
I20260709 12:17:02.122452 22551 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.113313 22600 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:02.091719 22527 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:02.144097 21027 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.112877 21102 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
W20260709 12:17:02.108127 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 127369us
I20260709 12:17:02.124749 22603 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.117043 22576 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:02.158810 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.159660 21107 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
W20260709 12:17:02.164232 22614 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:17:02.152498 22566 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 12:17:02.171044 22611 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:17:02.188616 22418 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.189170 22418 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:02.180333 22323 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.191378 22323 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:02.192466 22527 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:02.176872 22576 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.193344 22576 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:02.147156 22600 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:02.199203 22600 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.124585 22420 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:02.139686 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 89971.5us
I20260709 12:17:02.225878 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:02.149009 22308 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:17:02.150782 22551 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.193432 22323 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:02.207981 22616 log.cc:927] Time spent T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:17:02.280350 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:02.202908 22426 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:02.209960 22590 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:02.289142 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:02.291076 22615 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:17:02.287048 22323 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.292448 22588 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.292243 22323 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.294552 22594 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:02.294968 22316 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:02.295303 22590 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.284974 22439 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.226470 22526 consensus_queue.cc:1059] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:17:02.321043 22513 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.285146 22418 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:02.325040 21077 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.957s (SENT) [suppressed 40 similar messages]
I20260709 12:17:02.325151 22576 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:02.326495 22617 log.cc:927] Time spent T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.218s	user 0.003s	sys 0.000s
I20260709 12:17:02.327121 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:02.351593 21029 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:02.330178 21709 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:02.332677 22600 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.345834 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:02.357048 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:02.355706 21111 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.357635 21106 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:02.359371 21110 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:02.357553 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:02.364260 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:02.366194 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:02.350353 22439 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:02.384214 22439 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:02.365031 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:02.389575 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 378893us
I20260709 12:17:02.390502 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:02.393826 21177 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.394773 21151 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:02.367828 22267 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:17:02.370144 22379 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.351734 22513 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:02.372874 22308 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.401664 21184 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.401809 21151 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:02.404853 21184 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:02.418011 21151 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:02.373205 22528 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:02.466156 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:02.392352 22316 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.419175 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:02.502655 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:02.401679 22308 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.505318 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:02.402123 21102 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.400661 22379 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:02.465742 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 135659us
I20260709 12:17:02.512692 22418 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.374534 22570 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:17:02.404987 22624 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.515112 21185 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:02.516952 21177 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:02.519657 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:02.546545 21746 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:02.518797 21711 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:02.527056 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.528771 21033 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:02.534207 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 116281us
W20260709 12:17:02.536479 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 129833us
I20260709 12:17:02.526783 22527 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.532672 22308 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.530102 22426 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.551481 21000 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:02.555192 21151 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:02.419178 22566 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.134s
I20260709 12:17:02.538069 22379 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.563823 21033 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:02.533325 21183 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:02.542171 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:02.566092 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 201729us
I20260709 12:17:02.567118 22418 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:02.571791 22418 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.542322 21030 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:02.574323 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:02.580886 21103 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.550865 22603 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:02.590442 22603 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:02.573503 22455 consensus_meta.cc:287] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.004s
I20260709 12:17:02.552371 22629 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.565828 22628 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.587153 22576 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:02.565429 22426 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:02.583482 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.600951 21104 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:02.555740 22631 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:02.552152 22563 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 12:17:02.611651 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 245519us
I20260709 12:17:02.573549 22624 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:02.623970 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:02.621994 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 47764.9us
I20260709 12:17:02.624593 21104 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:02.617777 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 68827.4us
I20260709 12:17:02.557689 22527 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:02.611407 22267 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:02.734957 22634 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:17:02.735357 22267 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:02.716168 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 90728.4us
W20260709 12:17:02.651307 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:02.669965 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 44795.1us
W20260709 12:17:02.651552 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.630445 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:02.618573 22629 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.629832 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:02.670827 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 121294us
W20260709 12:17:02.670428 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 113753us
I20260709 12:17:02.731266 21746 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:02.649434 22576 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:17:02.733215 22527 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:02.669103 22528 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.611276 22566 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.626668 22631 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:02.620576 22628 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.618212 22455 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:02.738366 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.738047 22642 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:02.741237 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:02.778494 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.723304 21104 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:02.782119 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:02.782661 22379 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.783500 22529 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.784616 22379 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:02.761530 22630 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.785324 22630 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.606985 22513 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:02.704147 22600 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:02.733989 22316 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:02.743286 22632 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:17:02.787813 22630 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:02.701344 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:02.788437 21737 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:02.619570 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:02.752343 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:02.729067 22589 consensus_meta.cc:287] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.003s
I20260709 12:17:02.755985 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:02.760511 22566 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.792088 22316 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:02.792563 22316 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:02.792689 22566 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:02.729672 22510 consensus_meta.cc:287] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.002s
W20260709 12:17:02.729806 22585 consensus_meta.cc:287] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.002s
I20260709 12:17:02.628067 22590 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.623589 22485 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.735769 22267 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.668879 22625 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:02.760547 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:02.761634 22640 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:17:02.762076 21712 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:02.738786 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.842715 21075 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:02.764736 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:02.844511 21027 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 1.
I20260709 12:17:02.768049 22559 raft_consensus.cc:3055] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:02.772541 22563 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:02.772853 22426 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:02.774044 22323 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:02.774739 22455 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:02.776623 22628 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:02.790174 22642 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.777719 22624 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.840375 21103 raft_consensus.cc:2393] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:02.809597 22645 log.cc:927] Time spent T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:17:02.795997 22626 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.800269 22585 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.808682 22513 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.927670 22526 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.865339 22566 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:02.924096 21077 leader_election.cc:336] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.922s (SENT)
W20260709 12:17:02.977687 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 215700us
I20260709 12:17:02.943027 22631 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:02.941991 22529 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.866210 22559 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:02.945361 22620 raft_consensus.cc:2764] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Leader election decision vote started in defunct term 2: won
W20260709 12:17:02.951484 22635 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 12:17:02.953348 22420 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:02.955943 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:02.958753 20999 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:03.076349 21106 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:03.076611 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 121749us
I20260709 12:17:02.959437 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:02.973456 22551 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:02.975050 22629 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:02.976456 22608 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 12:17:02.984133 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 192314us
I20260709 12:17:02.985206 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:03.080677 21104 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:02.985776 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.081180 21109 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:03.081887 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.082094 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:02.799793 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 182947us
W20260709 12:17:03.003181 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 377188us
I20260709 12:17:02.897193 22634 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.008152 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:02.987226 22589 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.987284 22638 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:02.988898 22426 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:03.088831 22607 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:17:03.011622 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:02.862110 22625 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.816810 22308 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:02.796310 22316 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:02.991815 22455 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.065181 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.077982 21105 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:03.009246 22526 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.083981 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.109686 21183 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:17:03.085153 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.111115 21178 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:17:03.114364 22641 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 12:17:03.114873 22526 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.119199 21177 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.120352 22625 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:03.034406 22566 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.087644 21110 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.086788 21185 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:03.089735 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.089824 21151 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:03.132439 22213 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.133235 21151 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:03.134266 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:03.134385 22418 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.134958 22418 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:03.135398 21102 consensus_meta.cc:287] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.000s
I20260709 12:17:03.136013 22628 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.135815 22418 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.098047 22426 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.137374 22426 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.091150 21711 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:03.139175 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 48106.3us
I20260709 12:17:03.142135 22520 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.142494 22520 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.142814 22520 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.100030 22638 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.144882 22638 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:03.096815 22634 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.147235 22634 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:03.098176 22589 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.148577 21184 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:03.149537 22589 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:03.149977 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:03.150239 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 51587.7us
I20260709 12:17:03.153090 22526 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.011399 22485 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:03.163481 22485 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:03.164108 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.165194 22526 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:03.165388 22485 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:03.096131 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1248) took 1243 ms. Trace:
I20260709 12:17:03.166252 22626 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.098560 21109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:03.167325 21109 raft_consensus.cc:606] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:03.167840 22642 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:03.168408 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:02.796113 22510 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.083406 22570 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:03.092339 22379 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.104137 21103 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:03.013223 22513 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.104941 21106 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:03.105602 21149 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:03.123358 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.122640 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:03.127996 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 203943us
I20260709 12:17:03.154384 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.156015 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.181093 21110 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
W20260709 12:17:03.181428 21077 leader_election.cc:336] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.986s (SENT)
W20260709 12:17:03.090492 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 453804us
I20260709 12:17:03.157079 21177 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.159116 22520 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.135739 21102 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
W20260709 12:17:03.189147 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 78258.6us
I20260709 12:17:03.093133 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:03.162685 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.197795 21184 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:03.170094 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:03.198606 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.200389 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:03.157035 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:03.166051 21182 rpcz_store.cc:276] 0709 12:17:01.848813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.849635 (+   822us) service_pool.cc:224] Handling call
0709 12:17:01.849938 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.896248 (+ 46310us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:01.896276 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.896717 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 12:17:02.127651 (+230934us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b18003640c0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b 00007fcb9f533d23 00007fcb9f5340d1 00007fcb9f94fa0f
0709 12:17:02.550465 (+422814us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:02.550502 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.550979 (+   477us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.841186 (+290207us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:03.091699 (+250513us) raft_consensus.cc:1685] finished
0709 12:17:03.091719 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.091838 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43489,"raft.queue_time_us":47105,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7177,"spinlock_wait_cycles":21045504,"thread_start_us":422639,"threads_started":1,"wal-append.queue_time_us":837037}
I20260709 12:17:03.129578 22563 raft_consensus.cc:2955] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:03.202803 21036 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:03.175848 21107 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:03.175470 21109 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:03.179679 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 74155.8us
I20260709 12:17:03.205366 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:03.206969 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.208592 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:03.208726 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.209457 21106 raft_consensus.cc:2393] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:03.209473 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.212730 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.213433 21183 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:03.194674 21034 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.160265 21178 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:03.132299 22566 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:03.197017 21077 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:03.215533 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.173403 22625 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.228530 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.217106 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:03.217700 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.230260 21036 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 2: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:03.218499 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.219584 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:03.225118 21106 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:03.230950 21034 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.215904 21181 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.233628 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.189635 22624 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:03.180343 22570 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:03.236282 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.237303 21177 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.237564 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:03.236824 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.169451 22455 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.238624 21106 raft_consensus.cc:2368] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3.
I20260709 12:17:03.249787 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.250365 21106 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:03.189877 22213 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:03.197209 22634 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.211617 22576 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:03.160291 22267 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.210988 22554 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.331707 21184 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.177783 22379 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.253643 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.212236 21179 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:03.224635 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:03.333514 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 78223.2us
W20260709 12:17:03.266140 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.174027 22559 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:03.364715 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.345443 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:03.367686 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:03.214819 22323 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:03.334331 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.260085 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.260926 21103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:03.256974 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.233444 22590 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.343400 22650 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:03.225332 20918 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f16c07bcae284f65a7c0ee0375e00769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a62242aa80cd4affa87dc4a3cf6b64ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:03.344396 22510 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:03.344713 22267 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:03.345944 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 164517us
I20260709 12:17:03.349372 21177 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.345135 21184 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.358371 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.362769 21107 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:03.354348 21183 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
W20260709 12:17:03.228668 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 149975us
I20260709 12:17:03.349115 21180 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.256804 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:03.337291 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:03.370798 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.388258 21032 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:03.349596 21741 raft_consensus.cc:2368] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3.
I20260709 12:17:03.407205 22618 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.407752 22618 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 3 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:03.224133 22551 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 12:17:03.410766 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.412026 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.412870 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.413903 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.384343 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.415949 22455 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:03.385982 20918 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 168834us
I20260709 12:17:03.416752 22570 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.249330 22624 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.418043 22624 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.370060 22485 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:03.422093 21034 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:03.415887 21029 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:03.236016 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:03.331327 22576 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.379503 20999 leader_election.cc:400] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3.
I20260709 12:17:03.379412 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:03.450060 20999 leader_election.cc:403] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:03.376143 21035 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:03.386232 21103 raft_consensus.cc:606] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:03.370769 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.349990 21178 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.399231 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:03.399820 22439 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.331282 22528 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:17:03.401885 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.635676 21183 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:03.331290 22639 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.331424 22634 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.403400 22267 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.403923 21184 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.354943 22554 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.356959 22642 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:17:03.408629 22618 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.425047 21028 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:03.426178 21180 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.428894 21027 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:03.384320 21182 raft_consensus.cc:2376] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2. Re-sending same reply.
I20260709 12:17:03.236246 22625 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.236526 21709 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:03.450285 21740 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.461580 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.462083 22566 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.256714 22213 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.463570 21103 raft_consensus.cc:614] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:03.469237 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.637115 22455 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 12:17:03.372550 22323 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:03.498967 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:03.763653 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:03.764297 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:03.507587 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.419190 22485 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.381619 22650 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.524243 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:03.429065 22559 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.434602 22510 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.463296 22551 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:17:03.465019 22576 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.707970 22554 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:03.459697 22590 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:03.462879 22418 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:03.471053 21030 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.383147 22655 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:03.616339 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 170079us
I20260709 12:17:03.786180 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.805621 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:03.806800 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:03.642230 21033 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:03.642979 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:03.642309 22520 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:03.650205 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.586205 22389 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.711706 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:03.856191 21000 leader_election.cc:400] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3.
I20260709 12:17:03.717756 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.721768 21184 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:03.755143 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.464242 22426 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:03.766592 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.619468 22631 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:03.430269 22603 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:03.706262 22379 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:03.707113 22308 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:03.710031 22513 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:03.645306 21102 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:03.774744 22650 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.769057 21105 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:03.763722 22628 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.780339 22626 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.585896 22444 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.808281 21035 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:03.809428 21185 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.645505 22439 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:03.856599 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 44079.8us
I20260709 12:17:03.899127 22455 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.884740 21103 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:03.823715 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:03.810242 21183 raft_consensus.cc:2393] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 2: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:03.890718 21106 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:03.894556 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:03.809937 22663 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:17:03.898627 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.781672 22458 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.797093 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:03.780297 22632 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:17:03.788185 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.762859 22526 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.798215 22551 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.938850 21077 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.007s	sys 0.027s
I20260709 12:17:03.808247 22620 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.970599 21106 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.949306 22626 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.770165 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.768973 22323 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:03.772450 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 547578us
I20260709 12:17:03.948763 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.976681 21036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:03.976886 21180 raft_consensus.cc:2376] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3. Re-sending same reply.
I20260709 12:17:03.953883 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.902464 22389 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.790802 21177 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
W20260709 12:17:03.958328 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 580725us
I20260709 12:17:03.779399 22510 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.902349 22631 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.967551 22642 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.945393 22603 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:03.903264 22649 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.961735 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:03.941371 22379 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.856007 22418 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.768412 22566 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:03.968039 21077 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.008s	sys 0.027s
W20260709 12:17:03.962785 22563 consensus_meta.cc:287] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.011s
I20260709 12:17:03.783408 22471 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:03.974349 21182 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.979365 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:03.978703 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:03.975337 21178 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.968576 22590 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:04.025537 21183 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:03.978308 22626 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:03.959806 21746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.017s	sys 0.021s
W20260709 12:17:04.054159 21746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.017s	sys 0.021s
I20260709 12:17:04.027374 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:04.027596 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.057719 21180 raft_consensus.cc:2368] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5.
I20260709 12:17:03.975648 22505 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:03.959300 22444 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.982568 22625 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:04.081154 21182 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
W20260709 12:17:04.088390 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 109095us
I20260709 12:17:04.074393 22505 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:04.092160 22661 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:17:04.093070 22505 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:04.093432 22673 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:17:04.094406 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1144) took 1013 ms. Trace:
I20260709 12:17:04.094786 21104 rpcz_store.cc:276] 0709 12:17:03.080681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.093734 (+ 13053us) service_pool.cc:224] Handling call
0709 12:17:03.093980 (+   246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:03.094294 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.094319 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:03.094750 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:17:03.639648 (+544898us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:03.639903 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.640124 (+   221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:04.094152 (+454028us) raft_consensus.cc:1685] finished
0709 12:17:04.094178 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.094341 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":461691,"threads_started":1,"wal-append.queue_time_us":652236}
I20260709 12:17:04.095877 22513 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.096994 22513 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.097606 22559 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:04.098135 22559 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.029800 22642 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:04.103742 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 280080us
W20260709 12:17:04.094580 22664 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 12:17:04.028714 21181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.017s	sys 0.028s
I20260709 12:17:03.970920 21179 raft_consensus.cc:2376] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2. Re-sending same reply.
I20260709 12:17:03.962160 22628 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.967897 22458 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.007326 22455 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:04.028543 22624 consensus_meta.cc:287] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.011s
I20260709 12:17:03.971817 22526 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.042578 21186 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:03.975122 22551 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.053344 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:04.055476 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:04.047212 22379 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:03.958990 21712 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:04.044663 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 657016us
W20260709 12:17:04.107542 21181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.018s	sys 0.029s
I20260709 12:17:04.037606 22649 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.107102 21151 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.052549 22471 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.100214 22485 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:04.181705 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 74664.6us
I20260709 12:17:04.099126 22513 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.059489 22590 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.105348 22213 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:04.102520 22679 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.148552 21183 raft_consensus.cc:2376] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2. Re-sending same reply.
I20260709 12:17:04.242432 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.107395 22634 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:04.187335 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 306966us
W20260709 12:17:04.189580 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 46399us
W20260709 12:17:04.175616 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.157639 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.148916 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:04.148294 21177 raft_consensus.cc:2368] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3.
W20260709 12:17:04.158939 22676 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:17:04.240232 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.147742 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:04.299889 21182 raft_consensus.cc:2376] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2. Re-sending same reply.
I20260709 12:17:04.243258 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.243731 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.255200 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:04.301270 21104 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:04.296109 21185 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:04.301064 21182 raft_consensus.cc:2955] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:04.148838 21740 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:04.149335 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:04.183069 22439 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:04.153628 22666 log.cc:927] Time spent T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:17:04.185232 22622 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.313992 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.184573 22505 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:04.158377 22671 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:17:04.294443 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.315812 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1142) took 1359 ms. Trace:
I20260709 12:17:04.316145 21111 rpcz_store.cc:276] 0709 12:17:02.955876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.958963 (+  3087us) service_pool.cc:224] Handling call
0709 12:17:02.959267 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:03.233329 (+274062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.233360 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:03.233779 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 12:17:03.649403 (+415624us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:03.649446 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.715823 (+ 66377us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400229054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:03.715954 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:04.315549 (+599595us) raft_consensus.cc:1685] finished
0709 12:17:04.315569 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.315739 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56925,"raft.queue_time_us":11717,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":98962,"spinlock_wait_cycles":609729280,"thread_start_us":296532,"threads_started":1,"wal-append.queue_time_us":699399}
I20260709 12:17:04.317775 22680 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:04.263616 21106 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:04.319301 22444 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:04.270536 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.319806 22444 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.320150 22444 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:04.165710 22559 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:04.324962 21000 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:04.178704 22267 raft_consensus.cc:697] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:04.192678 22679 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.152972 22642 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:04.298761 22668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.015s	sys 0.030s
W20260709 12:17:04.247725 22638 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.009s	sys 0.032s
I20260709 12:17:04.190099 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.313481 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.313889 22389 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.152210 22510 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:04.184033 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 241124us
I20260709 12:17:04.167220 22570 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:04.150111 22458 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:04.300524 22618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.033s	sys 0.060s
W20260709 12:17:04.352227 22618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.034s	sys 0.061s
I20260709 12:17:04.352303 22458 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:04.339818 22628 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:04.329295 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.168031 22603 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:04.187026 22426 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.332422 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.164695 22551 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.299532 22681 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:04.175172 22624 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.356253 22681 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.357606 22624 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:04.357720 22520 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:04.341240 22690 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:04.338455 21077 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:04.164661 22576 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.321816 22439 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:04.337445 22680 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:17:04.323952 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:04.341259 22638 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.009s	sys 0.034s
I20260709 12:17:04.335713 22505 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.350757 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.351363 22570 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.161758 22566 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.352797 22458 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:04.335155 22679 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.358505 21184 raft_consensus.cc:2368] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:04.342793 22642 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:04.358319 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 269197us
I20260709 12:17:04.361393 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:04.398268 21185 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.345065 22418 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:04.349236 22672 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.400527 22672 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.401278 22471 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.401890 22379 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:04.339452 22668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.016s	sys 0.030s
I20260709 12:17:04.340938 22559 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:17:04.361187 22520 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.353055 22485 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.405017 22520 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.394735 22439 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.350353 22631 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:04.408169 22439 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.322649 22444 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.390746 21036 raft_consensus.cc:606] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:04.409946 21036 raft_consensus.cc:614] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:04.348518 21739 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:04.410738 21031 raft_consensus.cc:2368] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:04.413859 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.415632 21111 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:04.390321 22510 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:04.418134 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 317021us
I20260709 12:17:04.385305 22681 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.391407 21737 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:04.428435 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.428666 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:04.433326 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:04.443243 21027 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.440649 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.441417 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.443362 21035 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:04.445554 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.446066 21035 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:04.449321 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:04.451124 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 207942us
I20260709 12:17:04.452320 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.453858 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.454408 21186 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:17:04.456950 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.458441 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.459403 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.459991 21151 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.461416 21106 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:04.461782 21151 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.421867 22379 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.419979 22649 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:04.393262 22505 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.465440 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.432018 22672 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:04.478592 21151 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.443707 22551 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.364463 22690 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.480788 21027 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:04.393388 22267 consensus_queue.cc:237] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.483883 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.483783 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.449965 22681 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.487015 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.494048 21151 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.413365 22642 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.489173 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.458542 22444 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.457211 22485 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.443842 22510 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:04.463315 22590 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:04.494596 21106 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:04.495743 21151 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:04.493801 22628 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:04.498291 21186 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:04.502542 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.503249 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.510946 21105 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:04.503856 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.511821 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.512028 21028 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:04.512369 21108 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:17:04.488109 22418 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.505857 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.493600 21103 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
W20260709 12:17:04.515761 21149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.010s	sys 0.030s
I20260709 12:17:04.508466 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:04.520140 21149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.011s	sys 0.030s
I20260709 12:17:04.484786 22458 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:04.513181 20918 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f16c07bcae284f65a7c0ee0375e00769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a62242aa80cd4affa87dc4a3cf6b64ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:04.513921 22510 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.515803 22590 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.500751 22681 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.538494 21178 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:04.538594 22590 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.481388 22379 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.539088 22590 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.492359 22688 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:17:04.519984 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.540653 21102 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:04.541587 21027 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:04.516009 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1267) took 1095 ms. Trace:
W20260709 12:17:04.520488 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 626971us
I20260709 12:17:04.522035 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:04.524109 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.544787 21103 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:04.545073 21185 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:04.528767 21077 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:17:04.491358 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 133525us
I20260709 12:17:04.499418 22603 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:04.501034 22624 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:04.536567 22485 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.537056 22570 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:04.525786 21030 consensus_meta.cc:287] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.002s
I20260709 12:17:04.551709 21030 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:04.552217 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 1738) took 1358 ms. Trace:
I20260709 12:17:04.538144 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.506420 22692 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:04.491535 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 132980us
I20260709 12:17:04.492619 22551 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.542786 21181 rpcz_store.cc:276] 0709 12:17:03.421034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.180679 (+759645us) service_pool.cc:224] Handling call
0709 12:17:04.187725 (+  7046us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fe9c 00007fcb9c86fa5b 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:17:04.187894 (+   169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.188197 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.188223 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:04.188660 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:17:04.419710 (+231050us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:04.419753 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.419822 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:04.515720 (+ 95898us) raft_consensus.cc:1685] finished
0709 12:17:04.515741 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.515946 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46550,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":44172,"spinlock_wait_cycles":6825600,"thread_start_us":230543,"threads_started":1,"wal-append.queue_time_us":325585}
I20260709 12:17:04.548152 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.549535 22603 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:04.575764 21077 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:04.496043 22626 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.550776 22628 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:04.582720 22638 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:04.583159 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.583570 22628 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.584276 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.584841 21186 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:04.566430 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:04.498888 22455 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:17:04.571360 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.539038 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 1627) took 1141 ms. Trace:
I20260709 12:17:04.576877 21077 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:04.577471 21029 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:04.549999 22624 raft_consensus.cc:697] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:04.577839 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.579089 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.580545 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:04.594172 21110 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.579723 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.587234 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:04.552531 21030 rpcz_store.cc:276] 0709 12:17:03.194088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.197971 (+  3883us) service_pool.cc:224] Handling call
0709 12:17:04.552138 (+1354167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:04.553053 22554 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3.
I20260709 12:17:04.596449 21028 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:04.598274 21077 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:04.591241 22563 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.604485 22563 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.604825 22563 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.579538 22680 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:04.579782 22687 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:04.608742 22687 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:04.609248 22687 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.595989 22528 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:04.611109 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.553639 22693 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:17:04.611758 22603 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.586675 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.612355 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.612488 22563 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.612969 21102 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:04.614116 21712 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:04.614416 22563 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:04.589856 22323 consensus_meta.cc:287] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.000s
I20260709 12:17:04.611711 21109 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:04.619050 21077 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:04.628185 21110 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:04.589010 21178 rpcz_store.cc:276] 0709 12:17:03.398038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.784383 (+386345us) service_pool.cc:224] Handling call
0709 12:17:04.538978 (+754595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:04.629670 22638 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:04.590320 22559 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.630486 22689 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:04.603287 22650 consensus_meta.cc:287] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.648s	user 0.001s	sys 0.008s
I20260709 12:17:04.633106 21741 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.614368 22379 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.615658 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.600353 22576 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.615952 22639 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.645725 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.650336 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:04.637223 21077 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:04.637874 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 67731.1us
I20260709 12:17:04.639187 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.657217 21177 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:17:04.658982 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.658280 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.660766 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:04.661839 21149 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:04.634986 22704 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:04.663411 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.663371 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.668172 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:04.668716 21027 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.635212 22439 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.671607 22439 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.672006 22439 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.634790 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:04.635269 22213 raft_consensus.cc:2764] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:17:04.675102 21178 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.635108 22513 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:04.575273 22692 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.679638 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.603463 22510 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:17:04.698418 22620 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.699082 22620 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.699401 22620 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:04.699715 22620 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.703019 22213 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.704294 21178 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:04.685135 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:04.712232 21106 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.666477 22649 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:04.715616 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 54929.6us
I20260709 12:17:04.716400 21077 leader_election.cc:400] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5.
I20260709 12:17:04.716701 21077 leader_election.cc:403] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:04.644788 22638 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:04.703516 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.664314 21030 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:04.706020 21076 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:04.724221 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:04.707787 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.707999 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:04.725440 21108 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.660766 22455 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.713434 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.726347 21178 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:04.727211 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.727862 21178 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:04.717971 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:04.728436 21029 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.683904 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:04.631649 22323 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.691310 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:04.730307 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.691510 21027 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:04.732046 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.733878 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.734448 21027 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:04.735100 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.736052 21178 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:04.645584 22650 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.736848 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:04.737146 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:04.734448 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:04.692893 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 47950.5us
I20260709 12:17:04.745111 21106 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:04.743824 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:04.652227 22624 consensus_queue.cc:237] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.714466 22505 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:04.719666 22687 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:04.735216 22576 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.720221 22642 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.739936 22639 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5.
I20260709 12:17:04.694191 22513 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.752410 21178 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:04.756937 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:04.769506 21077 leader_election.cc:400] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3.
I20260709 12:17:04.750682 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:04.749010 21033 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.735613 22559 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.760788 21108 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:04.735023 22712 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:04.746379 22690 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:04.764165 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.769793 21077 leader_election.cc:403] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:04.776996 21109 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
W20260709 12:17:04.762759 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 100982us
I20260709 12:17:04.772655 21029 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:04.748342 22704 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:04.788661 22704 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.789438 22626 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:04.758281 22576 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.790133 22576 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.733352 22455 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.791088 22455 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.791183 22308 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.778155 20999 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:04.795689 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 966) took 1385 ms. Trace:
I20260709 12:17:04.795943 21031 rpcz_store.cc:276] 0709 12:17:03.410533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.413692 (+  3159us) service_pool.cc:224] Handling call
0709 12:17:04.795535 (+1381843us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b54000c53d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:04.795645 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291010816}
I20260709 12:17:04.778648 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.783491 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.783821 22692 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.783941 21108 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:04.849087 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.849452 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.849668 21108 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:04.783938 22389 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.784461 22513 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.786535 22650 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.763948 22649 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:04.787818 22642 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.847218 21109 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
W20260709 12:17:04.851152 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 81765.6us
I20260709 12:17:04.768205 22672 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:04.851991 21029 raft_consensus.cc:2368] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3.
I20260709 12:17:04.852516 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.794106 22551 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.852488 22389 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:04.855566 22685 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.855921 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.858026 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:04.775465 22570 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:04.857980 22458 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:04.858564 22566 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:04.868296 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:04.853644 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 68734.2us
I20260709 12:17:04.875149 22684 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.793515 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:04.873270 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.874027 22686 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.874742 22719 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:04.856153 22695 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.851537 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:04.881747 22649 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:04.889621 22684 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.794313 22712 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.859181 22308 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3.
I20260709 12:17:04.935724 22723 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:04.936090 22700 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:17:04.936240 22723 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.936959 22696 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.937323 22696 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:04.937665 22696 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.862300 22642 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.939020 22642 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.854724 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:04.867175 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.887569 21180 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:04.868333 21077 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:04.790778 22590 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.910146 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:04.879613 22685 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.880144 22526 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:04.859768 22618 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:17:04.921890 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1042) took 1030 ms. Trace:
I20260709 12:17:04.856313 22690 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:04.925757 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 74275.1us
I20260709 12:17:04.927165 22563 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:04.933717 22707 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 12:17:04.935205 22709 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:17:04.935338 22714 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:04.942050 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 87405us
I20260709 12:17:04.943642 21103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:05.017827 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:04.853132 22638 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.946703 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:04.935081 22710 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:17:04.994546 22680 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:04.887111 22570 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.909652 22566 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:04.926687 22695 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.889356 22458 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:04.995570 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 226630us
I20260709 12:17:04.921043 21030 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:04.886948 22672 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:04.997546 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 87472.3us
I20260709 12:17:05.037371 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:04.930935 22684 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.880517 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:05.000392 21107 rpcz_store.cc:276] 0709 12:17:03.891510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.893001 (+  1491us) service_pool.cc:224] Handling call
0709 12:17:03.945267 (+ 52266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.182553 (+237286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.182581 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:04.183455 (+   874us) log.cc:844] Serialized 26 byte log entry
0709 12:17:04.426482 (+243027us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:04.426522 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.892917 (+466395us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54003692d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:04.892974 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:04.893017 (+    43us) raft_consensus.cc:1685] finished
0709 12:17:04.893030 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.921814 (+ 28784us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2205,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":49310,"spinlock_wait_cycles":544954112,"thread_start_us":114707,"threads_started":1,"wal-append.queue_time_us":299279}
I20260709 12:17:05.018350 21103 raft_consensus.cc:606] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:05.018887 21744 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
W20260709 12:17:04.945727 22716 log.cc:927] Time spent T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:17:04.909511 22389 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:04.993556 22551 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.002705 22687 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.053421 22687 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.014134 22723 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:04.999028 22685 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.054967 21036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:04.995895 22668 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:04.999317 22323 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.004886 22690 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.005995 22713 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.034435 21076 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:05.039994 21108 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:05.044445 21029 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:04.929903 22719 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.052448 22389 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.037972 22695 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.007140 22563 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.094640 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.034238 22714 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.058228 21036 raft_consensus.cc:606] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:05.100649 21036 raft_consensus.cc:614] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:05.099900 21180 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:05.099249 22719 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.101840 22566 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.099340 22563 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:05.112119 22690 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:05.116297 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:05.117520 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:05.118498 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:05.119822 22672 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.120942 21185 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.127512 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.128190 21111 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:05.128688 22389 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.127630 22725 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:05.127676 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 259386us
W20260709 12:17:05.131590 21077 leader_election.cc:336] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.798s (SENT)
I20260709 12:17:05.131950 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:05.128319 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 93965.6us
I20260709 12:17:05.133083 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:05.134114 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:05.135084 21076 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:05.135926 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:05.144798 21077 leader_election.cc:336] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.869s (SENT)
I20260709 12:17:05.145272 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:05.141549 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:05.148931 22714 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.052996 22680 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.149451 22439 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.045897 22649 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.097599 22668 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.150519 22684 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.143700 22724 raft_consensus.cc:2764] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:17:05.167692 22458 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.175377 21031 raft_consensus.cc:2368] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3.
I20260709 12:17:05.176282 22684 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.176704 22639 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.177408 22639 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.174367 22642 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.170197 21076 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:05.182865 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 145552us
I20260709 12:17:05.185362 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:05.177812 22639 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:05.171651 22679 consensus_meta.cc:287] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.003s
I20260709 12:17:05.188802 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:05.190085 22724 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:05.140662 22513 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.143558 22725 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.201685 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.168011 22439 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.186458 22559 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:05.167052 22692 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.199651 22690 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:05.168627 22570 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.199921 21186 raft_consensus.cc:2410] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:17:05.187418 22723 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.172503 22576 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.214943 22576 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.215135 22455 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.199862 22639 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.167846 22712 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:05.197530 22458 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.204612 22724 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.215616 22510 raft_consensus.cc:993] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:17:05.195643 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:05.151401 22686 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.205569 22590 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:05.235394 21151 leader_election.cc:400] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:05.235716 21151 leader_election.cc:403] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:05.203256 22679 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:05.225448 22444 consensus_meta.cc:287] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.000s
I20260709 12:17:05.225581 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:05.211031 22559 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.226204 22458 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.247987 22458 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.249912 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:05.251117 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:05.231040 21185 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:05.228329 22685 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.208567 22725 raft_consensus.cc:697] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:05.245151 22668 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.246260 22559 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.217967 22723 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.252997 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:05.251677 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:05.224520 22631 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:05.188700 22696 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.230165 22690 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:05.256462 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:05.256177 22723 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.243640 22510 raft_consensus.cc:1081] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:17:05.260269 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:05.252101 22714 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.243242 22712 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:05.252307 22686 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:05.263476 22714 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.261313 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:05.271256 21185 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:05.264003 22620 consensus_meta.cc:287] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
I20260709 12:17:05.274245 22685 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.274400 21741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 233) took 1390 ms. Trace:
I20260709 12:17:05.288268 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:05.300309 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 297840us
I20260709 12:17:05.335203 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:05.302068 21104 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:05.271862 22714 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.259351 22631 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.327383 21185 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:05.301841 21186 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:05.341094 22731 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:05.329468 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 310256us
I20260709 12:17:05.310590 22642 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.349316 22724 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.350373 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:05.274528 22620 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.328567 22455 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.274856 21741 rpcz_store.cc:276] 0709 12:17:03.883920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.895131 (+ 11211us) service_pool.cc:224] Handling call
0709 12:17:03.972085 (+ 76954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:04.656430 (+684345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:05.274167 (+617737us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54004a6854. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:05.274340 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482204928}
I20260709 12:17:05.318787 22690 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.360256 22696 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.262967 22725 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.375978 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:05.382210 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:05.383615 21032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 964) took 1973 ms (client timeout 1798 ms). Trace:
I20260709 12:17:05.385005 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:05.411132 21742 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.399072 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:05.399727 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:05.402367 22681 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:05.404574 21184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 1629) took 2006 ms (client timeout 1869 ms). Trace:
I20260709 12:17:05.408437 21077 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:05.432294 21184 rpcz_store.cc:269] 0709 12:17:03.398509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.898256 (+499747us) service_pool.cc:224] Handling call
0709 12:17:05.404376 (+1506120us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400262fd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:05.404505 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916878208}
I20260709 12:17:05.435556 21077 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:05.410720 21032 rpcz_store.cc:269] 0709 12:17:03.410065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.411826 (+  1761us) service_pool.cc:224] Handling call
0709 12:17:05.383412 (+1971586us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54003d3bd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:05.383549 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3844555136}
I20260709 12:17:05.437906 21186 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.438339 21177 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:05.440310 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 64412.2us
I20260709 12:17:05.441812 21002 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:05.443573 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:05.353811 22686 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:05.455655 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 119615us
I20260709 12:17:05.456629 20999 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:05.460539 22696 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:05.460963 22696 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:05.461338 22696 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.471196 21185 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.478947 21002 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:05.481545 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:05.482667 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:05.483242 21031 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:05.484035 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:05.485306 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:05.405597 22563 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.491786 21036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:17:05.447803 22693 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:05.493294 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:05.444511 22731 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:05.494740 21036 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:05.509240 21036 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.495594 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:05.449239 22323 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.497408 21033 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:05.498420 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.499922 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.510509 21184 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:05.510787 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.500566 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.444976 22679 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.506009 21031 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:05.508060 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:05.437803 21739 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
W20260709 12:17:05.583240 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 87724.7us
I20260709 12:17:05.583756 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:05.586531 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 108223us
I20260709 12:17:05.589737 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:05.492903 22685 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.445272 22723 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.445068 22316 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:17:05.595247 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.509678 22668 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.496814 22693 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.598119 21149 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:05.579499 22471 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.615419 21036 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.530314 22678 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:05.582235 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 72854.5us
I20260709 12:17:05.599438 21103 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:05.609983 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.682451 21107 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:17:05.616014 21742 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
W20260709 12:17:05.600060 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 92083.6us
I20260709 12:17:05.621486 21711 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:05.623271 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 92540.7us
I20260709 12:17:05.597617 22685 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:05.671504 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 82464.8us
I20260709 12:17:05.672293 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1047) took 1111 ms. Trace:
I20260709 12:17:05.678109 21177 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:05.602504 22510 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:05.600896 22650 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:05.603870 22455 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.603911 22681 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.694406 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.671983 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.686601 21105 rpcz_store.cc:276] 0709 12:17:04.560602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.560752 (+   150us) service_pool.cc:224] Handling call
0709 12:17:05.638013 (+1077261us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54002530d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:05.672163 (+ 34150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959947648}
I20260709 12:17:05.697208 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:05.701025 22727 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
W20260709 12:17:05.701619 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 80212.6us
I20260709 12:17:05.701967 22510 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:05.703235 21036 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.612473 22693 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.719241 22668 raft_consensus.cc:697] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:05.719869 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 97705.1us
I20260709 12:17:05.721220 21106 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.738134 21711 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:05.691242 22678 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:05.722535 22576 consensus_queue.cc:1059] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:05.695608 21741 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:05.708491 22455 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:05.729301 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.733527 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.730348 22554 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:05.738097 22510 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:05.722586 22736 log.cc:927] Time spent T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.308s	user 0.000s	sys 0.000s
I20260709 12:17:05.581025 22675 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 12:17:05.723174 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.747188 21711 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:05.747278 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.725602 22704 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:05.725032 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.769363 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.753844 21107 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.695914 22685 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.775527 22618 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.776482 22668 consensus_queue.cc:237] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.756625 21104 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:05.761932 21106 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:05.755474 22455 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:05.782213 22742 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:17:05.762779 22554 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.778591 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:05.783097 22732 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:05.750427 22678 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.784315 22563 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.766068 22681 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:05.752173 22439 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:05.786898 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:05.757691 22426 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.732429 22650 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.724529 22731 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.798779 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:05.823177 21744 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.764846 22631 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.810329 21743 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:05.798432 22681 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:05.810516 22741 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:17:05.805317 22439 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.811100 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:05.812602 22554 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.819286 22734 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.222s
I20260709 12:17:05.806290 22316 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.825657 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:05.806006 22505 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:05.825626 22698 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:05.825556 22735 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
I20260709 12:17:05.830900 22732 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.793815 22620 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:05.852929 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1288) took 1222 ms. Trace:
I20260709 12:17:05.867013 21177 rpcz_store.cc:276] 0709 12:17:04.630908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.658054 (+ 27146us) service_pool.cc:224] Handling call
0709 12:17:05.852778 (+1194724us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400262ad4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:05.852875 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631324032}
W20260709 12:17:05.833244 22639 consensus_meta.cc:287] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
I20260709 12:17:05.851647 22439 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.873366 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:05.875265 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:05.825335 21107 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:05.796869 22714 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.866081 21744 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:05.854004 22723 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.868526 22639 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:05.911074 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:05.912643 21000 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:05.920898 22730 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:05.921427 22730 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:05.878342 22698 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:05.593437 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 89972us
I20260709 12:17:05.928308 22732 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.878957 22505 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:05.930100 22737 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:17:05.922437 20931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 112) took 4872 ms. Trace:
I20260709 12:17:05.917076 22316 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.944024 22650 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:05.944311 21746 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:05.914165 20930 catalog_manager.cc:5697] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 3 to 2, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from VOTER to NON_VOTER, now has a pending config: VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1), VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2), VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3), VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 3 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:05.960296 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:05.923074 22730 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.968827 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.968418 20930 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:05.970064 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.969838 20930 catalog_manager.cc:5697] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:05.971977 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.972585 21104 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:05.973601 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:05.970782 21111 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:05.975453 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:05.978058 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 293672us
I20260709 12:17:05.978655 21103 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:05.980981 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:05.967569 22695 consensus_meta.cc:287] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.860s	user 0.013s	sys 0.000s
I20260709 12:17:05.962642 22505 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:05.986219 21107 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:05.989537 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:05.998186 21103 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:06.001286 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.001892 21184 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:06.000356 21178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.013s	sys 0.036s
I20260709 12:17:05.963145 22455 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:05.985347 22620 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.928575 22685 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.010761 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:05.998348 21035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.023s	sys 0.041s
W20260709 12:17:05.987305 22672 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.092s	sys 0.158s
I20260709 12:17:06.042178 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:06.047068 21103 raft_consensus.cc:2368] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3.
I20260709 12:17:06.042021 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.007968 22389 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 12:17:06.049466 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 70829.8us
I20260709 12:17:06.050233 21076 leader_election.cc:400] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3.
W20260709 12:17:06.045236 21035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.024s	sys 0.041s
I20260709 12:17:06.045858 21183 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:06.048382 21179 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:05.990816 22712 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:06.044621 22620 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.013156 21107 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:06.061753 21184 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
W20260709 12:17:06.046617 22672 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.092s	sys 0.158s
I20260709 12:17:06.050540 21076 leader_election.cc:403] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:06.011009 22655 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:06.083123 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:05.933036 20931 rpcz_store.cc:276] 0709 12:17:01.042579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.042796 (+   217us) service_pool.cc:224] Handling call
0709 12:17:01.323973 (+281177us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fe090 00007fcb9f99cf3a 00007fcba5752e9c 00007fcba585104e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc 00007fcba3d11392 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:01.361292 (+ 37319us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b5400002490. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c870640 00007fcba5747846 00007fcba585190e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc 00007fcba3d11392 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:05.915307 (+4554015us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:02.628979 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:02.777016 (+148037us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:02.777053 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:17:02.777071 (+    18us) tablet.cc:662] Decoding operations
0709 12:17:02.777505 (+   434us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:02.777560 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:02.777588 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:02.977799 (+200211us) tablet.cc:701] Row locks acquired
0709 12:17:02.983291 (+  5492us) write_op.cc:260] PREPARE: finished
0709 12:17:02.992925 (+  9634us) write_op.cc:270] Start()
0709 12:17:03.007858 (+ 14933us) write_op.cc:276] Timestamp: P: 1783599422992866 usec, L: 0
0709 12:17:03.009429 (+  1571us) op_driver.cc:348] REPLICATION: starting
0709 12:17:03.177614 (+168185us) log.cc:844] Serialized 941 byte log entry
0709 12:17:04.151285 (+973671us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f98fe28 00007fcba33ca581 00007fcba33c9d58 00007fcba33ce9f1 00007fcba33ce9a9 00007fcba33ce939 00007fcba33ce901 00007fcba33cdb2d 0000000000388634 0000000000388479
0709 12:17:04.567730 (+416445us) op_driver.cc:464] REPLICATION: finished
0709 12:17:04.862320 (+294590us) write_op.cc:301] APPLY: starting
0709 12:17:04.872074 (+  9754us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:04.881998 (+  9924us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:04.886554 (+  4556us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:05.006488 (+119934us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:05.033126 (+ 26638us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:05.038329 (+  5203us) write_op.cc:312] APPLY: finished
0709 12:17:05.055099 (+ 16770us) log.cc:844] Serialized 29 byte log entry
0709 12:17:05.055285 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:05.055376 (+    91us) write_op.cc:454] Released schema lock
0709 12:17:05.055420 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:05.055777 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:05.055827 (+    50us) write_op.cc:454] Released schema lock
0709 12:17:05.361984 (+306157us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f99132a 00007fcb9f916f14 00007fcb9f916ec3 00007fcb9f916e38 00007fcb9f916df3 00007fcb9f9160dc 00007fcb9f93fe16 00007fcb9f927cbb 00007fcb9f91239d 00007fcb9f915d75
Metrics: {"mutex_wait_us":26576,"reported_tablets":12,"spinlock_wait_cycles":422043776,"child_traces":[["op",{"apply.queue_time_us":268820,"apply.run_cpu_time_us":2395,"apply.run_wall_time_us":198959,"num_ops":2,"prepare.queue_time_us":479872,"prepare.run_cpu_time_us":43213,"prepare.run_wall_time_us":1531486,"raft.queue_time_us":192141,"raft.run_cpu_time_us":35436,"raft.run_wall_time_us":854053,"replication_time_us":1533065,"spinlock_wait_cycles":73424128,"thread_start_us":965433,"threads_started":4,"wal-append.queue_time_us":825094}]]}
W20260709 12:17:05.990516 22725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.006s	sys 0.044s
I20260709 12:17:06.063320 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.082182 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:06.082734 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:06.069610 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:06.087970 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.106385 21186 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:05.989172 22695 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.112265 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.010354 22689 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:17:06.099889 22513 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3.
I20260709 12:17:06.117367 22739 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:06.045783 22626 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:17:06.105634 22725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.012s	sys 0.044s
I20260709 12:17:06.084756 22620 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.117873 22739 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:06.109424 22624 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.099638 22712 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:06.125725 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:06.138098 21107 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:06.113359 22526 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.127074 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.136812 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.114977 22714 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:06.146927 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.148021 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.148983 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.149473 21183 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:06.150182 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.150768 21183 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:06.105535 22510 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:06.138022 22740 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:17:06.143316 22685 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.163122 22698 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:06.137171 22734 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:17:06.152806 22639 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.173980 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.174770 21183 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:06.184382 22739 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:06.173617 22624 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.194666 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:06.193521 22455 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:06.196924 22649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.046s	sys 0.087s
I20260709 12:17:06.193653 22695 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.203385 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1052) took 1422 ms. Trace:
I20260709 12:17:06.180063 22712 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:06.209972 22696 consensus_meta.cc:287] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.003s
W20260709 12:17:06.209466 22649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.046s	sys 0.087s
I20260709 12:17:06.193809 22624 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:06.220278 21181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.024s	sys 0.010s
W20260709 12:17:06.242964 21181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.024s	sys 0.010s
W20260709 12:17:06.220862 21151 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.017s	sys 0.053s
W20260709 12:17:06.243480 21151 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.017s	sys 0.053s
W20260709 12:17:06.243772 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 822669us
I20260709 12:17:06.248648 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1290) took 1471 ms. Trace:
I20260709 12:17:06.258029 21151 leader_election.cc:400] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3.
I20260709 12:17:06.259124 22714 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.214701 21102 rpcz_store.cc:276] 0709 12:17:04.780132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.793159 (+ 13027us) service_pool.cc:224] Handling call
0709 12:17:04.872144 (+ 78985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:05.124836 (+252692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.124874 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:05.187791 (+ 62917us) log.cc:844] Serialized 26 byte log entry
0709 12:17:05.508510 (+320719us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:05.577906 (+ 69396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:05.578047 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.193587 (+615540us) raft_consensus.cc:1685] finished
0709 12:17:06.193607 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.202137 (+  8530us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":233931,"raft.queue_time_us":235941,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":2222,"thread_start_us":279193,"threads_started":1,"wal-append.queue_time_us":762451}
I20260709 12:17:06.268338 22624 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:06.213282 22620 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:06.296705 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 128873us
I20260709 12:17:06.281840 22426 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:06.284402 22624 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:17:06.291543 20999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.006s	sys 0.013s
I20260709 12:17:06.297703 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 109) took 1154 ms. Trace:
W20260709 12:17:06.302392 20999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.007s	sys 0.013s
I20260709 12:17:06.301605 21178 rpcz_store.cc:276] 0709 12:17:05.143064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.441280 (+298216us) service_pool.cc:224] Handling call
0709 12:17:05.441606 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:05.441810 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.441834 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:05.442260 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:17:06.008285 (+566025us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:06.008328 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.008397 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.297464 (+289067us) raft_consensus.cc:1685] finished
0709 12:17:06.297496 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.297642 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":512162,"threads_started":1,"wal-append.queue_time_us":748051}
I20260709 12:17:06.303819 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.304831 21178 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.241966 22696 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:06.297739 21002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.003s	sys 0.008s
W20260709 12:17:06.315682 21002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.003s	sys 0.008s
I20260709 12:17:06.304697 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.316386 21183 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:06.271575 21743 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:06.300735 22426 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.298801 22510 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:06.307816 22678 consensus_meta.cc:287] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.002s
I20260709 12:17:06.302276 22649 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:06.347275 21028 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:06.355654 22620 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:06.356736 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:06.357291 21744 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.333289 22455 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:06.359267 22455 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.361387 22455 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:06.364265 22696 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.335219 22739 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:17:06.367347 22739 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:06.367352 21744 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:06.367837 22739 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:06.368572 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:06.369019 22698 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:06.369414 22698 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:06.368572 22739 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.369792 22649 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.366453 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.373178 21036 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:06.374224 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:06.378561 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.380061 21178 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:06.381089 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:06.381966 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 277808us
I20260709 12:17:06.382908 21032 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:06.362671 22693 consensus_meta.cc:287] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.007s
I20260709 12:17:06.386046 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.387288 21077 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:06.394866 21033 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.391160 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.394021 21032 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:06.396277 21183 raft_consensus.cc:2376] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3. Re-sending same reply.
I20260709 12:17:06.395821 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.369516 22455 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:06.397471 21149 leader_election.cc:400] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3.
W20260709 12:17:06.381742 22681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.005s	sys 0.026s
I20260709 12:17:06.390537 21178 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:06.399344 21149 leader_election.cc:403] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:06.400743 21711 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:06.337181 22725 consensus_queue.cc:1059] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 12:17:06.402901 22323 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.014s	sys 0.014s
W20260709 12:17:06.405104 22323 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.014s	sys 0.014s
W20260709 12:17:06.408327 21712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.007s	sys 0.014s
W20260709 12:17:06.408663 21712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.007s	sys 0.014s
W20260709 12:17:06.408912 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 658992us
I20260709 12:17:06.409075 22756 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.390045 21179 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.384248 22668 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:06.419361 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 336685us
I20260709 12:17:06.391924 22526 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.394018 22739 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.390337 22639 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:06.392082 22714 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.491015 22714 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:06.491562 22685 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.490242 21076 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:06.492059 22685 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:06.477293 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 75209.4us
I20260709 12:17:06.389921 22755 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:06.478724 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 54848.1us
W20260709 12:17:06.399962 22681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.005s	sys 0.026s
I20260709 12:17:06.403326 22718 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3.
I20260709 12:17:06.483932 21033 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.485474 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.486151 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:06.490326 22756 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:06.349090 22678 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.401818 22679 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.402009 22695 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.494541 21076 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:06.392307 22439 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:17:06.391860 22620 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 12:17:06.370258 22698 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.483150 21028 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:06.396023 22690 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 12:17:06.519039 21036 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:06.505263 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.517935 21032 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:06.393420 22693 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:06.523056 21076 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:06.403203 22631 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:17:06.526786 21028 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.585716 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.586292 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:06.587025 21028 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:06.528193 22389 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.499917 22639 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:06.417732 22418 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:17:06.560643 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:06.494028 22668 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:06.493592 22379 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:06.559978 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 159282us
I20260709 12:17:06.498867 22526 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:06.559355 22725 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.551045 22681 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.559238 22603 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.568109 22698 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.524997 22679 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.524890 22695 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.577402 22628 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.626609 21110 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:06.517098 22755 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:06.567765 22213 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:17:06.638496 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.677758 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.634764 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.681951 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:06.693109 21036 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.693591 21033 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:06.631107 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.703951 22678 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.704111 22213 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:06.705214 22747 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.560s	user 0.001s	sys 0.000s
I20260709 12:17:06.707201 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1650) took 1836 ms. Trace:
I20260709 12:17:06.707784 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.701203 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:06.707544 21182 rpcz_store.cc:276] 0709 12:17:04.870674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.381109 (+510435us) service_pool.cc:224] Handling call
0709 12:17:05.381429 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:05.381764 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.381790 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:05.382250 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:17:05.582572 (+200322us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:05.603529 (+ 20957us) log.cc:844] Serialized 14 byte log entry
0709 12:17:05.604298 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:05.604420 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.704665 (+1100245us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:06.706938 (+  2273us) raft_consensus.cc:1685] finished
0709 12:17:06.707034 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.707146 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60620,"prepare.queue_time_us":20550,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":14791,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":9685,"spinlock_wait_cycles":10507648,"thread_start_us":199944,"threads_started":1,"wal-append.queue_time_us":669421}
I20260709 12:17:06.710369 21002 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:06.693243 22505 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:06.625597 22725 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.679587 22628 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.717715 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:06.716966 22755 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:06.718432 22696 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.718832 22696 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.719197 22696 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.625787 22603 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.630618 22526 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.712913 22649 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.715150 22439 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:06.631582 22681 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.702543 22758 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.720989 22732 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:17:06.721060 22678 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.713764 21030 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 1.
I20260709 12:17:06.715770 22505 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:06.732749 22439 raft_consensus.cc:697] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:06.728395 22685 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:06.709481 22639 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.733640 22678 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:06.840515 22678 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.841614 22213 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.842227 22213 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.739742 21028 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:06.844763 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 321754us
I20260709 12:17:06.846367 21076 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:06.842926 22672 raft_consensus.cc:3055] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:06.817883 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:06.841686 22714 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:06.849714 22764 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:17:06.860502 20999 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:06.863886 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:06.816190 22389 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:06.736191 22628 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:06.857419 22781 log.cc:927] Time spent T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 12:17:06.849205 22679 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.816992 22649 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.851142 22672 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:06.914696 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54260.9us
I20260709 12:17:06.918701 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:06.920142 20999 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:06.921203 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:06.921281 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:06.922957 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.866932 22668 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:06.938750 21183 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:06.938084 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.940311 21182 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:06.889249 22695 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.941143 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:06.916462 22785 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
W20260709 12:17:06.901494 22771 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:17:06.941804 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.946364 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.867475 22624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51888 (request call id 70) took 3685 ms. Trace:
I20260709 12:17:06.763986 22439 consensus_queue.cc:237] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:06.892246 22789 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:06.860054 22505 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.916473 22649 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.866801 22732 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.987305 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.937352 22714 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:06.947790 21182 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 2: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:06.988112 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:06.938235 22471 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.992130 22681 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.946295 22668 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:06.922761 22792 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:17:06.923002 22788 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.868500 22769 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:06.986938 22693 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:06.995896 21712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.010s	sys 0.036s
I20260709 12:17:06.968878 22526 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.994653 22513 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.901881 22389 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:06.952111 22695 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.012068 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:06.999257 22684 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.997705 22471 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:07.038981 22471 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.041003 22723 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.041399 22723 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:07.042132 22723 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.043038 22723 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.043284 22316 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:07.043790 22791 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:07.044955 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:07.025584 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 104388us
W20260709 12:17:07.035162 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 114025us
I20260709 12:17:06.999643 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:07.038609 22787 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:07.045578 21184 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:07.013448 22505 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.047672 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.010644 22603 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:07.048643 21002 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:07.025128 21712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.010s	sys 0.036s
I20260709 12:17:07.010241 22679 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.988886 22795 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:17:07.004079 22668 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:06.999930 22794 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.992842 22789 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.000429 22714 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.043120 22804 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.087592 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:07.088761 21746 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:07.088864 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:07.056107 22758 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.089640 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.093019 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:07.089893 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.054503 22213 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:06.989732 22672 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:07.091157 22779 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 12:17:07.091233 22684 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:07.094836 22793 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:17:07.012245 22788 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:07.057904 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 647950us
I20260709 12:17:07.092088 22668 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:07.099345 22426 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.000s
I20260709 12:17:07.026504 22769 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.112023 20999 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.114162 22805 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.114604 22792 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.114979 22672 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.097090 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.107718 22684 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:07.104892 22213 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.100924 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.099440 22795 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:06.968739 22624 rpcz_store.cc:276] 0709 12:17:03.173609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.173773 (+   164us) service_pool.cc:224] Handling call
0709 12:17:03.235963 (+ 62190us) log.cc:844] Serialized 494 byte log entry
0709 12:17:04.584275 (+1348312us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b54001e1ca0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f90d142 00007fcb9f8edeaa 00007fcb9f8f4d53 00007fcb9f8f4cd9 00007fcb9f8f4c69 00007fcb9f8f4c31 00007fcb9f8f3dfd 0000000000388634 0000000000388479 00007fcb9c8a7475
0709 12:17:04.767518 (+183243us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b18002ecfc0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f914b26 00007fcb9f90e49a 00007fcb9f90d714
0709 12:17:05.430366 (+662848us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b54001e1ca0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f914b26 00007fcb9f90e49a 00007fcb9f90d714 00007fcb9f8edeaa 00007fcb9f8f4d53 00007fcb9f8f4cd9 00007fcb9f8f4c69 00007fcb9f8f4c31 00007fcb9f8f3dfd 0000000000388634
0709 12:17:06.858766 (+1428400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3400,"raft.queue_time_us":2419,"raft.run_cpu_time_us":25894,"raft.run_wall_time_us":1675047,"spinlock_wait_cycles":15393792,"thread_start_us":825164,"threads_started":1,"wal-append.queue_time_us":891894,"wal-append.run_cpu_time_us":1483,"wal-append.run_wall_time_us":1029065}
W20260709 12:17:07.129491 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.107115 22798 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.134049 22798 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.146166 22696 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.122267 22426 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.134040 22802 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:07.133522 22795 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.187547 22802 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.188279 22769 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.190004 21742 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.149207 22471 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.155457 22678 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.136283 21737 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:07.132730 22213 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:07.134639 21179 consensus_meta.cc:287] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.642s	user 0.003s	sys 0.007s
I20260709 12:17:07.158336 22732 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.105014 22804 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:07.131837 22739 consensus_meta.cc:287] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.001s
I20260709 12:17:07.128455 22684 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.128850 22805 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.170075 22809 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:07.171368 22698 consensus_meta.cc:287] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.000s
I20260709 12:17:07.175357 22389 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.224613 22389 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:07.225075 22389 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.181147 22649 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.189636 22802 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.137066 22808 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.221156 21179 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:07.227197 22808 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:07.228223 22213 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.228055 22808 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.204957 22810 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:07.229184 22810 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.229799 22678 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.230233 22389 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.230554 22804 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:07.231228 20918 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f16c07bcae284f65a7c0ee0375e00769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a62242aa80cd4affa87dc4a3cf6b64ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:07.190012 22788 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:07.231921 22471 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.233181 22696 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.233527 22795 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:07.235294 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 123349us
I20260709 12:17:07.236013 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:07.219453 22798 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.180518 22668 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.194761 22723 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.194633 22789 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:07.241677 22668 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.234813 22810 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.240078 22723 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.240160 22809 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.244503 22723 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.244971 22809 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.246600 22668 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.247247 22668 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:07.247991 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.248185 22668 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.248818 22817 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.249177 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:07.249891 22817 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:07.250329 22817 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:07.252250 22817 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.253100 22814 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.253873 22814 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:07.257341 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 142588us
I20260709 12:17:07.259472 22814 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.260947 22798 consensus_queue.cc:1059] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:07.262042 22798 raft_consensus.cc:3055] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:07.262390 22798 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:07.263233 22798 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.264510 22798 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.254472 22684 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.267836 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:07.272387 21179 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.273906 22684 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.280474 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.281088 21103 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
W20260709 12:17:07.281680 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.281737 22796 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.283274 21103 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:07.284633 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.288666 21034 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:07.293674 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:07.294404 21033 raft_consensus.cc:2393] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:07.297256 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.297871 21104 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.299654 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.299687 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:07.301338 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.301993 21744 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:07.302793 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:07.304836 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:07.300230 21033 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:07.315975 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:07.316877 21029 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:07.321173 21104 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:07.323923 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.324167 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.324599 21103 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:07.324710 21106 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.330900 21106 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:07.324739 21104 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:07.282320 22796 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.333734 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.337191 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.342032 21029 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.338639 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:07.342494 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.343317 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.344513 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.286167 22526 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.341897 21109 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:07.302776 22689 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:07.377153 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.343014 22379 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.387521 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:07.385602 20921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f86692ab0d642a990d934ba6bd6493f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:07.399838 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:07.399034 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 147899us
I20260709 12:17:07.391357 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.399533 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.388785 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:07.383309 21107 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:07.410527 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:07.411882 21029 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:07.411659 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.412540 21182 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:07.406044 21033 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:07.385810 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.412791 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.375234 22689 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:07.413934 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.412127 21183 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.416436 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.412640 21111 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:07.414084 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.414342 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:07.419804 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:07.385170 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:07.422505 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.422181 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.419174 22788 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.429311 21744 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:07.429880 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:07.432101 21151 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.465457 21076 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:07.382268 22526 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.409456 22379 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:07.421180 22698 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.427066 22631 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:07.467512 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.468454 21076 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:07.334724 22626 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:07.469710 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.479496 21151 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.470908 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.472146 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.476337 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:07.483265 21031 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.481110 21111 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:07.489748 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.492045 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.421514 22721 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:17:07.493346 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.465943 22684 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:07.472541 22624 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.476082 22379 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.465495 22704 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:07.516033 22704 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.518215 22704 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.519786 21031 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:07.493920 22626 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.520716 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.521754 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.522173 22626 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.522691 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.523912 21031 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.437322 22505 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:17:07.476397 22696 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.499331 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.497455 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.529908 21111 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:07.530161 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:07.530802 21179 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:07.530810 22789 consensus_queue.cc:1059] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:07.531944 22723 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:07.532218 22704 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:07.473737 22798 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.493558 22688 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.465752 22712 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:17:07.505621 22684 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.473685 22603 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:17:07.534111 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.540139 21033 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:17:07.534751 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.471504 22788 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.531814 22725 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.540787 21029 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.528250 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.538654 21105 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.528384 22769 raft_consensus.cc:2764] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:17:07.523952 22526 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.558455 21105 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:07.487628 22698 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.531677 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:07.541944 21183 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:07.534329 22696 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.536765 22798 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:07.570330 22798 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.568712 22769 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:17:07.561589 22811 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.573915 22811 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:07.576478 21182 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.493654 22631 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.580832 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.584728 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.584941 21744 raft_consensus.cc:2393] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:07.582058 22723 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:07.582749 22739 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.566264 21028 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:07.583628 21111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:07.591094 21111 raft_consensus.cc:606] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:07.591423 21111 raft_consensus.cc:614] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:07.585254 21108 raft_consensus.cc:3055] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.592099 21108 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:07.593441 21028 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.580371 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:07.562352 22688 raft_consensus.cc:3055] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.594278 22687 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.573278 22603 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.599085 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.568390 22796 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.570182 22696 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.597306 21108 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.602234 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:07.594301 22695 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.612632 21183 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:07.626446 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:07.632103 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.633230 21108 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.574743 22811 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.623519 22687 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:07.635066 22810 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.617830 22689 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.638736 22379 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.641665 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.651829 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:07.617599 22688 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:07.652284 22687 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.653033 22684 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.653708 22698 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:07.654274 21741 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.655542 22798 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.655285 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:07.596143 22739 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.656951 21746 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:07.658474 21108 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:07.596836 22723 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.660786 21744 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
W20260709 12:17:07.663326 20999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 2.009s (SENT) [suppressed 13 similar messages]
W20260709 12:17:07.673391 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 200911us
I20260709 12:17:07.637054 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:07.675595 22824 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:17:07.684712 21002 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:07.687223 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.671777 21743 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:07.636324 22603 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.689011 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.676162 22811 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.690120 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.656275 22695 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.696470 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:07.696615 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.697042 22379 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.697350 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:07.699149 22750 log.cc:927] Time spent T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 1.392s	user 0.004s	sys 0.000s
I20260709 12:17:07.699735 21738 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.700769 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.718863 21102 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:07.719712 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.704098 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:07.720710 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:07.706632 22762 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 1.301s	user 0.000s	sys 0.002s
I20260709 12:17:07.709549 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:07.711685 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.715682 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.695300 22788 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:07.679543 22730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.430s	user 0.028s	sys 0.006s
I20260709 12:17:07.703785 21075 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:07.721490 21183 raft_consensus.cc:2410] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:07.721572 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.694741 22684 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.724466 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:07.725735 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.728339 21742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 233) took 1442 ms. Trace:
I20260709 12:17:07.732158 22426 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.733507 22776 raft_consensus.cc:3055] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:07.739060 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1654) took 2498 ms. Trace:
I20260709 12:17:07.742026 22714 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.678809 22626 consensus_queue.cc:1059] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:17:07.716288 21111 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:07.785663 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.795909 21102 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:07.789076 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.796826 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:07.797024 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 93308.8us
I20260709 12:17:07.797864 21075 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:07.787887 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 970) took 3254 ms. Trace:
I20260709 12:17:07.795349 21182 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.717478 22688 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:07.798238 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.801159 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.801379 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 265459us
I20260709 12:17:07.750669 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:07.801702 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 321106us
I20260709 12:17:07.798667 21111 raft_consensus.cc:2393] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:07.803474 21151 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:07.802829 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.803534 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:07.799214 21742 rpcz_store.cc:276] 0709 12:17:06.286293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.291425 (+  5132us) service_pool.cc:224] Handling call
0709 12:17:06.291706 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.190380 (+898674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.728099 (+537719us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54006a6b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:07.728265 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065448832}
W20260709 12:17:07.798990 22730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.551s	user 0.028s	sys 0.012s
I20260709 12:17:07.800508 21075 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:07.800145 21035 rpcz_store.cc:276] 0709 12:17:04.531762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.531866 (+   104us) service_pool.cc:224] Handling call
0709 12:17:04.532205 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.532536 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.532563 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:04.863323 (+330760us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b18003f8b00. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a
0709 12:17:05.365614 (+502291us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b2c00058028. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:17:05.378382 (+ 12768us) log.cc:844] Serialized 26 byte log entry
0709 12:17:06.050901 (+672519us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:06.436126 (+385225us) log.cc:844] Serialized 14 byte log entry
0709 12:17:06.491127 (+ 55001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.491211 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.274590 (+783379us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4800080358. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f 00007fcba49abf37 00007fcba49c055c 00007fcba49c0508 00007fcba49c0488 00007fcba49c0443 00007fcba49bf6ec 00007fcba38e9a96
0709 12:17:07.602733 (+328143us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:07.785657 (+182924us) raft_consensus.cc:1685] finished
0709 12:17:07.785678 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.785801 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54719,"prepare.queue_time_us":252457,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":7675,"raft.queue_time_us":58191,"raft.run_cpu_time_us":1554,"raft.run_wall_time_us":787893,"spinlock_wait_cycles":68304768,"thread_start_us":948857,"threads_started":2,"wal-append.queue_time_us":832818}
I20260709 12:17:07.802601 21185 rpcz_store.cc:276] 0709 12:17:05.240499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.471946 (+231447us) service_pool.cc:224] Handling call
0709 12:17:05.472245 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:05.586131 (+113886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.586160 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:05.599488 (+ 13328us) log.cc:844] Serialized 26 byte log entry
0709 12:17:06.220691 (+621203us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:06.248032 (+ 27341us) log.cc:844] Serialized 14 byte log entry
0709 12:17:06.256649 (+  8617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.256719 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.043561 (+786842us) spinlock_profiling.cc:243] Waited 999 us on lock 0x7b18003a8b80. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f
0709 12:17:07.090757 (+ 47196us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b480024da58. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f 00007fcba49abf37 00007fcba49c055c 00007fcba49c0508 00007fcba49c0488 00007fcba49c0443 00007fcba49bf6ec 00007fcba38e9a96
0709 12:17:07.735389 (+644632us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b18003a8b80. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:07.738802 (+  3413us) raft_consensus.cc:1685] finished
0709 12:17:07.738825 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.738967 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123032,"prepare.queue_time_us":27166,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":125085,"raft.run_cpu_time_us":4549,"raft.run_wall_time_us":841140,"spinlock_wait_cycles":67968896,"thread_start_us":498674,"threads_started":1,"wal-append.queue_time_us":642576}
I20260709 12:17:07.779532 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:07.789007 22631 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:07.722683 21739 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:07.797634 22796 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:07.801255 22639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.007s	sys 0.036s
I20260709 12:17:07.808687 21111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:07.809571 21185 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.811164 21151 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.812436 21032 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.803718 22638 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.761790 22655 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:07.802414 22776 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:07.812063 21103 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:07.813261 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 149964us
I20260709 12:17:07.812755 21108 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:07.813735 21111 raft_consensus.cc:606] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:07.751197 22822 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.832640 21111 raft_consensus.cc:614] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:07.832213 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:07.823505 22639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.007s	sys 0.036s
I20260709 12:17:07.808601 21149 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.809517 22688 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.838645 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.838868 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.839373 21103 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.840354 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:07.843604 21103 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:07.761168 21712 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:07.810292 22788 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:07.846531 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.852687 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:07.848475 20999 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.813251 22526 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:07.855350 21182 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:07.812110 22684 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:07.847211 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:07.848212 21709 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:07.848595 22838 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:07.851523 22835 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:17:07.855644 20999 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.831233 22638 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:07.835239 22655 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.847947 22712 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.880527 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 990) took 1294 ms. Trace:
I20260709 12:17:07.888311 21149 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:07.893033 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:07.893976 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.831602 22846 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.839128 22730 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:07.881723 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.831218 22804 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:17:07.901420 22624 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:07.901979 22624 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.897615 22839 raft_consensus.cc:2764] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:07.898114 22323 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.904022 22624 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:07.899626 22379 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.904615 22774 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:07.888736 22689 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.904963 22774 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:07.905282 22689 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.905656 22689 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.906985 22712 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.907649 21107 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:07.908783 21107 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:07.897125 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 59913.5us
I20260709 12:17:07.847885 22843 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.856949 22668 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.891779 21036 rpcz_store.cc:276] 0709 12:17:06.560572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.560789 (+   217us) service_pool.cc:224] Handling call
0709 12:17:06.561075 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.693525 (+132450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.855134 (+1161609us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540004b854. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:07.855288 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302897920}
I20260709 12:17:07.888620 22698 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.899797 22731 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.859545 22788 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:07.908416 22774 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.892139 22638 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.881368 22426 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:07.911371 22603 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:07.852049 22822 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:07.858356 22815 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.858822 22739 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.896347 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:07.900795 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 178688us
I20260709 12:17:07.914834 22842 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.916262 22846 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:07.918128 22712 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:07.925287 21149 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:07.904526 22379 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:08.087061 22379 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.036113 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:08.093216 21107 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:07.923151 22695 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:07.907534 22810 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:08.064380 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 168102us
I20260709 12:17:08.102397 20999 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:07.913906 22838 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:08.074653 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 149434us
I20260709 12:17:08.103907 21149 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:08.104700 21149 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:08.077281 22825 raft_consensus.cc:3055] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.926707 22698 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:08.106449 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:08.109692 20999 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:08.065691 22731 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.942561 22624 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.154s
I20260709 12:17:08.114779 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:08.111233 22695 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.127997 22825 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:08.143903 22825 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.144833 22825 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.114401 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:08.147957 22834 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 12:17:08.149657 22798 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:08.116008 20999 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:08.116928 22439 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:08.120796 22755 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:08.150228 22798 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:08.150628 22439 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.150810 22755 raft_consensus.cc:697] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:08.151088 22439 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.151803 22755 consensus_queue.cc:237] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:08.125516 22759 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 1.644s	user 0.003s	sys 0.000s
I20260709 12:17:08.107335 22838 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.156239 22838 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.158579 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:08.159461 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 133) took 1787 ms. Trace:
I20260709 12:17:08.159839 21027 rpcz_store.cc:276] 0709 12:17:06.372054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.372256 (+   202us) service_pool.cc:224] Handling call
0709 12:17:06.392072 (+ 19816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.676570 (+284498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.676604 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.676646 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:06.676675 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.159263 (+1482588us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54000c5dd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:08.159308 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:08.159411 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653769600}
I20260709 12:17:08.161950 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:08.159413 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:08.163956 21743 raft_consensus.cc:2393] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:08.163290 22603 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:08.164201 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 62292.8us
I20260709 12:17:08.164649 22603 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:08.165040 22603 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.898046 22776 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.107563 22810 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.113858 22788 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:08.170598 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54661.6us
I20260709 12:17:08.172132 20999 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:08.173620 20999 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:08.183205 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1318) took 1258 ms. Trace:
I20260709 12:17:08.183619 21177 rpcz_store.cc:276] 0709 12:17:06.924761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.106397 (+181636us) service_pool.cc:224] Handling call
0709 12:17:07.106568 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.127529 (+ 20961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:07.127594 (+    65us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:07.127635 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:07.127662 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.166570 (+1038908us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b1800152da0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419
0709 12:17:08.182947 (+ 16377us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b54002017d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:08.183004 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:08.183149 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":179,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3636,"spinlock_wait_cycles":51403776}
I20260709 12:17:08.185148 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.186394 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.188948 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:08.164372 22843 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.187024 22789 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:08.161862 22774 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.137250 22712 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:08.095757 22684 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.171308 22792 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.190986 22685 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.193459 22668 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.213320 21182 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.195993 22815 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:08.157945 22439 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.164202 22379 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.190438 22704 consensus_queue.cc:1059] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:17:08.217290 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 302808us
I20260709 12:17:08.200934 22756 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.197841 22712 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:08.227003 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:08.230039 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:08.232700 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 128064us
I20260709 12:17:08.232643 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:08.234063 21149 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:08.216830 22631 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:17:08.230645 22712 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.232681 22769 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.224974 22689 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.224664 22792 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:17:08.243606 22807 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 1.111s	user 0.012s	sys 0.020s
W20260709 12:17:08.245326 22801 log.cc:927] Time spent T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Append to log took a long time: real 1.111s	user 0.000s	sys 0.022s
I20260709 12:17:08.215808 22698 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.238494 22624 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.247284 22379 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:08.242388 22849 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:17:08.235567 22688 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:08.256618 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 67511.4us
I20260709 12:17:08.236961 22842 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
W20260709 12:17:08.249639 22455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.749s	user 0.016s	sys 0.015s
I20260709 12:17:08.272048 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:08.255914 22788 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:08.247879 21712 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:08.265214 22455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.771s	user 0.016s	sys 0.015s
I20260709 12:17:08.255666 22624 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:08.245693 22603 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.266607 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:08.288239 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.277274 22685 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:08.272058 22681 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:17:08.270171 22655 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.274682 22688 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:17:08.274286 22668 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:17:08.293187 22624 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.313354 22439 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:08.316509 22734 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:08.321988 22695 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:08.294365 22704 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.292492 22855 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:08.323513 22689 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:08.324389 22638 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.325870 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:08.326821 22603 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:08.327621 22850 log.cc:927] Time spent T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:17:08.328138 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:08.328787 21179 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:08.326561 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:08.294081 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 56551.9us
I20260709 12:17:08.302181 22838 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:08.326766 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.300164 22455 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:08.362646 22783 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 1.951s	user 0.008s	sys 0.007s
I20260709 12:17:08.371037 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:06.249076 21181 rpcz_store.cc:276] 0709 12:17:04.776979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.299916 (+522937us) service_pool.cc:224] Handling call
0709 12:17:05.307587 (+  7671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:05.307787 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:05.596641 (+288854us) log.cc:844] Serialized 14 byte log entry
0709 12:17:06.248298 (+651657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.248354 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:06.248394 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.248471 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.248588 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30847,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":4947,"thread_start_us":912762,"threads_started":2}
I20260709 12:17:08.372957 21182 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.381979 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:08.609639 21027 raft_consensus.cc:606] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:08.610350 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 228415us
I20260709 12:17:08.373623 21077 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:17:08.531288 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.326483 22810 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.374889 22842 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.553943 21111 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:08.554407 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.561329 22455 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.562597 22638 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:08.563195 21712 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:08.564994 22838 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:08.565996 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.579820 22712 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.374800 22685 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:08.375507 22734 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:08.581663 22799 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:08.584272 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:08.383562 22439 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.202s
I20260709 12:17:08.586241 22655 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:08.384472 22855 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.383591 22860 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.620464 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:08.673128 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:08.623737 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:08.625331 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:08.741613 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:08.743136 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:08.712000 22825 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:08.665828 22842 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.666177 22810 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:08.666795 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:08.668176 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 294610us
I20260709 12:17:08.758203 21077 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:08.672554 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:08.659065 22815 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.714103 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:08.669934 22692 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.712373 22638 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.738919 21183 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.740806 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:08.738121 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 175008us
I20260709 12:17:08.712180 22686 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:08.743691 21035 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.665225 22668 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.750237 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:08.736680 22734 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.763131 21030 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:08.715508 22799 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:08.762575 21029 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:08.622331 21028 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:08.715179 22685 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.794814 21034 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.758960 22862 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:08.777889 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.749883 22860 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:17:08.767017 22810 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.751912 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:08.782189 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.802067 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1216) took 1190 ms. Trace:
I20260709 12:17:08.766888 22692 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:17:08.805106 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.804785 21111 rpcz_store.cc:276] 0709 12:17:07.611375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.849165 (+237790us) service_pool.cc:224] Handling call
0709 12:17:07.849397 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:08.618015 (+768618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.801828 (+183813us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54000f9454. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:08.802007 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619800448}
I20260709 12:17:08.808822 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.810752 21178 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:08.811488 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.812214 21178 raft_consensus.cc:2410] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:08.777698 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.765409 22638 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.789237 22855 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:08.819823 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.804232 22734 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.768551 22686 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.804523 22810 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:08.808789 22655 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.826923 21035 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:08.806836 22825 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.808064 22852 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:08.801375 22774 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:17:08.837478 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:08.840085 22684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.009s	sys 0.041s
W20260709 12:17:08.840559 22684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.009s	sys 0.041s
I20260709 12:17:08.842602 21151 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:08.825999 22801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.029s
I20260709 12:17:08.851550 21028 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:08.851681 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 63725.6us
I20260709 12:17:08.831259 22810 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.803767 22862 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:08.848026 22767 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 2.438s	user 0.014s	sys 0.019s
I20260709 12:17:08.836880 22825 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.815173 22692 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.802932 22799 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:08.871189 22801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.007s	sys 0.030s
I20260709 12:17:08.870347 22704 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.833441 22655 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.881397 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.872831 22712 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:08.881999 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:08.914088 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 155956us
I20260709 12:17:08.875705 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:08.838630 22852 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:08.919317 22704 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:08.885373 22603 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.952677 21180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1652) took 3712 ms. Trace:
I20260709 12:17:08.953773 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:08.884100 22843 consensus_queue.cc:1059] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:17:08.954872 21180 rpcz_store.cc:276] 0709 12:17:05.239999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.699906 (+459907us) service_pool.cc:224] Handling call
0709 12:17:05.728341 (+ 28435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:05.734539 (+  6198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.734571 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:05.855953 (+121382us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b18003028c0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a
0709 12:17:05.856842 (+   889us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b2c00061b88. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:17:05.895231 (+ 38389us) log.cc:844] Serialized 26 byte log entry
0709 12:17:06.299510 (+404279us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:06.411294 (+111784us) log.cc:844] Serialized 14 byte log entry
0709 12:17:06.492715 (+ 81421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.492782 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:08.755470 (+2262688us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:08.952428 (+196958us) raft_consensus.cc:1685] finished
0709 12:17:08.952456 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:08.952607 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130465,"prepare.queue_time_us":60170,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":144847,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":22383,"spinlock_wait_cycles":173213824,"thread_start_us":438170,"threads_started":2,"wal-append.queue_time_us":502334}
W20260709 12:17:08.957756 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 75819.7us
I20260709 12:17:08.958534 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:08.894068 22867 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:08.958653 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 126232us
I20260709 12:17:08.961930 22684 consensus_queue.cc:1059] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:08.964298 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.965162 21178 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:08.967111 22687 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.954816 22799 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.997287 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:08.993283 21000 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:08.950739 22842 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:08.998179 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.962602 22455 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:08.964587 22689 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.995092 22803 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:09.000207 22685 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:09.023564 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 69792.5us
I20260709 12:17:09.026957 22686 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.006742 22455 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:09.030215 21077 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:09.036890 22877 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:09.037086 21103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:09.037497 22872 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:09.037971 22685 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.995226 22867 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:09.064677 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.024561 22689 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:09.076984 22862 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.026347 22684 raft_consensus.cc:3055] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.024459 22638 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.064678 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:09.067013 22870 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:17:09.081624 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:09.069077 22686 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.067258 22455 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.102749 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:09.068087 22774 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.077847 22689 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.114319 22774 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:09.083889 22868 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:17:09.117076 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.117185 22774 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.117766 21186 raft_consensus.cc:2393] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:09.118408 22723 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:09.119066 22814 raft_consensus.cc:3055] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.119462 22814 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:09.120261 22814 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.121019 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.121229 22814 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.123584 22513 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:09.124054 22513 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.118530 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.113176 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:09.106139 22873 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:09.114073 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.071311 22685 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:09.026089 22803 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:09.107869 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 107080us
I20260709 12:17:09.126361 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.184211 21186 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:09.126314 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:09.071839 22895 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:09.187405 21000 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:09.131714 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:09.127549 21184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 114) took 1868 ms (client timeout 1720 ms). Trace:
I20260709 12:17:09.133073 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:09.188606 21184 rpcz_store.cc:269] 0709 12:17:07.259339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.267591 (+  8252us) service_pool.cc:224] Handling call
0709 12:17:09.127365 (+1859774us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540015de54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:09.127489 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3799178496}
I20260709 12:17:09.188865 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:09.189817 21027 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.189911 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.190166 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.192005 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:09.194388 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:09.195966 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:09.196535 21102 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.083591 22684 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:09.207935 21033 raft_consensus.cc:1240] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.080134 22860 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.204268 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:09.188119 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.189076 22685 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.209914 21744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32986 (request call id 240) took 1470 ms. Trace:
I20260709 12:17:09.105412 22638 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.187783 22723 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:09.202314 22878 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.133s	user 0.000s	sys 0.002s
W20260709 12:17:09.202461 22826 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 1.756s	user 0.031s	sys 0.025s
I20260709 12:17:09.260515 21102 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:09.273548 21027 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:09.275568 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.127513 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:09.187563 21035 raft_consensus.cc:2410] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:09.072539 22872 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.289165 21744 rpcz_store.cc:276] 0709 12:17:07.715836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.716294 (+   458us) service_pool.cc:224] Handling call
0709 12:17:09.126163 (+1409869us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b5800004598. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:17:09.186017 (+ 59854us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20899072}
I20260709 12:17:09.069962 22877 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.300892 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:09.303736 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.300868 21104 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:09.311726 21027 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:09.304667 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:09.274682 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 247480us
I20260709 12:17:09.323540 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.298398 22825 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.329703 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:09.330317 21104 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.331663 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.333545 21102 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:09.312282 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:09.315735 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 239868us
I20260709 12:17:09.334332 21186 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.334987 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 128) took 1141 ms. Trace:
I20260709 12:17:09.341531 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.335304 21186 rpcz_store.cc:276] 0709 12:17:08.193899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.333854 (+1139955us) service_pool.cc:224] Handling call
0709 12:17:09.334158 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.334732 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.334930 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:09.344419 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 129) took 1143 ms. Trace:
I20260709 12:17:09.344805 21186 rpcz_store.cc:276] 0709 12:17:08.201219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.343682 (+1142463us) service_pool.cc:224] Handling call
0709 12:17:09.343956 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.344135 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.344160 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:09.344200 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:09.344229 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.344279 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:09.344370 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:09.308095 22860 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.304970 22655 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.295264 22638 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:09.363258 21110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1181) took 3775 ms (client timeout 2009 ms). Trace:
W20260709 12:17:09.364121 21110 rpcz_store.cc:269] 0709 12:17:05.583307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.583517 (+   210us) service_pool.cc:224] Handling call
0709 12:17:09.358854 (+3775337us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400253ad4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:09.358977 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384932224}
I20260709 12:17:09.362469 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:09.328083 22686 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:09.328293 22723 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.337909 22838 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.215969 22873 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.374918 22803 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:09.375449 22734 consensus_meta.cc:287] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.000s
W20260709 12:17:09.375600 22876 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:17:09.375809 21739 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:09.376155 22655 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:09.336501 22852 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.345821 22862 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:09.226922 22895 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.361189 22896 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:09.385141 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 299435us
I20260709 12:17:09.419548 21077 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:09.420675 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:09.421911 21077 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:09.393889 21104 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:09.397421 21711 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:09.367228 22774 consensus_queue.cc:1059] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:17:09.383975 22843 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:09.383495 22885 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:09.366711 22860 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.423781 21104 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:09.399693 22692 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.404599 22908 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.431107 22903 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.396224 22838 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.434262 22873 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.387171 22686 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.399482 22867 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:09.434983 22893 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:09.435652 22872 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.438457 22905 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.439047 22913 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.440313 22638 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.387689 22723 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.482646 21149 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:09.448525 22908 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.442554 22843 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.450716 22903 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.499176 22895 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:09.481184 22874 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:17:09.506781 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:09.428194 22655 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:09.509819 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 112469us
I20260709 12:17:09.428592 22862 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.515919 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:09.489319 22873 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.449079 22890 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:17:09.447355 22692 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:09.514983 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.508104 22883 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.510166 22852 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.444331 22885 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:09.513952 22624 consensus_meta.cc:287] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 1.141s	user 0.008s	sys 0.003s
I20260709 12:17:09.515064 22638 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:09.512223 22901 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:09.528680 22723 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.529137 22846 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.529527 22846 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.529667 22838 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:17:09.529907 22846 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.517915 22734 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.532141 22686 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:09.534440 22799 consensus_meta.cc:287] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.535s	user 0.004s	sys 0.003s
I20260709 12:17:09.536365 22843 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:09.539404 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1338) took 1845 ms. Trace:
I20260709 12:17:09.539781 21183 rpcz_store.cc:276] 0709 12:17:07.693654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.308716 (+615062us) service_pool.cc:224] Handling call
0709 12:17:08.330058 (+ 21342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:08.762061 (+432003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.539185 (+777124us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54002634d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:09.539347 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939770752}
I20260709 12:17:09.540680 22685 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.541015 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.542368 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 122) took 1966 ms. Trace:
I20260709 12:17:09.539692 22846 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.544817 22846 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.527063 22624 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.550235 22860 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.550639 22638 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:09.551024 21181 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:09.551007 21185 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:09.551311 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.551476 22638 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.552146 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1334) took 2253 ms. Trace:
I20260709 12:17:09.547482 22692 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.542719 21182 rpcz_store.cc:276] 0709 12:17:07.575672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.241185 (+665513us) service_pool.cc:224] Handling call
0709 12:17:08.257503 (+ 16318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:08.611690 (+354187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.542156 (+930466us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b54003fcd54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:09.542314 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172571520}
I20260709 12:17:09.552771 22917 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.553140 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.553830 22877 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.554293 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.517562 22913 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:09.552496 21185 rpcz_store.cc:276] 0709 12:17:07.298724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.814265 (+515541us) service_pool.cc:224] Handling call
0709 12:17:08.259917 (+445652us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:17:09.377134 (+1117217us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fe9c 00007fcb9c86fa5b 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:17:09.550545 (+173411us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86feee 000000000036eb39 00007fcba48e31e0 00007fcba49ac0c4 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:17:09.550695 (+   150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.551916 (+  1221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.552086 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68031104}
I20260709 12:17:09.555503 22903 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.556030 21185 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:09.556720 22687 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.589s	user 0.004s	sys 0.005s
I20260709 12:17:09.556656 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1342) took 1305 ms. Trace:
I20260709 12:17:09.557286 21185 rpcz_store.cc:276] 0709 12:17:08.251172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.555625 (+1304453us) service_pool.cc:224] Handling call
0709 12:17:09.555867 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.556418 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.556602 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:09.557767 22842 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.558344 22908 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.558216 22842 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:09.546280 22810 consensus_meta.cc:287] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.668s	user 0.007s	sys 0.000s
I20260709 12:17:09.534395 22885 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.528676 22901 raft_consensus.cc:697] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:09.542698 22685 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:09.553141 22917 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:09.586931 22917 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:09.609508 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 407456us
W20260709 12:17:09.613225 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 122367us
I20260709 12:17:09.613302 21000 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:09.615216 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.616367 21000 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:09.512709 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 159469us
I20260709 12:17:09.620025 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:09.620594 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 198616us
I20260709 12:17:09.621886 21077 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:09.624897 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 108941us
I20260709 12:17:09.624836 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.626034 21108 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:09.626121 21149 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:09.627460 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.628278 21108 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:09.628412 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:09.629395 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:09.631153 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:09.632120 21033 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:09.640935 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:09.642192 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:09.558342 21185 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:09.643321 21182 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:09.644157 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1674) took 1255 ms. Trace:
I20260709 12:17:09.644655 21185 rpcz_store.cc:276] 0709 12:17:08.389488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.557937 (+1168449us) service_pool.cc:224] Handling call
0709 12:17:09.558188 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.643500 (+ 85312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.643937 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:09.645246 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:09.646301 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.541607 21183 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:09.648137 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.649101 21183 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:09.650414 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.652398 22455 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:09.653496 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.653855 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:09.654718 21739 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:09.655368 22455 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:09.656186 22455 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.656670 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:09.657245 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:09.657457 21739 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:09.653766 21185 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
W20260709 12:17:09.659373 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:09.659409 22513 consensus_meta.cc:287] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.000s
I20260709 12:17:09.550660 22624 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.660029 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:09.660953 22624 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.661857 22624 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:09.662427 21741 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:09.662992 22624 raft_consensus.cc:3055] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.663415 22624 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:09.665016 22624 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.660056 22513 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.666502 22624 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.668473 22513 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.670022 21111 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:09.670944 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:09.671954 22638 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.672037 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.673492 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:09.674698 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.675658 21182 raft_consensus.cc:2410] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:09.676467 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.677296 21182 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:09.678112 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.574810 22810 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:09.582278 22815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.007s	sys 0.007s
I20260709 12:17:09.679448 21183 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:09.696740 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:09.681936 22655 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:09.660029 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.699144 21185 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:09.685132 22805 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.702133 21183 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.687207 22810 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.688100 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:09.708563 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 1767) took 2415 ms. Trace:
I20260709 12:17:09.708950 21034 rpcz_store.cc:276] 0709 12:17:07.292838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.292934 (+    96us) service_pool.cc:224] Handling call
0709 12:17:07.293183 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:08.797308 (+1504125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.708036 (+910728us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54000c4ed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:09.708361 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3452997376}
I20260709 12:17:09.712481 21105 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.713739 21105 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.678817 21182 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:17:09.694164 22803 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.722441 22803 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.682013 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:09.688993 22815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.007s	sys 0.007s
I20260709 12:17:09.735351 22867 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.735998 22861 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.737028 22917 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.737358 22867 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.738073 22867 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.738384 22862 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.584636 22901 consensus_queue.cc:237] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.738307 22686 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.746397 21108 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:09.751626 21183 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:09.738802 21178 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.743408 22867 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:09.748600 22526 consensus_queue.cc:1175] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:17:09.747141 22686 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.762080 22803 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:09.762609 22815 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:09.763474 21182 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.764015 22815 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.749641 22886 raft_consensus.cc:3055] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.642640 21177 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:09.767220 22886 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:17:09.771727 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 91072.3us
W20260709 12:17:09.773523 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 85617.3us
I20260709 12:17:09.741065 22872 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.736961 22861 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.779978 22889 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.780493 22889 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:09.780951 22889 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.784605 22723 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:09.785087 22723 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:09.785562 22723 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.780299 22883 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:09.780303 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:09.776294 22872 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.787317 22861 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.792332 21150 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:09.794732 22799 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:09.793365 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:09.785022 22862 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.796576 22862 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.789302 22883 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.799913 22883 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:09.800572 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.795926 22799 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:09.819294 21108 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:09.819495 22862 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:09.823246 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:09.825234 21183 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:09.825892 22931 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.826608 22931 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.836830 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.770196 22886 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.801033 22928 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.797194 22684 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.840071 22931 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.841672 21746 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:09.841535 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:09.842248 22921 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.843701 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.805560 22799 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:09.847259 22712 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:09.822305 22704 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.789180 22872 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.869308 22789 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:09.869921 22789 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:09.871500 22756 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.871922 22756 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:09.849920 22886 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.876227 21105 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:17:09.876700 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 47883.5us
I20260709 12:17:09.879014 22873 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.880962 22684 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.882346 21105 pending_rounds.cc:85] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 4
I20260709 12:17:09.884138 22921 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.859629 22712 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:09.889428 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 1685) took 1125 ms. Trace:
I20260709 12:17:09.873076 22756 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.891134 21181 rpcz_store.cc:276] 0709 12:17:08.763830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.766149 (+  2319us) service_pool.cc:224] Handling call
0709 12:17:09.889045 (+1122896us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54002620d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:09.889259 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731497472}
I20260709 12:17:09.896405 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:09.896591 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 49424us
I20260709 12:17:09.897257 21181 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:09.885718 21105 pending_rounds.cc:107] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:17:09.900404 21105 raft_consensus.cc:2889] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:09.901793 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 60235.5us
I20260709 12:17:09.902667 21709 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:09.904194 22825 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.904603 22825 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.904927 22825 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.905885 22926 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:09.922749 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:09.901826 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 259797us
I20260709 12:17:09.921684 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:09.900036 22861 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:09.937875 22718 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:09.925738 22756 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.939034 22714 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:17:09.937914 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1095) took 2403 ms. Trace:
I20260709 12:17:09.946465 21105 rpcz_store.cc:276] 0709 12:17:07.534942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.538235 (+  3293us) service_pool.cc:224] Handling call
0709 12:17:07.538526 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.711352 (+2172826us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b4c00303f80. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9dc60a20 00007fcb9dc71a29 00007fcb9dc37644 00007fcb9dc5ef2d 00007fcb9dc5eb93 00007fcb9f98f18b 00007fcb9f98fcb5 00007fcb9f98af30 00007fcb9f98c7de 00007fcb9f996b49 00007fcb9f997416
0709 12:17:09.936311 (+224959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.937838 (+  1527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63448960}
W20260709 12:17:09.938181 22804 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:17:09.951506 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:09.957252 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54668us
I20260709 12:17:09.938570 22718 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:09.982677 22723 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.986249 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:09.987534 22895 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.988149 22895 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.990412 22895 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:09.991127 21108 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:09.991470 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.993779 22858 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:09.993682 21102 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:09.999553 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:09.971166 22730 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.005719 21033 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.992036 22723 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:09.994483 22858 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:09.967330 22799 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.021427 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:10.023084 22842 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:10.002192 22921 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.028127 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.019134 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:10.033342 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.034070 21184 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:17:10.028560 21000 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:10.038959 21149 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:10.041894 22505 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:10.044035 22505 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.044202 22843 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:10.046183 22505 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:10.043752 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.048153 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.048801 21105 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:10.049647 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:10.050258 21105 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.048166 22712 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.052412 22712 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.059989 22323 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:10.061796 22730 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.062659 21184 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:10.065853 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.065996 22730 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.067405 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.069579 22921 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.070178 22921 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.072286 22921 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:10.071274 22686 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:10.075443 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 144) took 1282 ms. Trace:
I20260709 12:17:10.075620 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:10.076509 21739 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:10.076824 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:10.078271 21180 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:10.079579 21180 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:10.079913 21102 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:10.080998 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.081700 21102 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:10.083031 21075 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:10.084982 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.075816 21028 rpcz_store.cc:276] 0709 12:17:08.792835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.792942 (+   107us) service_pool.cc:224] Handling call
0709 12:17:08.793199 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:08.868588 (+ 75389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.074995 (+1206407us) spinlock_profiling.cc:243] Waited 58.2 ms on lock 0x7b540042e5d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:10.075265 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133798144}
I20260709 12:17:10.091147 21709 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:10.099684 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 60831.5us
I20260709 12:17:10.097115 22714 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.107151 22718 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:10.108645 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1345) took 1439 ms. Trace:
W20260709 12:17:10.109702 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.108996 21185 rpcz_store.cc:276] 0709 12:17:08.669381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.700609 (+1031228us) service_pool.cc:224] Handling call
0709 12:17:09.701174 (+   565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.701589 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.701613 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.722507 (+ 20894us) log.cc:844] Serialized 26 byte log entry
0709 12:17:09.997515 (+275008us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:09.997550 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.997608 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.108409 (+110801us) raft_consensus.cc:1685] finished
0709 12:17:10.108443 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.108568 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":274405,"threads_started":1,"wal-append.queue_time_us":340665}
I20260709 12:17:10.111619 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:17:10.113798 22894 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.904s	user 0.000s	sys 0.004s
I20260709 12:17:10.104698 22799 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.121335 22455 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.122156 21178 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:10.100968 22686 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:10.123136 22686 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.123538 22686 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:10.122045 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 113043us
W20260709 12:17:10.125586 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.079272 22789 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.123353 22889 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.134178 22858 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:10.087123 22906 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:17:10.136050 22889 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.137229 21180 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:10.137611 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:10.138881 21149 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:10.139364 22789 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:10.140126 22789 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.138527 22455 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:10.141676 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 124498us
W20260709 12:17:10.140779 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.123801 22872 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.150269 21105 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:10.140779 22789 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.142284 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:10.150836 21000 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:10.152742 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.157547 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.161811 21102 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:10.151011 22455 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.162283 21149 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:10.165741 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.166801 22774 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:10.156351 22323 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:10.169348 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.169955 21105 raft_consensus.cc:2393] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 2: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:10.161209 22858 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.176141 22872 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.177302 22822 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:10.178956 22901 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 12:17:10.183413 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.163373 22921 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:10.184314 22896 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.163288 22906 consensus_queue.cc:1243] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:10.184790 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.185439 22893 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:10.171607 22323 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:10.186246 22889 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.186597 22935 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:17:10.189581 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.169530 22455 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.202183 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:10.182189 22858 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.220479 22825 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.221975 22921 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.223068 22823 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:10.223507 22823 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:10.223954 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1103) took 1019 ms. Trace:
I20260709 12:17:10.224470 22823 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.225405 22681 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.225584 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.225858 22823 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.226326 21741 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:17:10.226701 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.200086 22712 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:10.199429 22323 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.230707 21077 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:10.231879 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 48360.6us
W20260709 12:17:10.224615 22689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.022s	sys 0.017s
I20260709 12:17:10.224342 21104 rpcz_store.cc:276] 0709 12:17:09.204403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.429729 (+225326us) service_pool.cc:224] Handling call
0709 12:17:09.452383 (+ 22654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.452589 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.452614 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.481732 (+ 29118us) log.cc:844] Serialized 26 byte log entry
0709 12:17:09.998453 (+516721us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:10.010925 (+ 12472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.010996 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.223650 (+212654us) raft_consensus.cc:1685] finished
0709 12:17:10.223669 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.223781 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":444556,"threads_started":1,"wal-append.queue_time_us":500353}
I20260709 12:17:10.206612 22858 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.224288 22921 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.208770 22730 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.180174 22774 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.248203 21102 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:10.249215 22839 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:10.235085 22689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.022s	sys 0.017s
I20260709 12:17:10.254792 21030 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:10.255034 22864 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.255884 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.257120 22872 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.257304 22513 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:10.257622 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1225) took 1059 ms. Trace:
I20260709 12:17:10.204246 22883 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:10.259534 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.259609 22893 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.231184 22712 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:10.267530 21149 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:10.238678 22789 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:10.274187 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:10.278861 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.280202 22776 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.280531 21031 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:10.281457 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.281791 22872 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.309697 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.310366 21027 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:10.311399 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.312029 21027 raft_consensus.cc:2368] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:10.312734 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.314047 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.308465 21031 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:10.308136 21184 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:10.315670 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.316272 21104 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:10.317340 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:10.308234 22864 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.319388 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.320133 21031 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:10.320845 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.321365 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.322075 21034 raft_consensus.cc:2393] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:10.323145 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.308264 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:10.324836 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 96674.3us
I20260709 12:17:10.309051 21102 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.327190 22685 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.328169 22685 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.329762 22685 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:10.330477 22685 consensus_queue.cc:1243] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:10.330571 22899 consensus_queue.cc:1059] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:10.331022 22901 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:10.331385 22901 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:10.331743 22899 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:10.332078 22899 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:10.332397 22872 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.332196 22901 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.282267 22730 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.332940 22899 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.333611 21031 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 2: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:10.315145 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.335143 21744 raft_consensus.cc:2368] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6.
I20260709 12:17:10.335032 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.332954 22872 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:10.325129 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.337136 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.337674 21028 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.339270 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:17:10.339936 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 51245us
I20260709 12:17:10.334537 22730 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.336058 22872 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:10.333385 22901 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.314966 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 1768) took 2951 ms. Trace:
I20260709 12:17:10.342824 21104 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:10.235275 22889 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.322775 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:10.344442 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 73065.3us
I20260709 12:17:10.347690 21034 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:10.345153 21036 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
W20260709 12:17:10.280539 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.350126 21102 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:10.345547 21032 rpcz_store.cc:276] 0709 12:17:07.293115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.295032 (+  1917us) service_pool.cc:224] Handling call
0709 12:17:07.295296 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.814768 (+519472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.204646 (+2389878us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b5400223dd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:10.244311 (+ 39665us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188922752}
I20260709 12:17:10.281783 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.351560 21033 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
W20260709 12:17:10.347218 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 114767us
I20260709 12:17:10.340204 22689 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:10.272324 22712 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.361006 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.336098 22883 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:10.361737 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:10.362301 21102 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.362819 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:10.363176 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 159162us
I20260709 12:17:10.365353 21035 raft_consensus.cc:2393] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:10.369467 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.369670 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.370261 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:10.372051 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.370350 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.374395 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:10.375667 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:10.376698 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.350566 22789 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:10.278791 22825 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.373436 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.341482 22872 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.266353 21107 rpcz_store.cc:276] 0709 12:17:09.197889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.198027 (+   138us) service_pool.cc:224] Handling call
0709 12:17:09.198337 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.312781 (+114444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.312815 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.332715 (+ 19900us) log.cc:844] Serialized 26 byte log entry
0709 12:17:09.356925 (+ 24210us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:10.256597 (+899672us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b18003c5f80. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9f53c4bc 00007fcb9c88a48b 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a4455 00007fcba338c3c7 00007fcb9f99e9a7 00007fcb9f9ae0bf
0709 12:17:10.256788 (+   191us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.257123 (+   335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.257214 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.257269 (+    55us) raft_consensus.cc:1685] finished
0709 12:17:10.257341 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.257460 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8020,"prepare.queue_time_us":127835,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":176940,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":11009,"spinlock_wait_cycles":54055168,"thread_start_us":148148,"threads_started":3,"wal-append.queue_time_us":91815}
I20260709 12:17:10.388983 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.389421 21033 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:10.385859 22758 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.369694 21739 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:10.390404 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.274315 22839 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.394068 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.373301 22921 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.395179 22758 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.395593 22688 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.395869 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.395423 22893 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.391180 22842 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.386279 22689 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:10.405826 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.369500 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:10.408005 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:10.409296 21183 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:10.412093 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.413348 21034 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:10.411554 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:10.403858 22688 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.415743 21149 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:10.419559 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.420554 21104 raft_consensus.cc:2410] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:10.422086 21179 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:10.414119 22685 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:10.428908 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.407445 22684 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.430608 21110 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:10.432570 22804 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.429633 22323 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.430387 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1221) took 1240 ms. Trace:
I20260709 12:17:10.435621 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.439926 21034 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:10.440073 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1687) took 1675 ms. Trace:
I20260709 12:17:10.412987 22921 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.448081 21178 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.438659 21111 rpcz_store.cc:276] 0709 12:17:09.189551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.189696 (+   145us) service_pool.cc:224] Handling call
0709 12:17:10.430132 (+1240436us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54003692d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:10.430316 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100958976}
I20260709 12:17:10.417733 22872 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.449831 21185 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:10.450480 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.435894 22688 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.451138 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.410766 22723 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:17:10.458577 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.459668 21036 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:10.456764 21102 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:10.419500 21738 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:10.445063 21179 rpcz_store.cc:276] 0709 12:17:08.764283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.722522 (+958239us) service_pool.cc:224] Handling call
0709 12:17:10.421574 (+699052us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:17:10.421784 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:10.439760 (+ 17976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.439987 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8309632}
W20260709 12:17:10.463003 22947 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:17:10.463721 21103 raft_consensus.cc:606] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:10.464141 21103 raft_consensus.cc:614] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:10.465188 22638 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.465593 22638 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.467609 22758 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.469834 22686 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.470283 22896 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:10.470700 22896 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.473078 21030 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:10.473349 22864 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.475782 21033 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:10.476867 21000 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:10.478485 21104 raft_consensus.cc:2410] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 5 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:10.478574 21107 raft_consensus.cc:2410] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:10.479369 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.483222 21738 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:10.484818 22860 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.485328 22860 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.452764 22893 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.506179 21185 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:10.457736 22889 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.511116 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:10.479861 22864 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.510540 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.473888 22774 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.453364 22684 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.506479 22893 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.524616 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.518270 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.515661 21111 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:10.516773 22815 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.447729 22789 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.508219 22624 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:10.515182 22864 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.540838 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:10.543322 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.516781 22686 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:10.506743 22758 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:17:10.536607 22893 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.562217 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.564025 21033 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:10.566684 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:10.567242 21111 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.569473 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:10.546725 22864 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.538419 22902 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.572592 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.512583 22689 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.568389 22624 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:10.568531 22815 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.575888 22455 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.584437 22860 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:10.586501 22839 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:10.601013 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 198506us
I20260709 12:17:10.615793 21182 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:10.585139 22858 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.624186 21028 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:10.624439 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.625073 21185 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:10.628754 21076 leader_election.cc:400] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:10.633842 21076 leader_election.cc:403] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:10.599375 22688 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:10.636209 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 250123us
I20260709 12:17:10.599990 22902 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.645071 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.645606 22688 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:17:10.646224 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.647341 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.648247 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.649259 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:10.649775 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.649760 21029 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:10.650782 22957 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.651433 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.652426 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.653383 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:10.653682 22946 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:17:10.653874 21029 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:10.654364 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.654981 21185 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:10.661530 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.661796 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.662129 21179 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:10.662343 21183 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:10.663715 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.664371 21029 raft_consensus.cc:2393] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:10.664440 22957 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
W20260709 12:17:10.665123 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54214.8us
I20260709 12:17:10.665274 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.665763 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.666256 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:10.666333 21076 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:10.667393 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:10.669128 22921 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:10.669625 21029 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:10.671675 20930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49692 (request call id 196) took 7921 ms. Trace:
I20260709 12:17:10.674417 22624 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.678045 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:10.679176 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40408 (request call id 14) took 1642 ms. Trace:
I20260709 12:17:10.679272 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:10.679556 21103 rpcz_store.cc:276] 0709 12:17:09.036827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.036947 (+   120us) service_pool.cc:224] Handling call
0709 12:17:10.678936 (+1641989us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000032d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f98e853 00007fcba495c60a 00007fcb9dee27d4 00007fcb9dee2762 00007fcb9dee2691 00007fcb9dee260c 00007fcb9dee18c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:10.679077 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3213568768}
I20260709 12:17:10.681665 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:10.685284 21177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 126) took 2498 ms (client timeout 1821 ms). Trace:
W20260709 12:17:10.685655 21177 rpcz_store.cc:269] 0709 12:17:08.187146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.188721 (+  1575us) service_pool.cc:224] Handling call
0709 12:17:10.685074 (+2496353us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000bdbd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:10.685196 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3318088576}
I20260709 12:17:10.672003 20930 rpcz_store.cc:276] 0709 12:17:02.750324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.756729 (+  6405us) service_pool.cc:224] Handling call
0709 12:17:10.671463 (+7914734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:06.477064 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:06.675475 (+198411us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:06.683315 (+  7840us) write_op.cc:435] Acquired schema lock
0709 12:17:06.693204 (+  9889us) tablet.cc:662] Decoding operations
0709 12:17:06.705325 (+ 12121us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:06.705382 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:06.705412 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:17:06.705701 (+   289us) tablet.cc:701] Row locks acquired
0709 12:17:06.705719 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:17:06.705858 (+   139us) write_op.cc:270] Start()
0709 12:17:06.705959 (+   101us) write_op.cc:276] Timestamp: P: 1783599426705814 usec, L: 0
0709 12:17:06.705981 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:17:06.706646 (+   665us) log.cc:844] Serialized 1602 byte log entry
0709 12:17:08.244591 (+1537945us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:08.842873 (+598282us) op_driver.cc:464] REPLICATION: finished
0709 12:17:09.207641 (+364768us) write_op.cc:301] APPLY: starting
0709 12:17:09.227336 (+ 19695us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:09.296700 (+ 69364us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:09.298204 (+  1504us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:09.370315 (+ 72111us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:09.375746 (+  5431us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:17:09.375794 (+    48us) write_op.cc:312] APPLY: finished
0709 12:17:09.376023 (+   229us) log.cc:844] Serialized 35 byte log entry
0709 12:17:09.376191 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:09.376280 (+    89us) write_op.cc:454] Released schema lock
0709 12:17:09.376323 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:09.376673 (+   350us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:09.376702 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":200445,"reported_tablets":4,"spinlock_wait_cycles":26880,"child_traces":[["op",{"apply.queue_time_us":266917,"apply.run_cpu_time_us":2507,"apply.run_wall_time_us":195672,"num_ops":3,"prepare.queue_time_us":374177,"prepare.run_cpu_time_us":58606,"prepare.run_wall_time_us":685253,"raft.queue_time_us":554282,"raft.run_cpu_time_us":79631,"raft.run_wall_time_us":186655,"replication_time_us":2136709,"spinlock_wait_cycles":35871616,"thread_start_us":1403797,"threads_started":4,"wal-append.queue_time_us":415588,"wal-append.run_cpu_time_us":63711,"wal-append.run_wall_time_us":3299471}]]}
I20260709 12:17:10.688354 22896 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.689687 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 130) took 2480 ms. Trace:
W20260709 12:17:10.690112 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:10.703923 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:10.704370 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.691524 21076 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:10.692945 21712 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:10.693735 22684 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.694010 22883 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:10.695473 22738 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.699798 22815 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.719300 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1101) took 1515 ms. Trace:
I20260709 12:17:10.719755 21110 rpcz_store.cc:276] 0709 12:17:09.203947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.368902 (+164955us) service_pool.cc:224] Handling call
0709 12:17:10.430313 (+1061411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:10.450268 (+ 19955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.719050 (+268782us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003692d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:10.719237 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440286464}
I20260709 12:17:10.721060 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:10.721746 21110 raft_consensus.cc:2368] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:10.715528 22839 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.722929 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:10.723626 21110 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.722895 22684 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.724454 22684 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.758114 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.788985 21178 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:10.703526 21186 rpcz_store.cc:276] 0709 12:17:08.209213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.351958 (+1142745us) service_pool.cc:224] Handling call
0709 12:17:09.385710 (+ 33752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.524063 (+138353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.524094 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:09.524133 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:09.524161 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.689305 (+1165144us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54003fd754. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:10.689362 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.689526 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317787520}
W20260709 12:17:10.857460 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 166017us
I20260709 12:17:10.865463 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:10.864284 21149 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:10.868364 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:10.869175 21177 raft_consensus.cc:2393] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:10.723662 22883 raft_consensus.cc:3055] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:10.937345 21744 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:10.722790 22902 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.947733 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.948302 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:10.949188 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 256303us
I20260709 12:17:10.949787 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:10.950943 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 87089.8us
I20260709 12:17:10.952512 22960 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:10.952898 22960 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:10.944905 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 86661.1us
I20260709 12:17:10.949487 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:10.953606 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 88203.2us
I20260709 12:17:10.954324 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:10.954799 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:10.956108 22913 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.956404 21002 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:10.957556 22960 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.948642 21105 raft_consensus.cc:2410] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:10.961525 21102 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:10.962165 22901 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.971020 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.964740 22650 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.953106 22888 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:17:10.974962 22888 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:10.964962 22889 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.975534 21102 raft_consensus.cc:2410] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:10.976742 21076 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:10.976938 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.977905 21102 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
W20260709 12:17:10.979010 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.979615 22730 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:10.979395 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.980157 22730 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.980474 21102 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 1.
I20260709 12:17:10.981791 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.982827 21102 raft_consensus.cc:2410] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:10.983991 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.984740 21102 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:10.985920 22758 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.986644 22650 consensus_queue.cc:1059] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:10.987789 22815 raft_consensus.cc:3055] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:10.968742 22688 consensus_queue.cc:1059] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:17:10.987104 22755 consensus_queue.cc:1059] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:17:10.988786 22688 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:10.988933 22815 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:10.989195 22688 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:10.989723 22755 raft_consensus.cc:3055] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:10.989867 22815 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.990451 22755 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:10.991673 22815 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.991365 22755 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:10.992478 22755 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.942955 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:10.982168 22730 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:10.943459 22883 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:10.986681 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:10.996567 22883 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:10.999559 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:10.999676 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:10.977617 22913 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.778568 22712 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.017856 21033 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:11.020258 21105 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:11.020687 21709 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.020905 20999 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:11.020283 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 164342us
I20260709 12:17:11.020381 21002 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:10.986279 21111 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:11.022629 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:11.014616 21110 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:11.022264 22911 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:11.024765 22858 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.024926 22931 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.025336 22931 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.025593 22679 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:11.029202 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:11.030568 21002 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:11.034834 21184 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:11.035043 22685 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.034858 22650 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.011694 22959 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.035624 22758 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.024729 22911 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.035743 22684 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.020048 22730 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.037336 21709 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:11.025283 22455 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:11.030088 22931 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.975535 22888 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.038655 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:11.033454 22738 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:11.035458 22685 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.056532 22685 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.036417 22650 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.043902 22758 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.049177 22911 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.027593 22679 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.049630 22730 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.055173 22883 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.990010 22688 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.067952 22758 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:11.074999 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.075552 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.075692 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:11.076241 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.076596 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.066290 22650 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:11.070775 22804 consensus_meta.cc:287] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.002s
W20260709 12:17:11.077463 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 100832us
I20260709 12:17:11.068572 22839 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:11.069792 22730 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.052250 22889 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:17:11.083102 21075 leader_election.cc:400] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6.
I20260709 12:17:11.087852 21075 leader_election.cc:403] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:11.083654 21110 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:11.073359 22686 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:11.047966 22959 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.095993 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1235) took 1693 ms. Trace:
I20260709 12:17:11.084287 22805 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.067085 22738 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:11.085855 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:11.086946 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:11.096401 21110 rpcz_store.cc:276] 0709 12:17:09.396936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.037196 (+1640260us) service_pool.cc:224] Handling call
0709 12:17:11.071036 (+ 33840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.090158 (+ 19122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.090349 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.101969 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 146) took 1309 ms. Trace:
I20260709 12:17:11.102691 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:11.105814 21029 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.102222 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.105636 21108 rpcz_store.cc:276] 0709 12:17:09.792465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.843402 (+ 50937us) service_pool.cc:224] Handling call
0709 12:17:11.101832 (+1258430us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400369cd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:11.101921 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312335744}
I20260709 12:17:11.092088 22957 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.109433 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:11.084808 22892 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:11.086758 22913 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.109877 22688 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.134394 22738 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:11.136483 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 49614.2us
I20260709 12:17:11.137660 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:11.138949 22526 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.139317 22526 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.139622 22526 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.140187 22513 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:11.140892 22513 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:11.141815 22513 raft_consensus.cc:3055] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:11.142150 22513 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:11.146344 22526 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.148304 22526 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.101435 22839 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:11.155587 22839 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.151187 22892 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.117867 22686 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.095839 22804 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.166942 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:11.099711 22896 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.162809 21029 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
W20260709 12:17:11.151942 22962 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:17:11.118306 22893 consensus_meta.cc:287] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.549s	user 0.004s	sys 0.004s
W20260709 12:17:11.173700 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 223151us
I20260709 12:17:11.118254 22913 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:11.182255 22892 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.183038 22526 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:11.183360 21076 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:11.183571 22526 raft_consensus.cc:697] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:11.185407 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:11.184130 22804 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:11.170312 22685 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.170446 22902 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:11.172973 22718 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.171247 22889 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:11.191301 22712 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:11.173334 22959 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.186403 22896 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:11.207404 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 126510us
I20260709 12:17:11.165612 22960 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.172796 22956 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.185032 22913 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.166496 22921 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 12:17:11.221125 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 185008us
W20260709 12:17:11.206809 22872 consensus_meta.cc:287] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.753s	user 0.006s	sys 0.003s
I20260709 12:17:11.227809 21034 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:11.176970 22893 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.232187 21108 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:11.232384 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 58045.3us
I20260709 12:17:11.233830 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.204710 22804 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:11.235786 21712 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.205461 22902 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:11.237534 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 53371.8us
W20260709 12:17:11.241647 22864 consensus_meta.cc:287] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.002s
I20260709 12:17:11.242020 22864 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.244716 22864 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.206413 22911 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.235576 22789 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.225327 22889 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.237547 22971 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.224530 22718 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:11.257573 22951 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.744s	user 0.000s	sys 0.011s
W20260709 12:17:11.259321 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.262825 22686 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.263382 22686 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:11.263827 22686 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.204267 22526 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.246366 22956 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:11.269721 22911 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.271623 22789 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.272898 22685 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.245487 22455 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.271947 22960 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:11.274051 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 47896.3us
I20260709 12:17:11.258517 22971 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.256971 22931 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:11.275997 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 215809us
I20260709 12:17:11.276288 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:11.280418 20999 leader_election.cc:400] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:11.280763 20999 leader_election.cc:403] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:11.282837 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.273548 22758 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.284727 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:11.271869 22730 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.257658 22650 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.261868 22970 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:11.284498 22804 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.273602 22789 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:11.290081 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.282397 22688 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:11.287562 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.282081 22685 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.297384 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.277288 22455 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:11.299575 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.298485 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:11.289716 22758 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.290448 22815 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:11.298357 20999 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:11.289728 22888 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:11.302546 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.302695 21151 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:11.302521 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.288731 22638 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.301810 22911 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:11.306496 22971 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.306522 22911 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.307260 22911 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.304495 22688 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:11.311856 22730 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.311940 22808 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.312501 22893 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.313992 22931 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.315794 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.316686 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:11.317983 22688 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:11.318404 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:11.319038 21110 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:11.319809 22889 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.296970 22718 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:11.305711 22888 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:11.321255 22888 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:11.321620 22455 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:11.322253 22983 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.322149 22888 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.323349 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:11.323849 22957 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6.
I20260709 12:17:11.324754 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:11.325657 21108 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:11.301332 22981 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.319239 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:11.329012 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:11.319950 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:11.331260 21108 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:11.339190 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:11.336416 21110 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:11.341550 21151 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:11.319888 22650 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.343348 22455 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.344084 22893 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.346522 22881 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.347107 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:11.346995 22881 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.347584 21151 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:11.348943 22881 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.349159 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:11.349460 22718 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.349858 22718 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.350159 22718 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.294371 22902 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.351609 22902 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.347663 21743 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.357087 21102 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:11.305671 22815 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:11.359229 21110 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.362005 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1238) took 1745 ms. Trace:
I20260709 12:17:11.326340 22979 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:11.365626 22979 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.362349 21110 rpcz_store.cc:276] 0709 12:17:09.617096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.358705 (+1741609us) service_pool.cc:224] Handling call
0709 12:17:11.359056 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.361760 (+  2704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.361950 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.364508 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:11.334276 22981 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.335705 22921 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:11.372583 21110 raft_consensus.cc:1240] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:11.373544 22979 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.378998 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:11.380318 21029 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:11.379122 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:11.383848 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 143) took 1589 ms. Trace:
I20260709 12:17:11.384285 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:11.384712 21107 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:11.374178 21077 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:11.384279 21110 rpcz_store.cc:276] 0709 12:17:09.791068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.366672 (+1575604us) service_pool.cc:224] Handling call
0709 12:17:11.372428 (+  5756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.380493 (+  8065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.380661 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.386382 21034 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 4. Ops: []
I20260709 12:17:11.388760 22960 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.389478 22880 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.389904 22880 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.391248 21109 raft_consensus.cc:2410] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:11.391945 21151 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:11.392648 22689 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.394038 22689 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:11.394483 22689 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:11.394870 22815 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.395819 22689 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.397672 21743 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:11.398021 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.336251 22789 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.358148 21108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:11.395023 22858 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:11.357976 22893 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:11.361198 22971 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.413841 22858 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:11.414243 22971 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.414700 22971 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.392635 22718 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.416913 22718 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:11.367199 22889 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.418005 22889 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.420033 22889 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.421103 22873 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:11.413915 22913 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.421478 22873 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:11.422991 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 144) took 1596 ms. Trace:
I20260709 12:17:11.423367 21110 rpcz_store.cc:276] 0709 12:17:09.791742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.386946 (+1595204us) service_pool.cc:224] Handling call
0709 12:17:11.387197 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.387344 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.387368 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.387407 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:11.387435 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.387483 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.387576 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.424335 21032 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:11.357837 22455 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:11.424998 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 147) took 1625 ms. Trace:
I20260709 12:17:11.425343 22893 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.427999 22893 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.428249 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:11.379858 22981 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.426602 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.403405 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1239) took 1786 ms. Trace:
I20260709 12:17:11.405129 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.425364 21110 rpcz_store.cc:276] 0709 12:17:09.800165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.424227 (+1624062us) service_pool.cc:224] Handling call
0709 12:17:11.424508 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.424693 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.424718 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.424773 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:11.424801 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.424851 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.424942 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.430023 21103 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:11.431232 21107 rpcz_store.cc:276] 0709 12:17:09.617502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.360585 (+1743083us) service_pool.cc:224] Handling call
0709 12:17:11.384397 (+ 23812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.385078 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.403348 (+ 18270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.394184 22685 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:11.414832 22858 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.422273 22873 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.387816 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.433228 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 150) took 1249 ms. Trace:
W20260709 12:17:11.434784 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 60688.5us
I20260709 12:17:11.451299 21103 rpcz_store.cc:276] 0709 12:17:10.182072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.680410 (+498338us) service_pool.cc:224] Handling call
0709 12:17:11.428111 (+747701us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b5800187b98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:17:11.430997 (+  2886us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7795584}
I20260709 12:17:11.451720 21077 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.451746 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.454135 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:11.488709 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.489279 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.489588 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.488931 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1106) took 1620 ms. Trace:
I20260709 12:17:11.491374 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1107) took 1622 ms. Trace:
I20260709 12:17:11.492201 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1109) took 1622 ms. Trace:
I20260709 12:17:11.491797 21107 rpcz_store.cc:276] 0709 12:17:09.869358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.433689 (+1564331us) service_pool.cc:224] Handling call
0709 12:17:11.489567 (+ 55878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.491063 (+  1496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.491098 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.491139 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:11.491166 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.491221 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.491323 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:11.491333 22990 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:17:11.494027 22858 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.377110 22911 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.490130 21110 rpcz_store.cc:276] 0709 12:17:09.868482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.433351 (+1564869us) service_pool.cc:224] Handling call
0709 12:17:11.433609 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.453354 (+ 19745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.453372 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.488670 (+ 35298us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:11.488710 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.488767 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.488875 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.453601 22881 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:17:11.498014 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1112) took 1626 ms. Trace:
I20260709 12:17:11.498391 21110 rpcz_store.cc:276] 0709 12:17:09.871170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.497087 (+1625917us) service_pool.cc:224] Handling call
0709 12:17:11.497331 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.497480 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.497504 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.497564 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:11.497720 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.497804 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.497894 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.500061 21110 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.500634 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1116) took 1628 ms. Trace:
I20260709 12:17:11.500958 21110 rpcz_store.cc:276] 0709 12:17:09.872260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.499585 (+1627325us) service_pool.cc:224] Handling call
0709 12:17:11.499873 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.500424 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.500575 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.492569 21103 rpcz_store.cc:276] 0709 12:17:09.870063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.452451 (+1582388us) service_pool.cc:224] Handling call
0709 12:17:11.491696 (+ 39245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.491884 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.491907 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.491979 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:11.492008 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.492060 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.492151 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.502357 21110 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:11.379653 22921 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.506992 22921 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.507682 21034 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:11.502647 21103 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:11.508311 22911 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.508490 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1244) took 1231 ms. Trace:
I20260709 12:17:11.508826 21103 rpcz_store.cc:276] 0709 12:17:10.277169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.502115 (+1224946us) service_pool.cc:224] Handling call
0709 12:17:11.502374 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.508264 (+  5890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.508443 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.496097 21107 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.510268 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1110) took 1639 ms. Trace:
I20260709 12:17:11.510643 21107 rpcz_store.cc:276] 0709 12:17:09.870454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.493925 (+1623471us) service_pool.cc:224] Handling call
0709 12:17:11.494205 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.510057 (+ 15852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.510221 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.435036 22526 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.512012 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1241) took 1307 ms. Trace:
I20260709 12:17:11.515669 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56396 (request call id 84) took 1889 ms. Trace:
W20260709 12:17:11.516330 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.490556 21077 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.515656 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.512904 21029 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.515558 21103 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.517467 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1245) took 1159 ms. Trace:
I20260709 12:17:11.517810 21103 rpcz_store.cc:276] 0709 12:17:10.358253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.509484 (+1151231us) service_pool.cc:224] Handling call
0709 12:17:11.509758 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.517258 (+  7500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.517422 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.518663 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:11.518949 21103 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:11.519493 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1247) took 1116 ms. Trace:
I20260709 12:17:11.519797 21103 rpcz_store.cc:276] 0709 12:17:10.403312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.518442 (+1115130us) service_pool.cc:224] Handling call
0709 12:17:11.518701 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.519289 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.519450 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.516366 21105 rpcz_store.cc:276] 0709 12:17:09.620595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.047475 (+1426880us) service_pool.cc:224] Handling call
0709 12:17:11.454616 (+407141us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400229054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f99a735 00007fcb9f9929fa 00007fcba495a4c9 00007fcb9ded6c54 00007fcb9ded6be2 00007fcb9ded6b11 00007fcb9ded6a8c 00007fcb9ded5d42 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:11.509960 (+ 55344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256160000}
I20260709 12:17:11.516168 21110 rpcz_store.cc:276] 0709 12:17:10.204445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.501954 (+1297509us) service_pool.cc:224] Handling call
0709 12:17:11.502192 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.511791 (+  9599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.511964 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.524209 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1250) took 1033 ms. Trace:
I20260709 12:17:11.524994 21105 rpcz_store.cc:276] 0709 12:17:10.490472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.523392 (+1032920us) service_pool.cc:224] Handling call
0709 12:17:11.523634 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.523917 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.523942 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.523980 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:11.524007 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.524058 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.524160 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:11.526171 21032 raft_consensus.cc:2368] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:11.528532 21110 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:11.530314 20918 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f16c07bcae284f65a7c0ee0375e00769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a62242aa80cd4affa87dc4a3cf6b64ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:11.530831 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1357) took 1145 ms. Trace:
I20260709 12:17:11.531451 21077 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:11.510535 22804 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.531208 21182 rpcz_store.cc:276] 0709 12:17:10.387276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.387409 (+   133us) service_pool.cc:224] Handling call
0709 12:17:10.390572 (+  3163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:10.616187 (+225615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.530586 (+914399us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540015ed54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:11.530758 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517499264}
I20260709 12:17:11.515954 22526 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:11.536554 21151 leader_election.cc:400] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:11.536864 21151 leader_election.cc:403] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:11.532979 22911 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.543867 21029 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:11.533867 22931 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.544950 21151 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:11.545610 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:11.545970 21077 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:11.546751 21032 raft_consensus.cc:2368] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:11.536211 22526 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.535893 22985 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:11.547802 21151 leader_election.cc:400] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:11.568876 21151 leader_election.cc:403] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:11.569118 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:11.569871 21180 raft_consensus.cc:2410] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:11.570326 22789 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.575232 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:11.576786 22323 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:11.577359 22323 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:11.547212 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.543476 22858 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.548530 22808 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:11.578645 22808 raft_consensus.cc:697] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:11.579546 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:11.579676 22808 consensus_queue.cc:237] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.581133 21030 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:11.548432 22931 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.584000 21737 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.584375 22931 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.549985 22893 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:11.585233 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:11.585907 21743 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:11.550293 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:11.586666 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:11.587025 21035 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:11.596750 21105 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:11.597676 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:11.598675 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:11.599217 21746 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.600270 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1117) took 1727 ms. Trace:
I20260709 12:17:11.600627 21104 rpcz_store.cc:276] 0709 12:17:09.872686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.441691 (+569005us) service_pool.cc:224] Handling call
0709 12:17:11.600072 (+1158381us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b5400253ad4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:11.600214 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56565632}
I20260709 12:17:11.601670 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:11.602210 21104 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:11.551568 21077 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:11.554929 22455 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:11.608129 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:11.558331 22971 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.558866 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.609324 22893 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.609632 21028 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:11.561167 22981 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.550208 22686 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.563724 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:11.564203 21149 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:11.564347 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:11.620327 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 56195.4us
I20260709 12:17:11.620682 21034 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.567517 22913 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:11.542373 22921 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:11.547940 22911 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.568528 22873 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:11.625712 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.626192 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.605602 21746 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:11.654196 21150 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:11.599184 21105 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.604586 21029 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
W20260709 12:17:11.606771 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.608917 21742 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:11.577294 22789 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:11.611060 22455 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:11.612251 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 60766.3us
I20260709 12:17:11.663220 21077 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:11.610152 22858 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:11.612777 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 1822) took 1290 ms. Trace:
I20260709 12:17:11.614162 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:11.623883 22971 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:11.611493 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:11.671195 21104 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.611713 22960 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:17:11.665541 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:11.665974 21108 raft_consensus.cc:606] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:11.666922 21744 raft_consensus.cc:2368] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:11.666602 21036 rpcz_store.cc:276] 0709 12:17:10.322249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.369419 (+ 47170us) service_pool.cc:224] Handling call
0709 12:17:11.612601 (+1243182us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x7b54003a4154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:11.612701 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205673728}
I20260709 12:17:11.622267 22958 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.631028 22921 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:11.630672 22718 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:11.670457 22913 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:11.681628 22921 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.660857 22959 consensus_queue.cc:1059] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:17:11.684168 21030 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.686961 22789 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:11.716406 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.669503 22323 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:11.690819 22913 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.680603 22843 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:11.726397 21105 raft_consensus.cc:2410] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:11.727731 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1257) took 1077 ms. Trace:
W20260709 12:17:11.731539 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.682333 22718 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.736615 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:11.732199 22881 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.720542 22712 raft_consensus.cc:3055] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:11.723243 22899 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.741180 22881 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.741649 22911 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:11.742645 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.742874 22981 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:11.743470 22994 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:17:11.730720 22913 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.740398 22712 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:11.746817 22712 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.751487 22712 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.748878 22843 consensus_queue.cc:1243] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:11.686021 20934 catalog_manager.cc:5697] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1), VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2), VOTER 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3), VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 3 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:11.755205 22981 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:11.755772 22981 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.723929 22455 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:11.761992 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 100600us
I20260709 12:17:11.738674 22323 consensus_queue.cc:1243] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:11.764858 22624 consensus_queue.cc:1059] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:17:11.768049 21149 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:11.769049 22958 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:11.780187 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.769831 22959 raft_consensus.cc:3055] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:11.786929 22959 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:11.787801 22959 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.791482 21036 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:11.793732 22513 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:11.800859 21109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1094) took 4267 ms (client timeout 1653 ms). Trace:
W20260709 12:17:11.801265 21109 rpcz_store.cc:269] 0709 12:17:07.533772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.534533 (+   761us) service_pool.cc:224] Handling call
0709 12:17:11.800612 (+4266079us) spinlock_profiling.cc:243] Waited 3.85 s on lock 0x7b54000dd9d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:11.800778 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8853727488}
I20260709 12:17:11.802305 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:11.803453 21106 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:11.803793 21106 pending_rounds.cc:85] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 1
I20260709 12:17:11.803980 21106 pending_rounds.cc:107] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:11.804188 21106 raft_consensus.cc:2889] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:11.804984 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.805537 22938 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:11.806103 22938 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.810006 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:11.810705 21102 raft_consensus.cc:2368] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:11.811517 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:11.812067 21102 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:11.812849 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:11.813341 21102 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:11.814049 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:11.833842 21108 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:11.843230 22815 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:11.843365 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:11.843700 22815 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:11.844614 22815 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.845745 22815 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.847602 21000 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:11.848511 22789 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:11.848873 22789 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:11.849155 22323 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:11.849632 22789 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:11.852298 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1359) took 1443 ms. Trace:
I20260709 12:17:11.852663 21184 rpcz_store.cc:276] 0709 12:17:10.409215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.414019 (+  4804us) service_pool.cc:224] Handling call
0709 12:17:11.852145 (+1438126us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b540024e0d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:11.852240 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369295744}
I20260709 12:17:11.855340 21185 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:11.849635 22323 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:11.857019 22323 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:11.859349 21109 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:11.860596 21109 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.731325 21110 rpcz_store.cc:276] 0709 12:17:10.639377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.533031 (+893654us) service_pool.cc:224] Handling call
0709 12:17:11.537393 (+  4362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.537579 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:11.661148 (+123569us) log.cc:844] Serialized 14 byte log entry
0709 12:17:11.716246 (+ 55098us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.716303 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:11.716341 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.716400 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.716538 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122160,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":19866,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":9834,"thread_start_us":150674,"threads_started":2}
I20260709 12:17:11.861703 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:11.862998 22931 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.863370 22931 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.863696 22931 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:11.865051 23000 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:17:11.866786 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1130) took 1420 ms. Trace:
I20260709 12:17:11.867163 21111 rpcz_store.cc:276] 0709 12:17:10.446737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.522565 (+1075828us) service_pool.cc:224] Handling call
0709 12:17:11.522833 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:11.523161 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.523191 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:11.523609 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.660885 (+137276us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:11.865933 (+205048us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b180020cbc0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c821c0a 00007fcba5f61219 00007fcb9c8a9a40 00007fcb9c8a44e4 00007fcb9c8a4455 00007fcba338c3c7 00007fcb9f99e9a7 00007fcb9f9ae0bf 00007fcb9f9ae038
0709 12:17:11.866180 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 12:17:11.866403 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.866481 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.866531 (+    50us) raft_consensus.cc:1685] finished
0709 12:17:11.866614 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.866729 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":971,"raft.queue_time_us":838,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4176,"spinlock_wait_cycles":12617600,"thread_start_us":136925,"threads_started":1,"wal-append.queue_time_us":138002}
I20260709 12:17:11.871137 21110 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:11.806651 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1220) took 4168 ms. Trace:
I20260709 12:17:11.876587 21106 rpcz_store.cc:276] 0709 12:17:07.637753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.889651 (+251898us) service_pool.cc:224] Handling call
0709 12:17:11.802998 (+3913347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.804550 (+  1552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.806468 (+  1918us) spinlock_profiling.cc:243] Waited 3.91 s on lock 0x7b54000dd9d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:11.806591 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8998954240}
I20260709 12:17:11.895288 21108 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:11.861660 21109 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:11.971513 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.972121 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.973116 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.974388 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 206485us
I20260709 12:17:11.975265 21149 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:11.977017 21000 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:11.995007 21149 leader_election.cc:400] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:11.996676 21149 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:12.001765 21000 leader_election.cc:400] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
W20260709 12:17:12.000025 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 345869us
I20260709 12:17:11.754786 20934 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:12.004848 21105 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:12.002539 21150 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:12.007233 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 211817us
W20260709 12:17:12.007789 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.011204 21036 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:11.985080 22513 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.014755 21149 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:12.020357 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 363280us
I20260709 12:17:12.000792 22689 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.983407 22774 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:11.985643 22959 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.009745 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.022486 20934 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:12.007607 22730 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.027053 21709 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:12.028411 20934 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 2 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:11.994604 22980 consensus_queue.cc:1059] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:17:12.033303 21150 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:12.034035 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:12.033869 21151 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:12.026779 22689 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.035508 20934 catalog_manager.cc:5697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 2, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 2 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.042475 21075 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:12.043232 21150 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:12.039127 22624 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:12.045547 22979 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:12.046056 22979 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.046980 22858 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:12.047400 23005 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.050439 22979 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.051002 22979 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.033911 22774 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.051334 22979 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:12.052970 22938 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.032836 22730 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.037365 22688 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:17:12.041646 22960 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:17:12.034894 22679 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.055153 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.027153 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.041803 22958 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.056437 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.056711 21104 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:12.057303 22985 raft_consensus.cc:3055] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:12.057668 22985 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:12.058420 22985 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.059583 22985 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.051754 22979 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.062613 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1248) took 1644 ms. Trace:
I20260709 12:17:12.062976 21103 rpcz_store.cc:276] 0709 12:17:10.418214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.520482 (+1102268us) service_pool.cc:224] Handling call
0709 12:17:11.629829 (+109347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:11.650530 (+ 20701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.650563 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:11.653677 (+  3114us) log.cc:844] Serialized 26 byte log entry
0709 12:17:12.011560 (+357883us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:12.011593 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.011646 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:12.029636 (+ 17990us) raft_consensus.cc:1685] finished
0709 12:17:12.029659 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.062386 (+ 32727us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400253ad0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:12.062559 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15068,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":7606,"spinlock_wait_cycles":250705664,"thread_start_us":326113,"threads_started":1,"wal-append.queue_time_us":351523}
I20260709 12:17:12.066367 22789 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.067770 22880 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.035039 22968 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.039774 22689 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.053498 22730 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.035282 22714 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.053114 22774 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:12.076575 22958 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.076973 22958 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.078981 22980 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.079559 21027 raft_consensus.cc:2410] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:12.032997 22862 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.053079 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:12.074424 21075 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:12.077910 22913 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.085057 22718 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:12.087108 22981 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:12.090742 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 47439.8us
I20260709 12:17:12.093278 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.095870 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.097883 21178 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:12.094623 20934 catalog_manager.cc:5697] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 2, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 2 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.080050 22888 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.101903 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.101833 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.102458 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.111248 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:12.100674 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 62570.4us
I20260709 12:17:12.111832 21184 raft_consensus.cc:2410] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:12.111183 20934 catalog_manager.cc:5697] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 2 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.087730 22692 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:12.113739 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.113925 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.107052 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.108332 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.108740 22730 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.109710 21185 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:12.084995 22862 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.110307 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.111713 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 1813) took 1792 ms. Trace:
I20260709 12:17:12.114331 21178 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.121896 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.080037 22963 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:17:12.123013 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.123355 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:12.123991 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.123579 20934 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:12.124577 22980 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:12.124950 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.125654 21108 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:12.125802 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.126315 21111 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.120792 22862 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.121155 21027 rpcz_store.cc:276] 0709 12:17:10.319777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.349681 (+ 29904us) service_pool.cc:224] Handling call
0709 12:17:12.103648 (+1753967us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540027ea54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:12.111659 (+  8011us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3945777920}
I20260709 12:17:12.114903 21182 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:12.113304 22881 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.129707 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.129643 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.124639 21109 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:12.131332 21178 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:12.132079 21111 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:12.133440 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.133999 21111 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:12.115460 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.115540 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.115823 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.135335 21103 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:12.108680 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:12.119197 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.102962 22624 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.120303 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.117309 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:17:12.120867 22526 consensus_meta.cc:287] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.007s
I20260709 12:17:12.134902 21110 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:12.136116 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.124967 20934 catalog_manager.cc:5697] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 2 to 3, term changed from 2 to 3, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to <none>, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:12.132124 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.137539 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.095136 22913 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.094321 22714 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:12.139376 21181 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:12.144887 21178 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.154464 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.155427 21109 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.144940 21108 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.137823 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.144363 21180 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:12.156963 21107 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:12.157313 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.121199 22692 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:12.150476 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.152256 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:12.149507 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.165098 21184 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.154835 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.161942 21178 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:12.163414 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.167559 21106 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.173867 21149 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:12.123723 22963 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:12.194893 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:12.197177 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 127609us
I20260709 12:17:12.201310 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:12.206012 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:12.207012 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 204129us
I20260709 12:17:12.200867 22881 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.186699 22688 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:12.154215 22526 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.200877 22714 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:12.227795 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.210170 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.221696 21110 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:12.210443 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.229302 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:12.226784 21180 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:12.229768 21181 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.223129 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.233357 21075 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:12.224614 21184 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:12.235378 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.211288 20934 catalog_manager.cc:5697] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:12.237651 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.154553 22718 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:12.241232 21108 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:12.242898 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.242462 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:12.239131 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.251122 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:12.252934 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:12.210997 22688 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.253602 21029 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:12.254272 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 102079us
I20260709 12:17:12.255122 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.202807 22963 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:12.135095 22888 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:12.242878 22893 consensus_meta.cc:287] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.010s
I20260709 12:17:12.303674 21109 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:12.227116 22624 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.267580 20934 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:17:12.313427 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.280211 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:12.280813 21737 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.215603 22774 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:12.219937 22730 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.282032 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.282585 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.328647 21182 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:12.208735 23003 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:12.284073 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 50810.3us
I20260709 12:17:12.226976 22980 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:12.253618 22804 consensus_meta.cc:287] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.008s
I20260709 12:17:12.227773 22971 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:12.303211 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:12.350006 21029 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:12.303434 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.243423 22858 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:12.271351 20999 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:12.355322 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 84049us
I20260709 12:17:12.308740 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.356356 21180 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:12.287603 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:12.357081 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 69561.9us
I20260709 12:17:12.357697 21077 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:12.355901 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:12.322399 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.256232 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.324574 21027 raft_consensus.cc:2393] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:12.220818 22526 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.330816 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.372864 21744 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:12.373983 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.375599 21002 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:12.220337 22958 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.214486 22689 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.286000 23016 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.336401 21035 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:12.323688 22712 consensus_meta.cc:287] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.003s
I20260709 12:17:12.258292 22718 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:12.268326 22513 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.339123 21105 raft_consensus.cc:2410] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:12.339888 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:12.340739 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 314117us
I20260709 12:17:12.344576 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:12.337237 20934 catalog_manager.cc:5697] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:12.432768 21184 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:12.319425 22893 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.308480 22880 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.324321 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:12.370632 21029 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:12.371266 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.346709 22774 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.324561 22892 consensus_queue.cc:1059] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:17:12.350795 23003 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.356189 22980 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.376946 22804 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:12.377058 22971 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.380908 22323 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:12.381791 21108 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:12.401583 22881 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:12.382086 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.403796 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:12.384636 21111 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:12.461083 21111 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:12.384584 21036 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:12.251854 22931 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.410315 21106 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:12.410733 21185 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
W20260709 12:17:12.398800 22873 consensus_meta.cc:287] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.749s	user 0.014s	sys 0.003s
W20260709 12:17:12.396725 22921 consensus_meta.cc:287] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.005s
I20260709 12:17:12.473654 21182 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:12.386934 22858 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.443521 20999 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:12.445266 21181 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:12.446518 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:12.447570 21186 raft_consensus.cc:2368] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
W20260709 12:17:12.448165 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 90545.5us
I20260709 12:17:12.387244 22815 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.480252 22815 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.480602 22815 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:12.480962 22815 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.385236 22526 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:12.390070 22688 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:12.453210 20934 catalog_manager.cc:5697] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 2 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:12.483358 22805 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:12.483655 21077 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:12.484985 22689 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:12.485623 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.486295 21181 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:12.456370 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.391103 22714 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.382238 22789 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:17:12.430243 22679 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:17:12.487664 22679 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:12.487823 21739 raft_consensus.cc:2368] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5.
I20260709 12:17:12.390292 22963 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.391263 22692 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.488583 22963 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.467422 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.490654 22921 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.470022 22881 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:12.472139 22931 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.470793 21104 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.430572 22862 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.441833 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.475513 21709 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:12.485127 22526 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:12.491261 21180 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.451365 23015 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:17:12.469142 22971 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.491202 21108 raft_consensus.cc:2368] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:12.455209 21738 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.494098 21107 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.484988 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:12.429760 22899 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:17:12.474440 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.496654 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.395821 22979 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.497653 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.498637 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.516966 21185 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.517016 21111 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.521914 21104 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
W20260709 12:17:12.503901 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 164077us
I20260709 12:17:12.505882 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.506052 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:12.491400 22679 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:12.508311 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.454540 22911 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 12:17:12.509271 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 268749us
I20260709 12:17:12.510156 21180 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:12.530221 22979 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.530787 22979 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:12.531163 22979 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:12.463431 22323 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:12.531492 22979 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.531744 22323 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.514701 21077 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:12.535463 22985 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:12.535815 22985 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:12.536221 22985 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:12.535851 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:12.430086 23016 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.459349 23014 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:17:12.524823 21709 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:12.546648 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.538513 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:12.547236 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.547778 21108 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.539469 21185 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:12.542305 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.551872 21185 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:12.503679 22805 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:12.515239 22689 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.544828 21000 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:12.557988 21182 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:12.536327 22893 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:12.536163 22892 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.571277 21027 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:12.573081 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.540517 22804 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.577750 21077 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:12.578965 21111 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:12.579875 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.580552 21111 raft_consensus.cc:2376] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4. Re-sending same reply.
I20260709 12:17:12.581364 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.581668 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:12.582407 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.571894 23017 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:12.574393 22679 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.576936 21178 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:12.585171 22679 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.589732 21737 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:12.592033 21179 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:12.577317 22730 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.595757 23028 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:12.596254 23028 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:12.597128 23028 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.598107 22725 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:12.598461 22725 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:12.599282 22725 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.600399 22725 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.603003 23019 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.603461 23019 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.605436 22980 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.610450 22815 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.612581 22815 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.613799 21179 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:12.614964 22526 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:12.615475 22526 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:12.616317 22526 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.617462 22979 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.617899 22730 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:12.618324 22730 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.620723 23014 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:12.621188 23014 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:12.621989 23014 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.623728 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1063) took 1051 ms. Trace:
I20260709 12:17:12.623852 22323 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.624083 21035 rpcz_store.cc:276] 0709 12:17:11.572361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.587584 (+ 15223us) service_pool.cc:224] Handling call
0709 12:17:12.103794 (+516210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.409626 (+305832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.622944 (+213318us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540027ea54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:12.623573 (+   629us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540027ea50. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:12.623680 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718462592}
I20260709 12:17:12.625564 22323 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.626129 21186 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:12.628827 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.629488 22888 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.630300 21111 raft_consensus.cc:2376] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6. Re-sending same reply.
I20260709 12:17:12.629660 22979 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:12.630952 21184 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:12.632467 21183 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:12.633611 23025 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:12.634065 23025 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:12.634896 23025 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.636231 21179 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:12.636740 22862 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:12.561719 23018 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.627312 21186 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:17:12.640589 21186 pending_rounds.cc:85] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 1
I20260709 12:17:12.640817 21186 pending_rounds.cc:107] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:17:12.579574 21077 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:12.640913 21185 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:12.584559 23017 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:12.641716 21186 raft_consensus.cc:2889] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:12.642958 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:12.641376 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 61864.4us
I20260709 12:17:12.643610 21108 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:12.561321 22913 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:12.650301 21186 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:12.651932 21182 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:12.653368 21077 leader_election.cc:400] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:12.653740 21077 leader_election.cc:403] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:12.657439 21111 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:12.665786 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.645373 23017 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.668622 21077 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:12.654203 22959 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:12.670547 22980 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:12.671072 22980 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:12.671906 22980 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.673543 22873 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:12.674880 23017 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.670567 22959 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.675905 22774 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.541777 22718 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.670261 22686 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:12.677332 23017 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.680863 21184 raft_consensus.cc:2410] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:12.681504 23016 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.585304 22805 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.687413 22858 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:12.653475 22881 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.575224 22892 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.689488 21106 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:12.646126 23022 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:17:12.667201 22913 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.647663 22893 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:12.700253 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.702157 21107 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:12.707041 21075 leader_election.cc:400] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5.
I20260709 12:17:12.707372 21075 leader_election.cc:403] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:12.709645 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:12.710232 21746 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.682711 22921 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.711751 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.718575 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.719295 21743 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:17:12.705750 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 262266us
I20260709 12:17:12.711431 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:12.674971 23026 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:17:12.743682 21075 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:12.715741 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:12.713187 22730 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.744477 21746 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:12.751367 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.771858 21186 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.751945 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:12.713188 22804 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.713204 22893 raft_consensus.cc:697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:17:12.754946 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 173338us
I20260709 12:17:12.721784 22911 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.773206 21185 raft_consensus.cc:2368] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 3. Current term is 4.
I20260709 12:17:12.733162 23016 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.778409 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.779039 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:12.786100 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.712898 22880 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:17:12.782024 21712 leader_election.cc:400] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 3. Current term is 4.
I20260709 12:17:12.788865 21712 leader_election.cc:403] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:12.759038 22692 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.760691 22913 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:12.779762 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 46155.7us
I20260709 12:17:12.785712 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:12.786916 21182 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:12.779078 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 375320us
I20260709 12:17:12.783252 21709 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:12.795070 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:12.815502 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:12.814460 21712 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:12.780042 21737 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:12.826105 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:12.792171 23036 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 3. Current term is 4.
I20260709 12:17:12.824455 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:12.828475 20999 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:12.831082 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:12.831816 21111 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.832614 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:12.820971 22979 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.833943 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:12.835654 22985 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.837154 21738 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:12.841135 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:12.787499 22911 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.790599 23016 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.823320 23033 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.855376 22323 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.829092 23015 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.855196 21111 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:12.892338 22963 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.032853 22963 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.035034 22963 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:12.852509 22815 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.054313 22815 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:12.981784 22513 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.055234 22513 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.868427 23031 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.056582 23031 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.057497 22513 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.058228 21000 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:12.951529 23016 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.842234 22526 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:12.929668 23035 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:17:13.059162 22805 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.059945 22805 raft_consensus.cc:697] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:12.964551 21739 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:12.950542 22730 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.950057 22911 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.861161 23033 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:13.061465 23033 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.060932 22805 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:12.839413 22979 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:12.868089 22893 consensus_queue.cc:237] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:12.885250 23026 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:12.982394 23003 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:12.917968 21110 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:13.067744 22979 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.069059 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.059219 22526 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.073647 22526 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.074877 22815 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.078462 21000 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:13.079382 23016 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:13.079833 23016 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.080250 23016 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.070341 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:13.009711 22804 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5.
I20260709 12:17:12.972277 22892 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.954455 22880 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:12.992786 22985 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:12.933605 23019 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:13.011834 22959 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.013859 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.135023 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.013908 21149 leader_election.cc:400] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:13.014524 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:13.017416 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.198881 21107 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:12.850382 23032 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.854949 22899 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:13.019541 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.020483 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.020973 23015 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.022171 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:13.022464 22938 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.022943 22688 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.023281 21709 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:13.205938 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 182756us
I20260709 12:17:12.829433 22888 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:17:12.853636 22685 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 12:17:13.023975 23027 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.054s	user 0.000s	sys 0.005s
W20260709 12:17:13.024366 23044 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.086s	user 0.005s	sys 0.001s
I20260709 12:17:12.853576 22679 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:12.876567 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:12.955103 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 77844.8us
I20260709 12:17:12.890772 22858 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.026976 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.029816 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.030577 22712 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.976390 22958 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:12.975095 22789 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.995347 21186 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
W20260709 12:17:13.084890 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.084811 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.086406 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.087309 21034 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.087227 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.103046 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:13.103274 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.219107 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.102998 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.103977 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:13.106791 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:13.107831 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:13.108695 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:13.210532 22899 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:13.227429 21102 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:13.111701 21000 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:13.231361 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 119749us
I20260709 12:17:13.199319 21108 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:13.231959 22685 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:13.234274 22685 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:13.235251 22685 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:13.230737 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 122987us
I20260709 12:17:13.219964 22679 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:13.243723 20999 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:13.199254 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.202790 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.252561 21107 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:13.204010 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.253283 22815 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.253723 22815 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.254105 22815 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:13.261505 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.262167 22985 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.262640 22985 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.198278 21149 leader_election.cc:403] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:13.213920 21076 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:13.250779 21031 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
W20260709 12:17:13.264086 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 50244.9us
I20260709 12:17:13.264616 22985 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.265321 22893 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:13.265939 22921 consensus_queue.cc:1059] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.210421 23022 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:13.217166 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 340695us
I20260709 12:17:13.266789 23022 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:13.267319 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.267675 23022 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.269196 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.224325 23025 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:13.230250 21111 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:17:13.270280 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.244138 22679 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.246093 22526 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.223668 22911 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.221758 22774 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.221232 22789 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.249476 22899 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.221848 22712 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.213547 23015 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.219655 22858 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.251302 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1381) took 1152 ms. Trace:
I20260709 12:17:13.212292 22938 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.241186 22805 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.058720 23031 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.270668 21111 pending_rounds.cc:85] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 5
I20260709 12:17:13.276649 22805 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:13.276893 21111 pending_rounds.cc:107] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:17:13.277159 21111 raft_consensus.cc:2889] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:13.271880 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.274024 22323 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:13.272641 21711 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.273788 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.271466 22921 raft_consensus.cc:3055] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.278208 21186 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:13.276155 21178 rpcz_store.cc:276] 0709 12:17:12.098477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.200998 (+102521us) service_pool.cc:224] Handling call
0709 12:17:12.201469 (+   471us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:12.230805 (+ 29336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.230836 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:12.291278 (+ 60442us) log.cc:844] Serialized 582 byte log entry
0709 12:17:12.542326 (+251048us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:12.592420 (+ 50094us) log.cc:844] Serialized 14 byte log entry
0709 12:17:12.650533 (+ 58113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.650617 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:12.969763 (+319146us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b1800067960. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:13.250979 (+281216us) raft_consensus.cc:1685] finished
0709 12:17:13.251095 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.251235 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87557,"raft.queue_time_us":91096,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":10554,"spinlock_wait_cycles":34563328,"thread_start_us":194793,"threads_started":1,"wal-append.queue_time_us":358988}
I20260709 12:17:13.283759 21077 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:13.279510 22323 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.265370 21076 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:13.277516 22805 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:13.271234 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 257446us
I20260709 12:17:13.292011 21149 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.209345 21105 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:13.278221 23017 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.296123 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.273631 22688 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4.
I20260709 12:17:13.273320 22730 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.280299 22888 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:13.270530 23025 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:13.305684 21149 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:13.326965 21029 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:13.327822 22685 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.328956 23073 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:13.285490 22893 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:13.282642 22921 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:13.341179 21149 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:13.292356 22980 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.305204 22931 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.326004 22718 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.351480 23071 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:13.331697 22958 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.346086 22688 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.335171 22686 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.331115 22888 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:13.288465 23033 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.369350 23076 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:13.395447 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 66300.7us
W20260709 12:17:13.395771 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 53649.1us
I20260709 12:17:13.354956 22980 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.400208 20999 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.359306 22959 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.392112 22888 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.345700 22685 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.414724 21110 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:17:13.402678 22980 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.397580 22686 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.396685 22911 consensus_queue.cc:1059] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:17:13.403841 22979 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.403911 23016 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.429522 22686 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:13.429929 23055 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:17:13.431196 22323 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:13.431413 22911 consensus_queue.cc:1059] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.432919 21030 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:13.433784 23064 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:17:13.442245 21746 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:13.444955 23015 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.399622 23076 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.445577 23015 raft_consensus.cc:3055] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:13.445925 23015 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:13.447104 23076 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.447376 22858 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:13.419042 22902 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.516390 22959 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:13.429929 23016 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.517612 22959 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:13.519040 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 163511us
I20260709 12:17:13.523914 21108 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:13.431106 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:13.532160 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 123916us
I20260709 12:17:13.534396 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.543828 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.544140 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.545382 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.548444 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:13.544610 21034 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:13.448182 23019 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.519171 22858 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.578155 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:13.531903 23073 consensus_queue.cc:1243] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:13.424932 23036 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 12:17:13.575284 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.597572 21746 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:13.601226 21000 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:13.418234 22921 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.582965 21033 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.423527 23074 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.154s
I20260709 12:17:13.566272 22526 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.548085 22714 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.412031 23025 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.532410 22730 raft_consensus.cc:3055] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:13.573272 22938 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.572647 22688 raft_consensus.cc:697] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:13.446709 23015 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:13.614675 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 206122us
I20260709 12:17:13.599200 22985 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.635584 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:13.636389 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.580267 23019 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.611866 22730 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:13.639423 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.649418 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:13.649544 21183 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:13.640019 21182 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.641553 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.643579 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:13.651317 21186 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:13.638556 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.594506 22858 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.651983 21180 raft_consensus.cc:1813] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Handling vote request from an unknown peer 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:13.652503 21180 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:13.652340 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:13.642912 23073 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.659590 22921 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.638672 23082 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:13.662922 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.668632 22685 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.613240 22714 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.656104 23033 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.674134 22730 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.637873 23080 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:13.659919 23073 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.673373 23019 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:13.693120 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:13.695735 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 62002us
I20260709 12:17:13.693789 21036 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:13.692791 23073 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.659057 22718 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:17:13.698945 22718 consensus_queue.cc:1243] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:13.704571 23073 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.674918 22858 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.656816 22815 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.678632 23015 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:13.733784 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.710160 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:13.734418 21746 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:13.734989 21033 raft_consensus.cc:2368] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5.
I20260709 12:17:13.681437 23082 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.712311 22979 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:13.713599 22880 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.718957 22902 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.721460 21178 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:13.722239 22714 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:13.723814 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:13.724090 22789 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:13.723984 22805 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:13.725608 22712 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.727212 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.749120 21000 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:13.755708 21184 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:13.742338 21746 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:13.755710 21027 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:13.749466 21711 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:13.742648 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:13.757373 21036 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.746196 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:13.706760 23073 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.758939 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:13.713675 21179 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:13.761703 21711 leader_election.cc:400] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5.
I20260709 12:17:13.762004 21711 leader_election.cc:403] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:13.762512 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:13.763363 21744 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.764555 22686 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.773665 21744 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:13.774725 21000 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:13.775092 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.775622 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.682225 22688 consensus_queue.cc:237] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.776278 21178 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:13.731539 22938 consensus_queue.cc:1059] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:17:13.707481 23088 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:17:13.779947 23016 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.761649 22725 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.760272 22805 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.783442 23033 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:13.787135 21036 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:13.767552 22979 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:13.767906 22692 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.794010 21178 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.795754 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.774740 23074 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:13.747455 22880 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.695854 23080 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.770470 22804 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:17:13.789108 23026 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:13.848294 23082 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.848680 23091 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:13.849149 23084 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5.
I20260709 12:17:13.794023 22725 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.842711 22686 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.798242 23017 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:13.798471 22938 consensus_queue.cc:1243] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:13.854976 23033 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:13.855432 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.856065 22880 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.840560 23074 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.840744 22513 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.858532 23080 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.860052 22805 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.874323 21150 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.790676 22888 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.874671 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.840049 22979 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.912683 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:13.912989 22979 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:13.885876 23091 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.917806 22980 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.878875 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.918856 21110 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:17:13.918808 21739 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:13.879549 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.919773 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.884274 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:13.896862 23017 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.839675 22455 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.920850 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.921236 22455 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.921841 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:13.922113 23017 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.904248 23074 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:13.922981 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:13.923221 22455 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:13.884950 22686 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.923601 21177 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.925190 22686 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.796911 23016 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.878378 22815 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.907158 23033 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.880427 23026 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:13.908485 22513 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:13.885345 22725 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.910349 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.911119 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.932451 21028 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:13.912544 23082 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:13.789304 22902 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 12:17:13.933581 21150 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:13.930156 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.929768 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.934073 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.934525 21180 raft_consensus.cc:2393] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:13.935688 21002 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.939759 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:13.940069 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.940874 21002 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.941458 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:13.942018 21180 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.942472 21177 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:13.945415 21027 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:13.946095 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:13.946652 21032 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.946882 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.948503 21178 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:13.921773 23031 raft_consensus.cc:3055] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:13.950199 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:13.951982 21712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.035s	sys 0.053s
I20260709 12:17:13.952158 22979 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:13.954743 21712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.035s	sys 0.053s
W20260709 12:17:13.955761 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 619425us
I20260709 12:17:13.956094 21180 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:13.929128 22980 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.955909 21178 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:13.948635 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.965219 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:13.966341 21035 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:13.967581 21178 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:13.967782 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:13.969419 21002 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:13.969826 21183 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:17:13.943002 23073 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.947834 22938 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.973341 21183 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:13.949232 23015 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:13.943995 22963 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:13.956475 23031 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:13.973308 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:13.975730 21186 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.971081 23017 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.984755 21035 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:13.991881 22888 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.972391 22815 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:17:13.995136 23073 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:13.995638 23073 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:13.996336 23026 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.001288 21032 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:14.001736 22513 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:13.978396 22963 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.002499 22963 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.003736 23015 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.003947 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.004282 23015 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.006335 23015 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:13.993562 23018 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:17:14.008388 22730 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.010973 23031 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.012248 23031 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.012569 23016 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.015959 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.017297 21186 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:17:14.017956 21182 raft_consensus.cc:2410] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:17:14.023643 21031 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:14.025465 21030 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:14.025662 21031 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:14.026571 21035 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:14.026665 21030 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:14.041733 22959 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:14.051378 22959 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.051783 21030 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:13.996428 23073 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.053153 21030 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:14.054068 21030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59982
I20260709 12:17:14.054615 21030 raft_consensus.cc:606] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 12:17:14.055003 21030 raft_consensus.cc:614] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:14.045105 23056 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.689s	user 0.008s	sys 0.001s
I20260709 12:17:14.056397 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1290) took 1050 ms. Trace:
I20260709 12:17:14.057763 23091 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.056955 21109 rpcz_store.cc:276] 0709 12:17:13.006284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.006417 (+   133us) service_pool.cc:224] Handling call
0709 12:17:13.006858 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:13.007232 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.007260 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:13.007751 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:17:13.200315 (+192564us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:13.328313 (+127998us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.595730 (+267417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.595827 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:14.044499 (+448672us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:14.056136 (+ 11637us) raft_consensus.cc:1685] finished
0709 12:17:14.056235 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.056343 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9943,"prepare.queue_time_us":12870,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":32787,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":10824,"spinlock_wait_cycles":89425792,"thread_start_us":564641,"threads_started":3,"wal-append.queue_time_us":279140}
I20260709 12:17:14.056376 21186 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:14.061734 21186 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:17:14.062084 21186 pending_rounds.cc:85] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 4
I20260709 12:17:14.062305 21186 pending_rounds.cc:107] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:17:14.062544 21186 raft_consensus.cc:2889] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:14.063592 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 70138.9us
W20260709 12:17:14.064160 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.027020 21031 pending_rounds.cc:85] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 1
I20260709 12:17:14.065428 21031 pending_rounds.cc:107] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:17:14.070617 21031 raft_consensus.cc:2889] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.025557 21077 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:14.073876 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 48393.9us
I20260709 12:17:14.066859 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:14.076417 21110 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:14.078481 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:14.081362 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:14.081970 21110 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:14.074508 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:14.087105 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:14.087774 21110 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:14.089936 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:14.061674 22959 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:14.095929 21106 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:14.097514 21180 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:14.097416 21077 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:14.147477 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.147641 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:14.149930 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:14.142892 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 64490.1us
I20260709 12:17:14.149973 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.085193 22688 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.118328 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.151822 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:14.151580 21151 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:14.031162 23074 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.144603 22858 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.085171 23076 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:14.159018 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 61677us
I20260709 12:17:14.161319 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:14.153759 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:14.153923 21151 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:14.161406 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:14.162397 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.164119 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:14.157205 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:14.064673 22963 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.169646 21149 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:14.170580 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:14.141278 21738 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:14.031531 22725 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.174683 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:14.187443 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.211673 21030 raft_consensus.cc:2410] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:14.090442 22893 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.090167 23017 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 12:17:14.215498 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.216246 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:14.217000 21032 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:14.216264 21030 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:14.144390 23096 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:14.151288 23003 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:14.237161 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.088795 22679 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:17:14.079697 23082 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 12:17:14.097983 22979 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:14.100129 22526 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:17:14.223233 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.079591 22899 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 12:17:14.238164 21030 raft_consensus.cc:2393] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:14.213292 22714 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.161825 22980 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:14.168210 23018 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.160844 22712 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.142207 23026 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:17:14.160707 22688 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.240899 23096 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.299429 22526 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:14.299604 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:14.300388 21738 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:14.300597 23096 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:14.245127 23090 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.301479 23073 consensus_queue.cc:1059] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:14.301669 23090 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.284514 22714 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.303514 22714 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.303889 23090 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.168458 22892 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:14.260434 22323 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.264681 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.213811 22718 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:14.239745 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 65120.3us
I20260709 12:17:14.281370 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.214073 22959 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.213877 22893 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.224756 22921 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:14.167692 23076 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:14.153684 22881 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:17:14.237349 22789 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:14.245879 23003 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.292639 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.293699 21739 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:14.293548 22693 consensus_queue.cc:1059] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:17:14.246387 23016 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:17:14.295765 23112 log.cc:927] Time spent T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:14.238705 22513 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:17:14.296422 21028 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:14.336736 21028 pending_rounds.cc:85] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 1
I20260709 12:17:14.337078 21028 pending_rounds.cc:107] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:14.337298 21028 raft_consensus.cc:2889] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.296868 22963 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:14.297780 23074 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:14.238910 22692 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.302289 23073 raft_consensus.cc:3055] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:14.258765 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.257611 22858 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:14.207676 22880 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:17:14.309638 21030 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
W20260709 12:17:14.315433 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 145854us
I20260709 12:17:14.311945 22718 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.313879 22893 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.312259 22980 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:14.314242 22892 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:14.334323 23016 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:14.313397 22921 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:14.315675 23076 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.375370 21149 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:14.331709 22789 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.377907 22718 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:14.377485 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 118052us
I20260709 12:17:14.313617 22913 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:17:14.391073 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.399127 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:14.407042 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 91935.8us
I20260709 12:17:14.365072 23073 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:14.389591 22921 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.390728 22789 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:14.371033 22963 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:14.366448 22959 consensus_queue.cc:1059] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:17:14.390411 22725 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:14.393587 22712 raft_consensus.cc:2764] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:14.387470 22858 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:14.423040 23082 consensus_queue.cc:1243] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:14.371028 22692 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.401713 23074 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:17:14.433027 22963 consensus_queue.cc:1243] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:14.436481 23127 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.447561 21111 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:14.449699 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:14.469460 21111 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:14.477051 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.438432 23096 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:17:14.445147 22725 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.445207 23125 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:14.432400 23016 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.486334 22971 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.503315 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:14.441499 22980 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.492846 22880 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:14.512971 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:14.488982 23081 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:17:14.516266 21106 raft_consensus.cc:2393] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:14.518504 20982 auto_rebalancer.cc:893] Removing replace marker failed: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:17:14.518998 20982 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:17:14.519323 20982 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:17:14.522472 23119 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:17:14.522608 23124 log.cc:927] Time spent T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:17:14.523238 23134 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:14.523475 23118 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:17:14.523530 22921 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.525638 22921 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:14.525799 23115 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:17:14.528990 21185 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:14.530912 22880 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.532863 23138 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.533596 22880 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:14.533326 23138 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.471097 23127 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.445555 23073 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.472040 23123 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:17:14.537668 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:14.538964 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 131212us
I20260709 12:17:14.539469 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.445933 22892 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.548051 21029 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:14.551754 22921 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.552214 22921 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.554095 22921 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.513751 23003 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:14.559135 23138 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.559906 22692 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:14.560904 23120 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:17:14.545136 23134 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.564704 23134 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.534126 22880 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.565758 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.567936 23144 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:14.569602 23144 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:14.569947 23144 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:14.497213 22725 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.518893 23135 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.513926 23016 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.575049 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.554545 22921 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:17:14.592295 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.506914 22971 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.501009 23125 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:14.608356 23121 log.cc:927] Time spent T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:17:14.608675 23078 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.593792 23073 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.589802 23018 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.615027 21030 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:14.615744 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:14.628489 21029 raft_consensus.cc:2410] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:14.619167 23080 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:14.622174 23122 log.cc:927] Time spent T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:17:14.623216 22971 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:14.590670 23003 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:17:14.624317 21111 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:14.644572 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:14.606933 23130 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:14.648705 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1419) took 1008 ms. Trace:
I20260709 12:17:14.649071 21179 rpcz_store.cc:276] 0709 12:17:13.639883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.643265 (+  3382us) service_pool.cc:224] Handling call
0709 12:17:14.648550 (+1005285us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b540001c7d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:14.648652 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72561920}
I20260709 12:17:14.650130 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:14.653153 22893 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.590401 23135 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.655821 23127 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.656677 23135 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.635341 23078 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.658305 23125 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:14.659116 23078 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:14.660601 22893 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.635504 23080 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:14.663515 23080 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.664744 23080 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:14.670300 23116 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.378s	user 0.005s	sys 0.000s
I20260709 12:17:14.675339 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:14.625403 22789 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.677574 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:14.638482 23134 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.686352 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:14.683531 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:14.682065 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:14.687482 21743 raft_consensus.cc:2393] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:14.688689 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:14.689718 21151 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:14.686952 21742 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:14.691332 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:14.692644 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 73972.6us
I20260709 12:17:14.570701 23144 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.657069 22725 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.764602 21179 raft_consensus.cc:2368] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7.
I20260709 12:17:14.765717 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.690793 22959 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.641573 23076 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.687425 22880 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.772452 22688 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:14.773164 23145 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:17:14.773396 22725 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:14.775347 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:14.788444 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:14.776063 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:14.789319 21103 raft_consensus.cc:2368] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5.
I20260709 12:17:14.776623 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:14.692500 22963 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.697376 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:14.766328 23084 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:14.794355 21108 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:14.795595 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.796087 21183 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:14.782163 23026 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.784086 22921 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:14.782009 22892 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:14.675732 23130 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.792428 22959 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.698764 23134 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.810667 21077 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:14.797264 22688 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:14.817179 21075 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:14.818137 21737 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:14.821147 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.821713 21178 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:14.822490 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.823510 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.825014 21178 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:14.825723 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:14.826189 21178 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.827208 23146 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.827111 23125 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:14.827639 23146 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.827994 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:14.828899 23076 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.829078 21077 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:14.829725 23076 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:14.830103 23076 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.830435 23076 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.828011 23146 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.832350 23130 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:14.833642 21178 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:14.834482 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:14.805222 23026 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.799171 23084 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.840129 23026 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:14.840657 23026 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.841637 22789 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:14.835943 23129 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:14.843019 23129 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:14.838713 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.843698 21181 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:14.843827 23129 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.793493 22725 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.846052 22725 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.844458 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.797127 22714 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.847151 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.848145 23129 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.850246 23137 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:14.854522 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:14.850962 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.857435 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.838258 23134 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.854239 21104 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:14.857899 21183 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:14.812278 22892 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.860844 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:14.862602 23026 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:14.863281 22513 raft_consensus.cc:3055] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:14.863665 23146 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.938009 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.858530 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:14.872080 22718 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.840811 23084 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.809887 22921 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.816948 22688 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:14.850831 23018 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 12:17:14.873492 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 56455.1us
I20260709 12:17:14.873984 23078 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.874728 23128 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.874871 22714 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:14.875214 22880 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.875771 23138 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:14.876780 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:14.946038 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:14.955909 21183 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:14.952545 21075 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:14.879854 23032 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:14.957031 21183 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:17:14.960836 22718 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:14.876216 22693 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:14.964385 22921 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:14.965746 22880 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:14.967833 22880 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:14.969099 23128 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:14.889516 22513 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:14.850989 23025 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:17:14.953481 22688 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.937633 23019 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:14.998890 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1091) took 1137 ms. Trace:
W20260709 12:17:15.002220 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.003921 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.004515 21035 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:15.005254 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.005645 23074 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.006201 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:15.006742 21035 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:15.007762 21030 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:15.008700 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.009279 21030 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:15.010035 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.010542 21030 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
W20260709 12:17:15.011153 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 134439us
I20260709 12:17:15.011921 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:15.006790 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:14.999276 21031 rpcz_store.cc:276] 0709 12:17:13.861622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.026476 (+164854us) service_pool.cc:224] Handling call
0709 12:17:14.026746 (+   270us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:14.151878 (+125132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.151907 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:14.157677 (+  5770us) log.cc:844] Serialized 52 byte log entry
0709 12:17:14.317631 (+159954us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:14.497229 (+179598us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.506809 (+  9580us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.621467 (+114658us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:14.998419 (+376952us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b18004371a0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c821c0a 00007fcba5f61219 00007fcb9c8a9a40 00007fcb9c8a44e4 00007fcb9c8a4455 00007fcb9f98c060 00007fcb9f99e716 00007fcb9f9af287 00007fcb9f9af208
0709 12:17:14.998588 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.998655 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:14.998693 (+    38us) raft_consensus.cc:1685] finished
0709 12:17:14.998703 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.998822 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104041,"prepare.queue_time_us":81452,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":94,"raft.queue_time_us":22339,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":7214,"spinlock_wait_cycles":27839232,"thread_start_us":279295,"threads_started":2,"wal-append.queue_time_us":276186}
I20260709 12:17:15.014740 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.015643 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:15.015811 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:15.016404 21031 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.014948 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:15.018227 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:15.018836 21030 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.020162 23130 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:15.020300 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.020558 23130 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:15.020922 23130 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:15.021341 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.022578 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.023134 21029 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:15.019296 21077 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.025700 21027 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:15.028810 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.029346 21036 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:15.031533 21030 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:15.033352 21030 pending_rounds.cc:85] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 2
I20260709 12:17:15.033663 21030 pending_rounds.cc:107] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:15.033932 21030 raft_consensus.cc:2889] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:15.036326 21076 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:15.033869 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:15.043308 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 90833.6us
I20260709 12:17:15.044075 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:15.048895 21031 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:15.070276 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:15.071686 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 52448.4us
I20260709 12:17:15.072685 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.083360 21075 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:15.022130 22693 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:15.027536 22921 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.013376 23074 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.037379 23128 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:15.094303 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 58044.5us
I20260709 12:17:14.978581 23032 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:15.068054 22858 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.015s	sys 0.018s
I20260709 12:17:15.129878 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:15.133848 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 117144us
I20260709 12:17:15.078994 22880 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:15.134307 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 119435us
I20260709 12:17:15.134641 22323 raft_consensus.cc:2764] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:17:15.138677 21076 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:15.138948 23125 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:15.092255 22881 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:17:15.094736 22980 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.089285 22725 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.095847 22692 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:15.149325 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 129663us
W20260709 12:17:15.135283 22858 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.015s	sys 0.019s
I20260709 12:17:15.128486 22921 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.112733 23026 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.141597 23126 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.136137 22880 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.149775 22725 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.140697 22693 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.089761 22513 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.146656 22980 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.154608 22714 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:15.162349 20999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.545s (SENT) [suppressed 10 similar messages]
I20260709 12:17:15.195190 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.164783 22892 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.199038 21027 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:15.166023 22921 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.173167 22725 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.202431 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.188980 22980 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.174970 22880 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.194348 23126 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.206951 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.208789 21183 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:15.211824 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:15.205695 23153 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:17:15.212975 21183 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:15.233397 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.234781 21183 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:17:15.209143 23137 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.199221 22714 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:15.237916 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 113495us
W20260709 12:17:15.249333 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 109141us
W20260709 12:17:15.239431 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 93562.2us
I20260709 12:17:15.250363 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.250648 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.251439 21103 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:15.253281 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:17:15.237434 23080 consensus_meta.cc:287] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.001s
I20260709 12:17:15.257586 21183 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:15.260433 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:15.280831 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.281638 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:15.282828 21076 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.284026 21076 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:15.286804 23147 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 12:17:15.288842 23155 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:17:15.290083 23154 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:17:15.291383 23156 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:17:15.291244 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.292521 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.293159 21108 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:15.293782 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.252771 22881 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:15.295318 22881 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.296657 21181 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:15.299733 22692 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.300271 22692 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:15.300874 22692 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.300990 23167 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.301658 23167 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.302220 23167 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:15.304352 23158 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:17:15.254412 23137 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.306635 21035 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:15.236119 23025 consensus_queue.cc:1059] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:17:15.280230 23126 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.325199 22881 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.300345 22686 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.323889 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:15.337159 22902 raft_consensus.cc:2764] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:15.338141 21183 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 12:17:15.339468 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 86268.4us
I20260709 12:17:15.325137 23074 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.330412 23032 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.329815 22881 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:15.342993 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 180657us
I20260709 12:17:15.346685 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:15.350180 23132 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.864s	user 0.007s	sys 0.005s
I20260709 12:17:15.352885 23137 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:15.357918 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.358914 21035 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:15.360559 21711 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:15.360620 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.380017 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.350580 22880 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.354694 22714 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.330858 23126 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:15.392947 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 247557us
I20260709 12:17:15.380586 23022 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.396238 21105 raft_consensus.cc:1240] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:15.397936 21712 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:15.379575 23125 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:15.423911 22725 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.428201 23126 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.431725 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 1867) took 1640 ms. Trace:
I20260709 12:17:15.432112 21032 rpcz_store.cc:276] 0709 12:17:13.790872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.001922 (+211050us) service_pool.cc:224] Handling call
0709 12:17:14.002176 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.217373 (+215197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.431477 (+1214104us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54003a4154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:15.431666 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493656960}
I20260709 12:17:15.399093 23022 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.435209 23022 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.440248 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1433) took 1354 ms. Trace:
I20260709 12:17:15.440618 21177 rpcz_store.cc:276] 0709 12:17:14.086332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.301661 (+215329us) service_pool.cc:224] Handling call
0709 12:17:14.301952 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.302248 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.302275 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:14.302735 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:17:14.336403 (+ 33668us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:14.336441 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.336523 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.349315 (+1012792us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:15.409329 (+ 60014us) raft_consensus.cc:1685] finished
0709 12:17:15.409353 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.440183 (+ 30830us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2982,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3980,"spinlock_wait_cycles":8484096,"thread_start_us":33307,"threads_started":1,"wal-append.queue_time_us":134261}
I20260709 12:17:15.404875 23137 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.456945 22688 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.462466 20934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49682 (request call id 218) took 10549 ms. Trace:
W20260709 12:17:15.463593 23160 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:17:14.879227 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:15.466632 22688 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:15.468276 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 1865) took 1721 ms. Trace:
I20260709 12:17:15.479125 21028 rpcz_store.cc:276] 0709 12:17:13.746814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.970862 (+224048us) service_pool.cc:224] Handling call
0709 12:17:13.977075 (+  6213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.337726 (+360651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.468044 (+1130318us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54000811d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:15.468221 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733627648}
I20260709 12:17:15.470487 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.480167 21110 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.471076 20930 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.472097 23164 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:15.472707 23163 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:15.500592 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 215484us
I20260709 12:17:15.473429 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:15.473845 23076 consensus_meta.cc:287] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.001s
I20260709 12:17:15.489820 20930 catalog_manager.cc:5697] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 3 to 4, leader changed from <none> to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.493197 22880 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.494155 23125 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.408908 22980 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.501938 21111 raft_consensus.cc:2368] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5.
I20260709 12:17:15.503504 20930 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 4, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.509274 20930 catalog_manager.cc:5697] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 2, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 2 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:15.517817 23127 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:15.506601 23076 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.518298 20930 catalog_manager.cc:5697] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 3, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 3 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:15.518967 23127 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:15.519331 23127 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:15.520370 23076 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.520129 23127 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.520152 20930 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 3 to 4, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.488662 22714 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:15.523955 20930 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.529819 20930 catalog_manager.cc:5697] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 3, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 3 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.533147 20930 catalog_manager.cc:5697] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 3, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 3 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.536059 20930 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 2 to 3, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 3 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.537829 20930 catalog_manager.cc:5697] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.537204 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.539456 20930 catalog_manager.cc:5697] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 1 to 3, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 3 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.476330 20934 rpcz_store.cc:276] 0709 12:17:04.913172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.913306 (+   134us) service_pool.cc:224] Handling call
0709 12:17:15.462370 (+10549064us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:12.952018 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:12.983669 (+ 31651us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:12.983725 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:17:12.983744 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:12.985011 (+  1267us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:12.985106 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:12.985133 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:17:12.986322 (+  1189us) tablet.cc:701] Row locks acquired
0709 12:17:12.986364 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:17:12.986555 (+   191us) write_op.cc:270] Start()
0709 12:17:12.986704 (+   149us) write_op.cc:276] Timestamp: P: 1783599432986476 usec, L: 0
0709 12:17:12.986744 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:17:13.053182 (+ 66438us) log.cc:844] Serialized 5281 byte log entry
0709 12:17:13.196256 (+143074us) op_driver.cc:464] REPLICATION: finished
0709 12:17:13.307898 (+111642us) write_op.cc:301] APPLY: starting
0709 12:17:13.308010 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:13.308290 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:13.308446 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:13.310120 (+  1674us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:13.310456 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:17:13.310519 (+    63us) write_op.cc:312] APPLY: finished
0709 12:17:13.319169 (+  8650us) log.cc:844] Serialized 95 byte log entry
0709 12:17:13.319383 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:13.319555 (+   172us) write_op.cc:454] Released schema lock
0709 12:17:13.319625 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:13.340439 (+ 20814us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:13.345866 (+  5427us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2911,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":111351,"apply.run_cpu_time_us":4075,"apply.run_wall_time_us":25820,"num_ops":13,"prepare.queue_time_us":450924,"prepare.run_cpu_time_us":6009,"prepare.run_wall_time_us":106252,"raft.queue_time_us":127412,"raft.run_cpu_time_us":29171,"raft.run_wall_time_us":87110,"replication_time_us":209337,"thread_start_us":667936,"threads_started":4,"wal-append.queue_time_us":12792,"wal-append.run_cpu_time_us":43519,"wal-append.run_wall_time_us":1265736}]]}
I20260709 12:17:15.541242 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.542312 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.545357 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.500837 23096 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:17:15.511036 22725 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.547775 21104 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:15.541829 20930 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:15.549755 21110 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:15.550551 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.552356 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.558037 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.558269 21110 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:15.560930 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.563730 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.567492 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.504803 23164 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.544723 23127 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:15.507053 23163 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:15.576918 23177 log.cc:927] Time spent T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:17:15.582430 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 1875) took 1068 ms. Trace:
I20260709 12:17:15.585880 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.540223 22714 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.582834 21034 rpcz_store.cc:276] 0709 12:17:14.514433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.514608 (+   175us) service_pool.cc:224] Handling call
0709 12:17:14.514926 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.999026 (+484100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.999055 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:15.003743 (+  4688us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.301304 (+297561us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b4800080358. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f 00007fcba49abf37 00007fcba49c055c 00007fcba49c0508 00007fcba49c0488 00007fcba49c0443 00007fcba49bf6ec 00007fcba38e9a96
0709 12:17:15.313750 (+ 12446us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b18000c09a0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b 00007fcb9f533d23 00007fcb9f5340d1 00007fcb9f94fa0f
0709 12:17:15.394115 (+ 80365us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:15.394154 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.394220 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.582225 (+188005us) raft_consensus.cc:1685] finished
0709 12:17:15.582245 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.582368 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":520437,"raft.queue_time_us":486565,"raft.run_cpu_time_us":1080,"raft.run_wall_time_us":295295,"spinlock_wait_cycles":15096960,"thread_start_us":80193,"threads_started":1,"wal-append.queue_time_us":523336}
I20260709 12:17:15.596626 23164 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.567654 22692 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.607228 22714 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.607568 21103 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:15.587311 23019 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 12:17:15.569310 22921 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.610175 22921 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.607311 22692 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.612087 23163 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.600994 23022 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.604059 22513 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.613140 22980 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:15.614862 23130 consensus_meta.cc:287] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.006s
I20260709 12:17:15.615231 23130 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.623833 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.624480 21102 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:15.625355 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.626420 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.627748 21106 raft_consensus.cc:2410] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:15.627518 23167 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.629916 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.630653 23167 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.631769 21111 raft_consensus.cc:2368] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5.
I20260709 12:17:15.630672 21102 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 2: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:15.641554 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.643049 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.644317 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.644899 21102 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:15.645975 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.628525 23130 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:15.670073 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.625356 23022 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:15.674306 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.666641 23167 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:15.676553 21102 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:15.679956 21102 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:15.681440 21102 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:15.686527 23026 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:15.686936 23026 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:15.687675 23026 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.688580 23026 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.678929 22804 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:15.689213 21103 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:15.690229 22804 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.691953 22804 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.692122 21103 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:15.676782 23167 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.697153 21103 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:15.700773 23167 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.704115 21102 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:15.707871 21107 raft_consensus.cc:2410] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:15.715327 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.715828 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.716491 21180 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:15.719691 22714 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:15.720203 22714 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.722967 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.726619 21180 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:17:15.734503 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.735968 21149 leader_election.cc:400] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5.
I20260709 12:17:15.736354 21149 leader_election.cc:403] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:15.740095 22959 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.740250 22714 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.742954 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.744289 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:15.744796 21111 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.747195 22971 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:15.747736 22971 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.750005 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.750236 22971 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.754050 23018 raft_consensus.cc:3055] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:15.754420 23018 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:15.755244 23018 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.756314 23018 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.759354 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.754645 21111 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:15.766165 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:15.766768 21182 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.767141 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:15.767696 21181 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.768618 22959 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5.
I20260709 12:17:15.770836 22712 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:15.771250 22712 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:15.772053 22712 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.773234 22712 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.774125 21182 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:15.776315 21186 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:15.778441 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.779069 21179 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:15.780277 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:15.780550 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.780978 21184 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:15.781955 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 56488.6us
I20260709 12:17:15.782068 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:15.781179 21179 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:15.784039 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:15.787326 21180 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:15.792498 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.794682 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.795640 21186 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:15.801277 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.767360 23146 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.792043 23167 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.806041 23167 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.806403 23167 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.806995 22959 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:15.807535 22959 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.807924 21184 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:15.809602 22959 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.812095 21077 leader_election.cc:400] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7.
I20260709 12:17:15.812983 22892 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.813428 22892 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.814937 23135 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:15.817651 21181 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:15.817951 21179 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:15.828356 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:15.829743 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:15.831436 23143 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:15.832122 23184 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.256s	user 0.003s	sys 0.000s
I20260709 12:17:15.834883 22714 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.835268 22714 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:15.835646 22714 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.836280 23130 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.836763 23130 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.835294 23144 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.839342 23130 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:15.840070 21151 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:15.840535 23167 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.841313 22712 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:15.841801 22712 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:15.842584 22712 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.843428 22892 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:15.844658 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:15.828320 23157 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:17:15.847601 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 115547us
I20260709 12:17:15.848613 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:15.853787 21075 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:15.854097 21150 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:15.855325 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:15.859464 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:15.862685 22455 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:15.863806 21077 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.863895 22455 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:15.865724 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.867169 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.868983 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:15.869665 21181 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:15.877928 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:15.874797 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:15.879892 22455 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.847358 23167 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:15.881268 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.856346 22971 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:15.883491 23136 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.883821 23090 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.884611 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:15.884881 23134 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:15.885329 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:15.895794 21746 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:15.885541 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:15.886030 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:15.895145 23090 consensus_queue.cc:1243] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:15.897220 21742 raft_consensus.cc:2410] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:17:15.886687 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:15.898306 21741 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:15.899868 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.895277 23033 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.904372 23033 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.906994 22899 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:15.908913 23031 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:15.911339 23083 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:15.912111 23083 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:15.872882 23084 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:15.883416 21739 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:15.887502 23174 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.883769 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:15.888355 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:15.887812 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.864085 23081 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.862331 23019 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:15.861407 22804 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.890275 21104 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:15.891098 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:15.942822 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 51791.3us
I20260709 12:17:15.896023 23135 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:15.913985 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 520022us
I20260709 12:17:15.951745 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:15.952294 21036 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.873799 22892 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:15.881614 23125 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:15.928531 21747 raft_consensus.cc:2368] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6.
I20260709 12:17:15.927805 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:15.892493 23136 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:15.943521 21077 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.887387 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:15.988232 21740 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:15.911818 23026 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:17:15.956133 21150 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:15.959348 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:15.992349 21075 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:15.960489 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.994145 23136 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.963224 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:15.963824 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.967301 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.986604 21029 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.001052 21032 raft_consensus.cc:2410] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:15.986464 22323 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:15.991572 22971 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:16.037968 22323 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:15.961277 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:15.999197 21186 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:15.911264 23031 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:17:16.002210 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.007275 21738 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:17:16.007830 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.008358 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:15.958106 22881 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:16.046056 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.024518 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:16.025466 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 82023.4us
I20260709 12:17:16.047498 21077 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:16.047950 21075 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:15.960353 22892 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.918637 23084 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.034092 21036 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:15.926430 23174 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.022416 22815 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:15.996186 23033 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.001765 23151 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.043411 21031 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:16.065306 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.008759 23074 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:16.044065 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 166611us
I20260709 12:17:16.049764 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:16.031526 23125 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:17:16.112680 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 64168.2us
I20260709 12:17:16.036845 23139 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.036598 22980 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:16.022567 23135 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:16.041675 22805 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:17:16.035719 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 178233us
I20260709 12:17:16.065953 21740 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
W20260709 12:17:16.116547 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.045197 22971 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:16.129097 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 81222.8us
I20260709 12:17:16.063905 22881 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:16.063571 22892 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.063532 22693 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.120348 23025 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:16.127568 23191 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:16.127110 23135 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:16.120522 23161 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:16.130112 21075 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:16.066969 23127 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.052574 22455 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.131562 21709 leader_election.cc:400] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5.
I20260709 12:17:16.117712 23139 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:16.133423 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 180456us
I20260709 12:17:16.138481 21740 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:16.144006 21709 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.147739 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.132494 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.145470 22455 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:16.150301 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:16.151640 21743 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:16.148612 22455 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.070228 22815 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.157078 21709 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.118857 23146 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:17:16.133279 22980 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:16.115374 23074 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.160589 21182 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:16.160578 20999 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.161011 22455 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:16.163295 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.147840 23138 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.149905 23139 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.150431 22693 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:16.211265 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 50766us
I20260709 12:17:16.212229 20999 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.160972 23031 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.167104 23130 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.141644 23025 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.159508 23036 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.165853 22959 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.166957 23019 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.219147 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.227232 21178 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:16.166647 23083 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.172185 23138 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:16.215517 22805 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:16.216643 23170 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:16.155028 23199 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
W20260709 12:17:16.271323 23195 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:17:16.215776 23017 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.297230 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:16.268325 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:16.329054 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 172033us
I20260709 12:17:16.334312 21709 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:16.251317 23032 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.265408 23084 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:16.291587 23201 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:17:16.343532 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:16.345845 21742 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:16.269196 23143 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.292855 23074 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.211771 23125 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.290161 22714 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.269889 22959 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.288038 22892 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.221302 23102 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.294991 23138 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.293991 23019 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:16.292157 22971 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:16.352867 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 344577us
W20260709 12:17:16.353235 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 134166us
I20260709 12:17:16.365384 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.356261 22805 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.293108 22980 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.221933 22881 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.366914 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.254861 23130 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.367076 21180 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.337095 23017 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.358422 23032 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:16.355525 23084 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:17:16.372786 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.367803 23074 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.366295 23019 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.363858 23174 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.371610 23206 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.380921 21151 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.370479 22815 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.382745 23032 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:16.380415 22712 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.388019 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.392299 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.395391 23080 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:16.376143 22971 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:17:16.384958 23223 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.390836 23208 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.380746 23083 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:16.383009 22911 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:17:16.380064 23102 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:17:16.421315 23083 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:16.421670 23083 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:16.404386 21185 pending_rounds.cc:85] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 2
I20260709 12:17:16.393427 23143 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:16.411327 21106 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:16.424111 21106 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:16.412473 22714 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:16.414494 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:16.416342 23081 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.418780 21184 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:16.387368 22899 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:17:16.428107 21186 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.420369 21181 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:16.423449 21185 pending_rounds.cc:107] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:17:16.389214 23174 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:17:16.429399 21185 raft_consensus.cc:2889] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:16.400324 23033 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:16.403389 23200 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:17:16.429693 22899 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:16.430080 22899 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:16.430787 22899 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.432227 22899 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.400224 22971 consensus_queue.cc:1243] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:16.395889 23080 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.398233 22815 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:17:16.439555 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:16.441113 21106 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.438306 23025 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.436955 23143 raft_consensus.cc:697] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:16.404834 23223 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.464488 23128 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:16.423795 23083 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.476699 23083 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.480037 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.480705 21746 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:16.462868 23032 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.475507 23094 raft_consensus.cc:3055] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:16.487557 23094 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:16.488356 23094 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.489575 23094 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.475591 23130 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:16.491056 23128 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.493515 23128 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.497134 23139 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.498163 21104 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:16.511399 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 62154.4us
I20260709 12:17:16.499128 23017 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.524763 22513 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:16.525923 23220 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:16.526908 23222 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:17:16.529152 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:16.532234 23223 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:16.488456 21741 consensus_meta.cc:287] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.000s
I20260709 12:17:16.556098 21110 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:16.548529 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 156298us
I20260709 12:17:16.553720 21179 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.552778 22513 consensus_queue.cc:1243] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:16.536103 23019 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.592689 22323 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.558542 21741 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:16.594784 21740 raft_consensus.cc:1240] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.536303 23138 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.561120 23097 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:16.641381 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 47942.3us
I20260709 12:17:16.648177 21034 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:16.648938 21036 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:17:16.649312 21036 pending_rounds.cc:85] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 1
I20260709 12:17:16.650374 21036 pending_rounds.cc:107] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:17:16.650605 21036 raft_consensus.cc:2889] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:16.591190 22815 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:16.652805 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.640756 23036 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:16.654342 23036 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.655092 23138 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.651372 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.657068 21031 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:16.659554 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:16.670594 22323 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:16.671139 22323 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.644652 22513 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.691530 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.702291 21034 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:16.692673 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.693711 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.703088 21031 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.706060 22323 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.708845 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.713539 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.715914 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.716553 21033 raft_consensus.cc:2368] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6.
I20260709 12:17:16.717156 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.718334 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:16.645764 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.720510 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.724836 21029 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:16.725613 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.726231 21029 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:16.726994 23226 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:17:16.727319 23230 log.cc:927] Time spent T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:17:16.723135 22679 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:16.731348 22679 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.640722 23135 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:17:16.721716 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.735877 21034 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.726290 21031 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:16.721132 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.644735 23017 consensus_queue.cc:1059] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:17:16.733577 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:16.700941 23136 consensus_meta.cc:287] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.670s	user 0.002s	sys 0.008s
I20260709 12:17:16.651743 23016 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:17:16.740177 23136 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.723826 22513 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.742223 23139 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.649405 23143 consensus_queue.cc:237] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.649991 23097 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.746780 23036 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.737293 21033 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:16.749620 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:16.749228 23080 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:16.652971 22815 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.756422 22815 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.758879 21027 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:16.759006 22679 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.760113 22513 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.760072 21027 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:16.761898 21032 raft_consensus.cc:2410] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:16.764079 21150 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:16.762768 21036 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 12:17:16.767427 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.768117 21027 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:16.771348 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.772418 21185 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:16.774650 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.776577 21150 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:16.776870 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.778188 21035 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:16.779074 23019 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.742249 23136 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.767693 23094 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:16.780033 23094 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:16.780824 23094 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.781977 23094 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.788321 22959 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:16.788924 21029 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:16.790154 23081 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.767454 23139 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:16.795548 23139 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.796793 21181 raft_consensus.cc:2393] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:16.798609 23168 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:16.798971 23168 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:16.778234 23097 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.799772 23168 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.804081 23151 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.804883 21150 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:16.807204 23208 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.804909 22971 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:17:16.806737 23017 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:16.812326 21106 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:16.806335 21150 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:16.814283 21034 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:16.819164 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:16.820233 21027 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:16.815896 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:16.806905 23207 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.537s	user 0.004s	sys 0.000s
I20260709 12:17:16.810431 23017 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.827312 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.827494 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:16.829557 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.807565 23208 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:16.835678 21076 leader_election.cc:400] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6.
I20260709 12:17:16.835951 21076 leader_election.cc:403] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:17:16.807406 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f16c07bcae284f65a7c0ee0375e00769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:16.811232 23136 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.809993 23139 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.841542 21076 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:16.822562 23126 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:16.848094 21106 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:17:16.848436 21106 pending_rounds.cc:85] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 4
I20260709 12:17:16.842239 22804 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6.
I20260709 12:17:16.849116 23127 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:16.838440 23208 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.849532 23127 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:16.849988 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.849988 23127 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.828575 23134 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:16.851275 23240 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:17:16.851183 23134 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.853220 23134 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:16.853762 23126 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:16.828161 22959 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.856161 22959 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:16.856603 22959 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.857468 23127 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.833868 23135 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:16.860011 23135 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:16.860385 23135 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.860656 23127 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.860790 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:16.837323 22526 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:16.863631 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:16.865432 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:16.847201 23136 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.866255 23036 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:16.867041 23036 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:16.867281 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:16.867666 23136 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.868438 23136 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.868799 23136 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:16.875960 23136 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:16.877591 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.877727 22323 raft_consensus.cc:3055] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:16.878088 22323 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:16.879545 22892 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.881852 23146 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.882131 22804 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:16.882297 23146 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.882656 23138 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.883168 23138 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.884248 23146 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.885079 23138 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.835523 23168 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.885865 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.886480 21744 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:16.887315 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.883111 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:16.888047 21103 raft_consensus.cc:2376] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5. Re-sending same reply.
I20260709 12:17:16.882627 22804 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.889469 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:16.889971 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.891197 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.891736 21743 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:16.869145 23017 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:16.869465 23026 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:16.892545 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:16.892760 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.894260 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.890584 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:16.895967 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.896641 22804 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.897251 21104 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:16.898020 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.898499 23146 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.898988 23146 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.899515 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:16.900844 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:16.901508 23146 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:16.901988 22892 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:16.902751 22892 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:16.903120 22892 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:16.904136 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:16.873296 23202 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.535s	user 0.001s	sys 0.002s
I20260709 12:17:16.901746 23026 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:16.905650 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.905441 23026 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.830327 23031 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:17:16.907356 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.903921 22892 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.846160 23220 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:17:16.837209 23229 consensus_queue.cc:1059] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:17:16.848666 21106 pending_rounds.cc:107] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:17:16.854573 23126 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:16.910681 21106 raft_consensus.cc:2889] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:16.915267 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:16.915838 21181 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:16.916864 21075 leader_election.cc:400] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6.
I20260709 12:17:16.917757 21075 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:16.917966 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:16.917447 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:16.921134 21743 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:16.921888 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.924491 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.926244 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:16.927039 21108 raft_consensus.cc:2410] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:16.927949 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:16.908499 23197 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.617s	user 0.003s	sys 0.000s
W20260709 12:17:16.931419 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.933730 21076 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:16.931331 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:16.935724 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.936193 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:16.937964 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.867359 23036 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:16.937423 21075 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:16.968007 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.968808 21029 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:16.942071 22804 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.961884 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:16.977053 21027 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.951745 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.931780 23168 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:16.942458 23138 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.950940 21031 raft_consensus.cc:3055] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.942858 23126 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.947130 22892 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.942114 23218 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:17:16.984527 21031 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:16.938364 23208 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:16.994859 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.006124 21034 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:16.944983 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.005956 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.007231 21029 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:16.947366 23127 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:17.010210 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:16.983843 21738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 524) took 1117 ms. Trace:
I20260709 12:17:17.016590 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.017586 21738 rpcz_store.cc:276] 0709 12:17:15.866568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.874060 (+  7492us) service_pool.cc:224] Handling call
0709 12:17:15.917810 (+ 43750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.062508 (+144698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.978637 (+916129us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54006d83d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:16.983754 (+  5117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72930048}
W20260709 12:17:17.020409 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 83073us
I20260709 12:17:16.983428 23136 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.025015 23036 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:17.046573 23241 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:17:17.027482 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:17.031440 23239 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:17:17.039502 23193 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.825s	user 0.011s	sys 0.028s
I20260709 12:17:17.029000 21032 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:16.984692 23168 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.032696 21711 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:17.034245 21076 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:17.027972 23138 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:17.042400 23208 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:17.055469 21028 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:17.055666 21075 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:17.066784 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:17.056943 21031 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.065019 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:17.067684 21027 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:17.068467 21031 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.069492 22892 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.058959 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:17.070382 23137 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.081691 22892 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:17.069635 21075 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:17.075963 21743 raft_consensus.cc:1240] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:17.078625 23094 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.079720 23136 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:17.082993 21110 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:17.083403 21075 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:17.080634 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1211) took 1469 ms. Trace:
I20260709 12:17:17.051631 23135 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.103618 21031 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:17:17.103142 21102 rpcz_store.cc:276] 0709 12:17:15.610886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.708481 (+ 97595us) service_pool.cc:224] Handling call
0709 12:17:15.708862 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:15.709403 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.709431 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:15.723364 (+ 13933us) log.cc:844] Serialized 52 byte log entry
0709 12:17:15.917051 (+193687us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:15.917763 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.917828 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.038911 (+1121083us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:17.080349 (+ 41438us) raft_consensus.cc:1685] finished
0709 12:17:17.080370 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.080574 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78942,"raft.queue_time_us":222,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":12188,"spinlock_wait_cycles":9800064,"thread_start_us":133591,"threads_started":1,"wal-append.queue_time_us":401574}
I20260709 12:17:17.082872 23127 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:17.115494 23127 raft_consensus.cc:697] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:17.115211 21031 pending_rounds.cc:85] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 1
I20260709 12:17:17.084084 23134 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.109313 23218 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:17.116355 23127 consensus_queue.cc:237] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.116320 21031 pending_rounds.cc:107] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:17:17.119695 21031 raft_consensus.cc:2889] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:17.092308 22892 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.124274 23135 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:17.124871 23135 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.125211 23135 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.125509 23135 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.057466 22959 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:17.127168 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.104378 23094 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.116847 23218 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:17.116592 23126 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:17.151530 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 86576.1us
I20260709 12:17:17.158452 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:17.152305 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.154386 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.159523 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:17.155053 23126 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.181703 23167 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:17.182958 22959 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:17.185907 23218 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:17.190997 23136 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.193608 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:17.219638 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:17.195734 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:17.197216 23094 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:17.198315 23168 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:17.201757 21179 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:17.201758 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:17.227159 21181 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:17.228022 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:17.202301 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:17.202389 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:17.203224 23228 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.550s	user 0.002s	sys 0.001s
I20260709 12:17:17.203742 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:17.205618 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:17.204671 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:17.209179 23126 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:17.209674 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 50206.7us
I20260709 12:17:17.156122 23026 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.243635 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:17.213726 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:17.218034 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:17.224607 21107 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:17:17.245301 21107 pending_rounds.cc:85] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 3
I20260709 12:17:17.245576 21107 pending_rounds.cc:107] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:17:17.245796 21107 raft_consensus.cc:2889] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:17.224987 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:17.208834 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.246992 21109 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:17.249112 21076 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:17.217881 23136 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.235116 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.240093 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:17.250377 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 167036us
I20260709 12:17:17.226187 23218 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:17.241700 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.251150 21075 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:17.252965 21077 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:17.256606 21108 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:17.261284 21184 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:17.263444 21183 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:17.242835 23138 raft_consensus.cc:697] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:17.212520 23167 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.242065 23260 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:17.270062 21102 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:17.255117 23136 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.272887 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:17.277506 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:17.276759 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:17.280702 21031 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.280939 21033 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:17.287322 21031 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:17.288566 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:17.270650 23252 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:17.256456 23128 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:17:17.264290 23218 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:17.304859 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 53800.9us
I20260709 12:17:17.306454 23138 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:17.274966 23260 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.312495 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:17.318789 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.286182 22815 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:17.325335 22815 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.325708 22815 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:17.326460 23237 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.673s	user 0.003s	sys 0.000s
I20260709 12:17:17.320098 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.276096 23261 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:17.322781 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 49907.8us
I20260709 12:17:17.286362 23026 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:17:17.324103 21107 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:17:17.324995 21109 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:17:17.334971 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 45297.5us
I20260709 12:17:17.335611 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:17.323640 21102 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:17.331660 21181 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:17.332762 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.336531 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.338214 21033 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:17.338420 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.340021 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:17.340003 21032 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:17.341459 21034 pending_rounds.cc:85] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 1
I20260709 12:17:17.342015 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.342963 21034 pending_rounds.cc:107] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:17:17.343272 21034 raft_consensus.cc:2889] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:17.343508 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.341636 23125 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.345252 22881 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:17.347307 21031 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:17.328764 23163 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:17.329056 23260 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:17.354166 21035 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:17.346954 23259 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.351953 22881 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:17.360978 22323 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:17.367162 22323 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.368613 23125 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.369133 23125 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.372246 22881 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.372826 23125 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:17.374017 22526 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:17.374295 22714 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:17.374739 22714 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:17.369149 23167 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:17.370662 23259 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.375610 22714 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:17.377139 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.379174 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:17.379220 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.377827 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:17.380586 21103 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:17.380609 20999 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.381901 20999 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.382936 21709 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.391559 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:17.377355 23259 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:17.392730 21709 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.394205 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.395329 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.399809 21028 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:17.366159 23252 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:17.370514 23090 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.416041 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.422596 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.387517 23017 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.391711 22899 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.392297 23083 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.436584 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:17.432855 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 81780.9us
I20260709 12:17:17.394806 23137 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.364562 23163 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.436378 22323 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.408562 23084 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.442324 22323 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.390899 23081 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:17:17.423288 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:17.394706 23134 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:17:17.397328 23133 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:17:17.436538 22679 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:17.464279 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 50076.9us
I20260709 12:17:17.466156 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.468864 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.470078 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.470786 21107 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:17.471284 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.471242 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.470685 21105 raft_consensus.cc:2955] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:17.454476 23084 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:17.474809 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 97461.9us
I20260709 12:17:17.453300 23090 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:17.467314 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.476038 21111 raft_consensus.cc:1240] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:17.473269 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.469657 22892 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:17.487182 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 43923us
I20260709 12:17:17.489570 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:17.488152 20999 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:17.481190 23223 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:17.486146 23267 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:17:17.500290 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.500831 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.490898 23218 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:17.501514 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.501422 21031 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:17.503718 21033 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:17.504590 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:17.482895 23084 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:17.504730 21031 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:17.494076 23268 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.505467 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:17.510322 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:17.514185 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:17.514294 21031 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:17.472486 23252 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.497844 23168 consensus_queue.cc:1059] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:17:17.519886 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:17.517774 21031 pending_rounds.cc:85] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 2
I20260709 12:17:17.520534 21031 pending_rounds.cc:107] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:17.520503 21033 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 1.
I20260709 12:17:17.516060 23128 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 12:17:17.523393 23270 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:17:17.521234 21031 raft_consensus.cc:2889] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:17.504609 23279 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.527510 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:17.508477 23266 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:17.508618 23268 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.516916 23220 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:17.512014 23278 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.518739 23259 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.525067 23017 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:17.538189 23017 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:17.538589 23017 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:17.547518 21103 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:17.533931 23138 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:17:17.549186 23019 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:17.530706 23266 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.532253 23220 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.550359 22815 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.566865 23220 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.567909 23266 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.568511 22815 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:17.532689 23268 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.533452 23125 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:17.569679 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:17.559438 23143 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.570881 23143 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:17.571344 23143 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.570015 23125 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:17.573475 23125 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.559337 23278 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:17.560624 23287 consensus_queue.cc:1059] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:17.575443 23279 raft_consensus.cc:3055] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:17.575829 23279 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:17.576633 23279 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.509701 23090 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.564079 23084 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:17.565584 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:17.579844 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:17.592358 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:17.592952 21029 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:17.586229 23285 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:17.580257 23274 log.cc:927] Time spent T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:17:17.551795 23163 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:17.600960 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 82524.4us
I20260709 12:17:17.598641 22980 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:17.600006 23090 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:17.605834 23135 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:17.607744 21102 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:17.622468 21149 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.565369 23260 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:17.658739 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:17.662642 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.607810 23288 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:17:17.668191 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 200930us
I20260709 12:17:17.617076 23017 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:17.757818 21108 raft_consensus.cc:2368] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 7. Current term is 8.
W20260709 12:17:17.782954 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.800139 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 127115us
I20260709 12:17:17.665808 23278 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.801602 22815 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.654371 23096 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 12:17:17.600708 23285 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:17.821583 23136 consensus_meta.cc:287] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.002s
I20260709 12:17:17.843509 21151 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:17.762228 23126 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.843706 23096 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.821693 23081 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.806468 22815 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.867723 23133 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:17:17.902110 23286 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:17:17.839933 23278 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:17:17.883258 23096 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:17.870960 23136 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.894992 23133 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:18.000276 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 156838us
I20260709 12:17:18.002221 21151 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:17.883987 23081 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:17.914567 23032 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:17.919844 22815 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:18.011694 21709 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.643s (SENT)
I20260709 12:17:17.955183 23017 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:17.990978 23285 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:18.002909 23278 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:18.008523 23136 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:18.007637 23135 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:18.025581 23289 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:18.040155 23017 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.007439 23143 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:18.006224 23296 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:17:18.054234 23017 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:18.021735 23032 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:18.051509 23097 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:18.050787 23304 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:18.061986 23300 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:17:18.064913 23017 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:18.065809 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 61930.9us
I20260709 12:17:18.070340 23289 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.070712 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:18.071635 23303 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.072041 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:18.072041 23303 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.072758 23303 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.073369 23296 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.074302 23032 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:18.056653 23126 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:18.075639 23096 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:18.076815 23143 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:18.081194 23303 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:18.082683 23266 consensus_meta.cc:287] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.002s
I20260709 12:17:18.032687 23278 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:18.094655 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.096134 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:18.096793 21030 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:18.098803 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:18.099232 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:18.099627 21105 raft_consensus.cc:2410] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:17:18.099763 21103 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.100366 21031 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:18.100689 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:18.101383 21032 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:18.103281 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:18.104605 21034 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:18.105984 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:18.106896 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:18.111773 23299 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:17:18.112377 21711 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:18.111770 23032 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.114156 23032 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.114468 23032 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.117560 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:18.119761 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:18.103883 21029 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:18.120705 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:18.121552 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:18.123706 21738 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:18.124812 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:18.125115 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:18.125434 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:18.125983 21032 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:18.126123 21033 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:18.126814 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:18.127328 21032 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.128289 23304 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:18.136071 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:18.138188 21033 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:18.141208 21032 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:18.143189 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:18.143854 21032 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:18.126222 23220 consensus_meta.cc:287] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.002s
I20260709 12:17:18.144556 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:18.147895 23309 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:18.148408 23309 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:18.151072 21032 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:18.069021 23097 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:18.155375 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.156499 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:18.157514 21035 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:18.136526 23125 consensus_meta.cc:287] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.005s
I20260709 12:17:18.137076 23282 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:18.133057 23084 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:17:18.128839 23304 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:18.099265 23266 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:18.847882 21103 consensus_meta.cc:287] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.748s	user 0.008s	sys 0.000s
I20260709 12:17:18.218979 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:18.972985 21710 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.004s	sys 0.030s
W20260709 12:17:18.389267 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.988031 21103 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:18.975090 21032 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:18.976840 21709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.008s	sys 0.036s
W20260709 12:17:18.990053 21709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.008s	sys 0.036s
I20260709 12:17:18.215920 21106 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:17:18.973794 21077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.023s	sys 0.021s
I20260709 12:17:18.167629 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:18.990821 21077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.024s	sys 0.021s
I20260709 12:17:18.976126 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:18.324177 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.225289 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:18.302323 21035 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:18.976425 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:18.992245 21185 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:18.976065 21105 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:18.976511 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 864086us
W20260709 12:17:18.989567 21710 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.005s	sys 0.030s
W20260709 12:17:18.986272 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.331367 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:18.991252 21180 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:18.999859 21184 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:17:19.000298 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 781354us
I20260709 12:17:19.003391 21032 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:17:18.260401 23268 consensus_meta.cc:287] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
W20260709 12:17:18.331077 23273 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:17:18.158306 23303 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:18.345737 23301 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.030092 21111 raft_consensus.cc:2368] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6.
W20260709 12:17:19.034034 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 56067.4us
I20260709 12:17:18.987021 23282 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.202126 23310 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.168318 23308 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:18.153338 23220 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:18.209776 23018 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.823s
W20260709 12:17:19.046904 21027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.004s	sys 0.012s
I20260709 12:17:18.212064 23032 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:18.169854 23125 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:19.053755 21027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.004s	sys 0.012s
I20260709 12:17:19.037750 23282 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:19.033383 23136 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:19.067512 21030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.002s	sys 0.016s
I20260709 12:17:19.038204 23303 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.029495 23268 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.052953 23097 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.123947 21109 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:17:19.125352 21030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.003s	sys 0.016s
I20260709 12:17:19.125797 21102 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:19.070070 23285 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:19.130307 21712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.006s	sys 0.026s
I20260709 12:17:19.042186 23316 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 12:17:19.130647 21712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.006s	sys 0.026s
I20260709 12:17:19.038383 23301 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:19.126272 23252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.021s	sys 0.000s
I20260709 12:17:19.127018 21740 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:19.139489 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1142) took 1023 ms. Trace:
I20260709 12:17:19.139885 21031 rpcz_store.cc:276] 0709 12:17:18.116335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.116445 (+   110us) service_pool.cc:224] Handling call
0709 12:17:18.116760 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:18.117057 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:18.117081 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:18.117479 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 12:17:18.260629 (+143150us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:18.260668 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.260737 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:19.139247 (+878510us) raft_consensus.cc:1685] finished
0709 12:17:19.139268 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.139428 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1396,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9502,"thread_start_us":102799,"threads_started":1,"wal-append.queue_time_us":926516}
I20260709 12:17:19.143983 23032 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:19.137506 23252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.022s	sys 0.000s
I20260709 12:17:19.144570 23032 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:19.145109 23032 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.147858 23125 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.148424 23125 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.148857 23125 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:19.127718 23085 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.014s
I20260709 12:17:19.154733 21034 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:19.053828 23310 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.055279 23308 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.079147 23136 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:19.136718 23243 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 2.143s	user 0.009s	sys 0.007s
I20260709 12:17:19.150671 23125 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:19.159088 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 161738us
W20260709 12:17:19.156224 23126 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.053s	sys 0.071s
I20260709 12:17:19.136500 23097 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:19.163098 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 831736us
W20260709 12:17:19.154181 23085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.009s	sys 0.017s
I20260709 12:17:19.128264 23303 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.176671 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:19.150990 23285 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:19.168081 23126 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.053s	sys 0.071s
I20260709 12:17:19.171118 23125 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.188426 23085 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.193624 23322 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:17:19.199862 23266 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.206694 23324 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:19.223743 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 47130.1us
I20260709 12:17:19.208621 23220 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.202296 23125 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:19.268335 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 43958.8us
I20260709 12:17:19.217583 23268 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.222750 23032 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.221169 23326 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:19.226619 23328 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.291159 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1146) took 1173 ms. Trace:
I20260709 12:17:19.206084 23085 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.222060 23327 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:19.268290 23324 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.270458 23316 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.291517 21027 rpcz_store.cc:276] 0709 12:17:18.117489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.117599 (+   110us) service_pool.cc:224] Handling call
0709 12:17:18.117870 (+   271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:18.118202 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:18.118228 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:18.133490 (+ 15262us) log.cc:844] Serialized 52 byte log entry
0709 12:17:19.066973 (+933483us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:19.269258 (+202285us) log.cc:844] Serialized 14 byte log entry
0709 12:17:19.269456 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.269531 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:19.290954 (+ 21423us) raft_consensus.cc:1685] finished
0709 12:17:19.290973 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.291103 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6492,"raft.queue_time_us":11296,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7085,"thread_start_us":1110501,"threads_started":2,"wal-append.queue_time_us":1026482}
I20260709 12:17:19.286919 23266 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:19.287942 23329 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.285749 23139 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:19.292255 23320 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.288763 23268 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:19.293452 23312 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:17:19.340790 23279 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:19.372803 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 86243.3us
I20260709 12:17:19.289968 23304 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.377380 22714 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:19.378981 21108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 186) took 2061 ms (client timeout 1643 ms). Trace:
I20260709 12:17:19.382500 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:19.328815 23326 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.380759 23301 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:19.418529 23319 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:17:19.332125 23328 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.507225 23331 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:19.333464 23327 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.340471 23324 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.509084 23326 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:19.509452 23321 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
W20260709 12:17:19.502979 21108 rpcz_store.cc:269] 0709 12:17:17.317917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.318543 (+   626us) service_pool.cc:224] Handling call
0709 12:17:19.378728 (+2060185us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b540031c254. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:19.378896 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995065088}
W20260709 12:17:19.484824 23318 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:19.484848 23032 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.389357 23342 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:19.382362 23136 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.456867 23310 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.455268 23303 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.477528 21738 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.369529 23316 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.389638 23268 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.374053 23266 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.508860 23085 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.477675 23304 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.547565 23339 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:19.517725 23301 consensus_queue.cc:1059] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:17:19.440097 23330 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.383235 23139 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:19.537844 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.383392 23320 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.552304 23324 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.552316 23345 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.380398 23329 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:19.533666 23323 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 12:17:19.554064 23343 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.550753 21737 raft_consensus.cc:2410] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:17:19.529776 23350 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:19.562561 23083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.695s	user 0.004s	sys 0.010s
I20260709 12:17:19.505383 23285 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.574584 21185 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.581020 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.572782 21184 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.582155 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:19.627369 21105 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:19.575779 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:19.582410 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:19.548779 23328 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.547930 23341 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.549582 23342 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:19.529381 23220 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:19.611146 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:19.609413 23268 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.616997 23329 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.617306 23316 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.563438 23310 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:19.571465 23303 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.553372 23032 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:19.597213 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 323850us
I20260709 12:17:19.622977 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.579892 23351 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:19.627628 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.584620 23085 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.630295 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.609752 23324 raft_consensus.cc:3055] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:19.629513 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.632417 21108 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:19.606678 23125 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.634032 21106 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:19.529561 23331 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.606236 23325 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:19.627568 23083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.762s	user 0.004s	sys 0.010s
I20260709 12:17:19.622093 23338 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:19.587091 23304 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.611498 23357 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:19.665740 23316 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:17:19.637892 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.612350 23345 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.649854 21186 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
W20260709 12:17:19.650087 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.667747 21184 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:19.635797 23342 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.642684 23340 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.704046 21712 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:19.684229 23282 consensus_meta.cc:287] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 12:17:19.635249 23341 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.668629 23324 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:19.644116 23268 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:19.587834 23339 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.650360 23320 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.591032 23330 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.636896 23220 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.684221 23334 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.703732 21185 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.694762 23327 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.682057 23085 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.647617 23310 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.651476 23303 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.624601 23343 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.690506 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:19.716444 21183 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.629756 23350 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.704239 23355 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:19.721864 23324 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.724550 23032 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.693861 23338 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.725646 23335 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:17:19.699107 23328 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.703820 23285 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.693612 23357 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.704238 23329 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.687304 23325 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.739125 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.740643 21032 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:19.720468 23268 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.741025 23083 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:19.730576 23360 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.731571 23139 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.776929 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:19.747360 23349 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.747646 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.753423 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.753309 23315 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:19.714788 23282 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.756681 21002 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:19.748227 23322 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.741438 23266 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.672523 23351 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.727586 23340 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.763700 23331 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.766621 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.796684 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.765323 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.767716 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:19.770346 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:19.781020 21183 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:19.798236 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.787818 21031 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:19.794471 23330 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.734054 23334 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.797923 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.774655 23339 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.802023 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.798408 21027 raft_consensus.cc:2393] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:19.797992 21747 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:19.798834 21035 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:19.760043 23285 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.761701 23328 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.800443 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.774336 23083 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.802786 21032 raft_consensus.cc:2410] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:19.758263 23355 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.806244 21031 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:19.766204 23329 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.797021 23345 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.810745 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.796389 23315 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.804332 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:19.816823 21035 raft_consensus.cc:2410] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:19.805466 23330 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.823320 23356 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:19.834332 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 245393us
I20260709 12:17:19.770498 23360 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.835031 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.827715 23220 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.832072 23304 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.826503 21737 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:19.827673 23085 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.835347 21150 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:19.839859 23338 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.841105 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1236) took 2184 ms. Trace:
I20260709 12:17:19.841449 21102 rpcz_store.cc:276] 0709 12:17:17.657025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.657178 (+   153us) service_pool.cc:224] Handling call
0709 12:17:17.657503 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.135038 (+1477535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.840898 (+705860us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400252bd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:19.841049 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3299295104}
I20260709 12:17:19.832556 22712 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.826880 23330 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.801160 23322 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.843297 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.845853 21150 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:19.835207 23350 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.850519 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:19.851220 23205 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:19.840791 23341 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.856913 23357 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.860500 23355 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.852210 23304 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:19.863914 23255 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 2.526s	user 0.009s	sys 0.014s
I20260709 12:17:19.862891 23282 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.864915 23340 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.865882 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.846747 22712 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.854835 23310 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.857877 23205 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.876631 21180 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:19.861920 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:19.880033 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.883332 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.883647 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.871171 23343 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.875969 23356 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.887688 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.888978 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:19.889673 21031 raft_consensus.cc:2410] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:19.890509 21186 raft_consensus.cc:2393] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:19.895183 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:19.897073 23322 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.897202 22712 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.877766 23085 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.902763 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.871735 23365 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.885442 23328 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.880503 23083 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.892840 23343 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:19.881400 21000 connection.cc:256] RPC call timeout handler was delayed by -1.5311901259999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 12:17:19.910785 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:19.886580 23356 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.912153 23315 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.884527 23325 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.895619 23285 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.910140 23360 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.895735 23126 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:19.916026 23126 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.913172 21738 raft_consensus.cc:2410] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:19.917320 23278 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.902731 23329 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:19.878389 23205 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.918377 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 1927) took 2925 ms. Trace:
I20260709 12:17:19.919838 21036 rpcz_store.cc:276] 0709 12:17:16.993092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.993210 (+   118us) service_pool.cc:224] Handling call
0709 12:17:16.993562 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:17.009197 (+ 15635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:17.009229 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:17.012002 (+  2773us) log.cc:844] Serialized 52 byte log entry
0709 12:17:17.255705 (+243703us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:17.255745 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.262776 (+  7031us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:19.857635 (+2594859us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:19.915334 (+ 57699us) raft_consensus.cc:1685] finished
0709 12:17:19.915354 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.918317 (+  2963us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15148,"raft.queue_time_us":15856,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":9399,"spinlock_wait_cycles":15988608,"thread_start_us":210266,"threads_started":1,"wal-append.queue_time_us":281609}
I20260709 12:17:19.914216 23343 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.921751 23356 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.905169 23085 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.922919 23343 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.923779 23085 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.918795 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 207) took 1855 ms. Trace:
I20260709 12:17:19.913337 23083 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.927201 23083 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:19.928231 21181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1476) took 2700 ms (client timeout 2104 ms). Trace:
I20260709 12:17:19.917949 23126 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:19.925244 21186 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:19.931169 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:19.932368 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:19.932507 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:19.930311 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:19.925765 21179 rpcz_store.cc:276] 0709 12:17:18.063175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.063300 (+   125us) service_pool.cc:224] Handling call
0709 12:17:18.063580 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:18.087475 (+ 23895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:18.087515 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:18.087558 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:18.087601 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.918586 (+1830985us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54003fd754. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:19.918631 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.918740 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54412032}
W20260709 12:17:19.928602 21181 rpcz_store.cc:269] 0709 12:17:17.227701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.227810 (+   109us) service_pool.cc:224] Handling call
0709 12:17:19.928039 (+2700229us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540001a4d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:19.928160 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237068672}
I20260709 12:17:19.933668 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:19.912452 23365 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.928697 23342 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:19.913463 21035 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:20.400485 21000 connection.cc:256] RPC call timeout handler was delayed by -1.0010901260000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 12:17:20.305552 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.473678 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:20.286075 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:20.477005 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:20.280218 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 387150us
W20260709 12:17:19.976081 23276 log.cc:927] Time spent T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 2.486s	user 0.018s	sys 0.002s
I20260709 12:17:20.477233 23218 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.481411 23285 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:20.331934 21179 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:20.304185 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:20.327975 21151 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.700s (SENT) [suppressed 11 similar messages]
I20260709 12:17:20.303079 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.304804 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.303565 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:19.940418 23325 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:20.302320 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:19.974087 23308 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:20.495777 23208 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:19.997126 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:20.495261 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:19.931166 23083 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:20.499653 21102 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:20.504319 23102 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:19.980706 23324 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:20.505481 21108 raft_consensus.cc:2393] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:19.938526 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:19.977454 23137 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:20.491201 23351 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:20.495779 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.004575 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:20.503324 21105 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:19.973145 23349 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.487671 23285 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:20.523550 21103 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:19.953219 23280 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.939744 23330 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:20.523660 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 44605.3us
I20260709 12:17:20.004278 22892 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:20.001436 23334 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:20.000506 23309 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:19.947204 23205 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:17:20.540537 23325 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.547140 23137 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:20.548676 23137 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:19.987699 23133 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:20.550633 23133 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.551401 21737 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:20.553122 21742 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:20.554318 23218 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:20.556358 21000 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:20.557632 22679 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:20.541226 23208 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:20.559360 21036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:20.561275 23208 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:20.567227 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.558521 23218 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:20.597806 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.565893 23325 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.524758 23102 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:20.644898 23365 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:20.598001 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:17:20.645427 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 317583us
I20260709 12:17:20.652470 21036 raft_consensus.cc:606] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:20.655660 21036 raft_consensus.cc:614] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:20.636389 21002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.017s	sys 0.032s
W20260709 12:17:20.666814 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 339914us
I20260709 12:17:20.667032 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.670667 21107 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:20.669135 21104 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
W20260709 12:17:20.674688 21002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.017s	sys 0.032s
W20260709 12:17:20.681854 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.686422 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.668196 23285 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:20.685690 21106 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
W20260709 12:17:20.697315 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 139146us
I20260709 12:17:20.715519 22899 raft_consensus.cc:3055] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:20.716010 22899 raft_consensus.cc:740] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:20.720893 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.717424 22899 consensus_queue.cc:260] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:20.734314 23102 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:20.738062 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.739351 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.742393 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.745501 21106 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:20.748309 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.749128 21110 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:20.750182 21181 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:20.745401 23278 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:20.751148 23278 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:20.752081 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.752872 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.753221 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:20.753638 21110 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:20.753687 23278 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:20.750286 23285 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:20.755576 22714 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:20.755672 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:20.752411 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.755970 22714 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:20.757295 22714 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:20.758827 22714 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:20.763803 22892 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.764338 22892 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:20.767323 22892 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:20.768970 21000 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:20.769311 22892 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.771365 21107 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:20.773224 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.774024 22899 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.791718 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:20.793044 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:20.795264 23137 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.799044 22892 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:20.800341 21106 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:20.792114 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1240) took 3133 ms. Trace:
I20260709 12:17:20.801111 21109 rpcz_store.cc:276] 0709 12:17:17.658102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.659721 (+  1619us) service_pool.cc:224] Handling call
0709 12:17:17.660006 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:19.128400 (+1468394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.791665 (+1663265us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000a8054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:20.791932 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3248365824}
I20260709 12:17:20.804869 23374 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:20.814783 21034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1147) took 2696 ms (client timeout 2011 ms). Trace:
W20260709 12:17:20.815291 21034 rpcz_store.cc:269] 0709 12:17:18.117792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.121314 (+  3522us) service_pool.cc:224] Handling call
0709 12:17:20.814254 (+2692940us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001c0a54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:20.814500 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372737280}
I20260709 12:17:20.816121 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1486) took 1240 ms. Trace:
I20260709 12:17:20.816546 21182 rpcz_store.cc:276] 0709 12:17:19.575569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.576851 (+  1282us) service_pool.cc:224] Handling call
0709 12:17:19.577122 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.757702 (+180580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.757723 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:19.757750 (+    27us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:19.757771 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.815704 (+1057933us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400386b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:20.815762 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.815927 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414871424}
I20260709 12:17:20.822674 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.826982 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:20.828521 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:20.830202 21075 connection.cc:256] RPC call timeout handler was delayed by -1.0804412090001279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260709 12:17:20.830972 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:20.831355 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:20.831786 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:20.833341 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:20.834084 21747 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:20.836234 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:20.836594 20931 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:20.838258 23296 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.839128 23138 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:20.839038 23296 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:20.839800 23138 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:20.840405 23259 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:20.843822 23259 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:20.844291 23138 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:20.777992 23280 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:20.848162 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:20.848459 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.850123 21179 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:20.837847 23205 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.852097 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:20.856109 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:20.861183 21149 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:20.865486 21181 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.864643 21747 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:20.868831 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:20.863350 23259 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:20.876068 21106 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:20.878221 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:20.877087 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 1.12036e+06us
I20260709 12:17:20.874945 23342 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:20.894145 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 125358us
I20260709 12:17:20.875607 23205 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:20.898758 23347 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:20.899188 23347 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:20.900475 23205 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:20.900141 23347 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:20.895758 21740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 545) took 2732 ms (client timeout 1816 ms). Trace:
I20260709 12:17:20.907212 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.908658 21109 raft_consensus.cc:2410] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:20.908672 21181 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:20.911545 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:20.907944 21740 rpcz_store.cc:269] 0709 12:17:18.115636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.124602 (+  8966us) service_pool.cc:224] Handling call
0709 12:17:20.847976 (+2723374us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400582fd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:20.848199 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185089280}
W20260709 12:17:20.921113 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.916662 23081 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:20.920610 23347 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:20.924988 21746 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:20.927145 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.940408 21106 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:20.927608 22892 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:20.945684 23260 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:20.919090 23325 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:20.946523 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:20.944507 23279 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:20.945088 23296 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:20.947321 22693 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:20.954519 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:20.956913 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:20.956965 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:20.958362 22899 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:20.958511 21002 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:20.959350 22899 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:20.960075 23360 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.960745 21741 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:17:20.963460 21076 connection.cc:256] RPC call timeout handler was delayed by -1.2801879269998153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 12:17:20.968897 21076 connection.cc:256] RPC call timeout handler was delayed by -1.0533879269999034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260709 12:17:20.954602 23280 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:20.971135 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:20.977401 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:20.968186 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:20.977977 23360 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:20.978447 23268 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:20.977313 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1148) took 2859 ms. Trace:
W20260709 12:17:20.979164 21111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1242) took 2884 ms (client timeout 2079 ms). Trace:
I20260709 12:17:20.980855 21150 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:20.981328 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1487) took 1405 ms. Trace:
I20260709 12:17:20.985004 21185 rpcz_store.cc:276] 0709 12:17:19.575854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.669389 (+ 93535us) service_pool.cc:224] Handling call
0709 12:17:19.703222 (+ 33833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.731397 (+ 28175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.980860 (+1249463us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b5400020650. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:20.981115 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77055360}
I20260709 12:17:20.967860 22693 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:20.979261 22899 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:20.984318 21111 rpcz_store.cc:269] 0709 12:17:18.094632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.106643 (+ 12011us) service_pool.cc:224] Handling call
0709 12:17:20.978705 (+2872062us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54001374d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:20.978933 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121383296}
I20260709 12:17:20.992825 22899 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:20.993017 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:20.993568 22899 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:20.988520 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:20.991483 23360 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:20.993642 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:20.992816 21000 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:20.989889 23325 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:20.994712 23360 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:20.997807 23360 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:20.998518 23328 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:20.996587 23268 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:20.996399 23102 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:21.004032 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.005031 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1160) took 1262 ms. Trace:
I20260709 12:17:21.006603 21182 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:21.006091 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 215) took 1385 ms. Trace:
I20260709 12:17:21.006821 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1834) took 3791 ms. Trace:
I20260709 12:17:21.004158 23260 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:21.016225 23036 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.016798 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.011000 21184 rpcz_store.cc:276] 0709 12:17:19.620835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.704377 (+ 83542us) service_pool.cc:224] Handling call
0709 12:17:19.704680 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.742962 (+ 38282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.743012 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:19.743052 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:19.743083 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.005702 (+1262619us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b5400386154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:21.005753 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.005907 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87209728}
I20260709 12:17:20.999485 23328 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.009625 21027 rpcz_store.cc:276] 0709 12:17:19.742023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.804896 (+ 62873us) service_pool.cc:224] Handling call
0709 12:17:19.805087 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.819539 (+ 14452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.819558 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:19.819585 (+    27us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:19.819609 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.004606 (+1184997us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b540042e0d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:21.004673 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.004847 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32891136}
I20260709 12:17:21.019563 21179 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:21.012209 21178 rpcz_store.cc:276] 0709 12:17:17.215718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.248216 (+ 32498us) service_pool.cc:224] Handling call
0709 12:17:19.934404 (+2686188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.934560 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.934585 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:19.934624 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:19.934657 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.934709 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.006520 (+1071811us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b540001a4d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:21.006661 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6176964864}
I20260709 12:17:21.008311 23268 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.022411 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:20.994922 22899 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.007129 22693 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.023025 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.029668 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.019150 23260 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:21.023381 23360 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.033758 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.021519 23328 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.026391 23268 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.037096 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.037321 22980 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:21.038991 21111 raft_consensus.cc:1813] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Handling vote request from an unknown peer 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:21.040452 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.041563 23260 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.042994 21150 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:21.043288 23378 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:21.043892 22899 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.018224 22892 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.067253 22892 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.061354 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.036856 22959 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.068531 22959 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.068912 22959 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.072187 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1483) took 1497 ms. Trace:
I20260709 12:17:21.072556 21183 rpcz_store.cc:276] 0709 12:17:19.574624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.575562 (+   938us) service_pool.cc:224] Handling call
0709 12:17:21.071861 (+1496299us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b5400262fd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:21.072010 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203717376}
I20260709 12:17:21.073757 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.047657 23303 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:21.047669 21185 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.048110 21186 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.059512 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.067772 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.050391 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.051285 23016 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.051448 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.051791 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 211) took 1466 ms. Trace:
I20260709 12:17:21.052927 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.053984 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:21.055408 21711 connection.cc:256] RPC call timeout handler was delayed by -1.2207199889999174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260709 12:17:20.983693 21030 rpcz_store.cc:276] 0709 12:17:18.118032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.146421 (+ 28389us) service_pool.cc:224] Handling call
0709 12:17:18.146674 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:18.198702 (+ 52028us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:18.299744 (+101042us) log.cc:844] Serialized 14 byte log entry
0709 12:17:19.368209 (+1068465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:19.368261 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:19.368305 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.976792 (+1608487us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b54000c3fd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:20.976854 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.977050 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7884,"prepare.queue_time_us":125170,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":58737,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6960,"spinlock_wait_cycles":119133568,"thread_start_us":1068068,"threads_started":2,"wal-append.queue_time_us":867468,"wal-append.run_cpu_time_us":9699,"wal-append.run_wall_time_us":1476523}
I20260709 12:17:21.057632 21111 raft_consensus.cc:2410] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:17:21.034271 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.061470 21178 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:21.061280 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.074780 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.047844 23259 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:21.076285 21106 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:21.063342 20931 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:17:21.064256 23373 log.cc:927] Time spent T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.315s	user 0.004s	sys 0.000s
I20260709 12:17:21.064491 23252 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:21.065514 22804 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:21.043112 23304 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.066500 23378 raft_consensus.cc:697] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:21.076210 21177 rpcz_store.cc:276] 0709 12:17:19.585178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.680315 (+ 95137us) service_pool.cc:224] Handling call
0709 12:17:19.680606 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.806724 (+126118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.806745 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:19.806773 (+    28us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:19.806799 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.051428 (+1244629us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54003fcd54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:21.051493 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.051642 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289679104}
I20260709 12:17:21.088670 21181 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:21.095742 21181 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:21.098078 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.098671 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.100795 21184 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:21.102347 23016 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:21.103399 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 81749.8us
I20260709 12:17:21.105201 22892 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:21.097373 23304 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.106544 23303 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.107448 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.107321 23303 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.109326 23303 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:21.109714 21181 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:21.110982 23301 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:21.111398 23301 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.111769 23301 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.112720 21181 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:21.113468 23252 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:21.114405 23252 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.091899 23259 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:17:21.115090 21180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 219) took 1249 ms (client timeout 1644 ms). Trace:
I20260709 12:17:21.103003 23378 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:21.116255 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.107335 21739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 548) took 1773 ms. Trace:
I20260709 12:17:21.116130 21742 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:21.119239 21177 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:21.119563 23337 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.120050 23337 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.122115 21036 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:21.094599 21737 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
W20260709 12:17:21.116783 21180 rpcz_store.cc:269] 0709 12:17:19.865479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.865623 (+   144us) service_pool.cc:224] Handling call
0709 12:17:21.095447 (+1229824us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b540001b3d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:21.114929 (+ 19482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8900352}
I20260709 12:17:21.123536 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.126034 21711 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.127135 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:21.129329 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:21.118549 23259 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.132223 21712 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:21.142576 23337 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.147097 23102 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:21.147509 23102 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:21.147850 23102 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.148798 23016 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.152055 23325 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.152442 23325 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.152779 23325 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.105957 21149 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.105991 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:21.095960 23278 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:21.118798 21739 rpcz_store.cc:276] 0709 12:17:19.333663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.338318 (+  4655us) service_pool.cc:224] Handling call
0709 12:17:20.003173 (+664855us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b5800004598. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:17:20.003377 (+   204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:20.003789 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:20.003825 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:20.681142 (+677317us) log.cc:844] Serialized 26 byte log entry
0709 12:17:20.895497 (+214355us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:20.895553 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.896779 (+  1226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:21.092271 (+195492us) raft_consensus.cc:1685] finished
0709 12:17:21.093107 (+   836us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.106994 (+ 13887us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":358,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":12532480,"thread_start_us":158606,"threads_started":1,"wal-append.queue_time_us":210097}
W20260709 12:17:21.159780 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:21.159844 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 53994us
I20260709 12:17:21.159454 22959 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.164328 21029 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:21.163329 21034 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:21.163496 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.165140 23303 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:21.165534 23303 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.165880 23303 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.167907 23268 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.169018 21033 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:17:21.169346 21033 pending_rounds.cc:85] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 5
I20260709 12:17:21.169554 21033 pending_rounds.cc:107] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:17:21.169800 21033 raft_consensus.cc:2889] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:21.171036 21149 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.171957 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.173148 21149 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.173378 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.173928 22714 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.174364 23133 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:21.174592 22714 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.175052 22714 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:21.177235 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 75091.7us
I20260709 12:17:21.174064 21180 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:21.178746 23309 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.179122 21028 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:21.180032 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:21.180061 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.181993 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.177750 22892 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:21.182191 21149 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.182957 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.183601 21184 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:21.186334 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:21.187139 21737 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:21.192521 23304 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:21.196266 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.197464 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.198046 21107 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:21.199241 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.199993 21102 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:21.201166 23309 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.201591 23309 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:21.209820 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 83924.8us
I20260709 12:17:21.210914 23368 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.211279 22892 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:21.211879 22892 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.212301 22892 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.211328 23368 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.135663 23137 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:21.214005 23368 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.214334 23137 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.215763 23268 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:21.198670 22959 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:21.221387 21077 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:21.180428 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 63583.1us
I20260709 12:17:21.228107 21186 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:21.229444 23036 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.229840 23036 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.230154 23036 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.235112 20931 catalog_manager.cc:5697] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 3, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 3 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:21.236814 20931 catalog_manager.cc:5697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:21.238934 23133 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.239338 23133 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.239277 23303 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.239866 23133 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:21.240890 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 54582us
I20260709 12:17:21.243645 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.244292 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.247869 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:21.248562 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:21.248854 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.249503 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.251616 23102 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.252647 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:21.253901 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.266607 22804 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.256847 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.258056 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:21.261636 21185 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:21.268366 21028 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:21.272558 21034 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.254556 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.273099 21036 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:21.308413 21149 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.246655 23036 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:21.316813 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 53198.9us
I20260709 12:17:21.319417 21150 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.317754 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.320389 21028 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:21.318389 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.315562 21033 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.316323 21109 raft_consensus.cc:2393] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:21.276322 22804 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:21.325213 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 81671.3us
I20260709 12:17:21.307758 23268 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:21.326642 21149 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:21.331187 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 73212.7us
I20260709 12:17:21.338959 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.322598 23260 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:21.327629 22804 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.334298 21029 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:21.342307 21075 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.325039 23137 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.345827 21150 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:21.349265 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.351155 21711 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.375353 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.347122 23304 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:21.379524 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 115342us
I20260709 12:17:21.341374 23279 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.378789 21185 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 1.
I20260709 12:17:21.379451 21028 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:21.361779 23278 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.376142 23337 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.403470 21712 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:21.403940 21075 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.391492 23317 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.380573 23304 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:21.408800 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.444974 23304 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.445279 21028 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
I20260709 12:17:21.445631 23303 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:21.446249 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.446920 21028 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:21.447732 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.448787 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.449302 21028 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:21.450038 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.452915 21076 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.453764 23260 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:21.455178 23260 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:21.455935 23260 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:21.456296 23325 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.408869 21035 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:21.393236 23279 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.411397 20930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49666 (request call id 197) took 9067 ms. Trace:
I20260709 12:17:21.411147 23317 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.412832 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.416589 23036 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.418889 23334 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:21.419294 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.419517 23324 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.420131 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:21.420495 23384 log.cc:927] Time spent T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:21.420784 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:21.421341 23383 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:17:21.422726 23134 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:21.383580 22959 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:17:21.423229 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.419234 23102 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.424005 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.424768 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.426326 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.427146 23259 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:21.427927 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.485695 23134 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:21.429512 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.430972 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.431213 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.487855 21184 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:21.490028 23134 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:21.431838 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 92510.8us
I20260709 12:17:21.490002 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.491900 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.493296 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.494407 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.434950 23167 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.495030 23167 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.495551 23167 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.497138 23317 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:21.497661 23317 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.437333 22804 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.362385 23268 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.394430 23278 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.439276 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.408792 22899 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.456709 23090 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:21.457250 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.328723 23368 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.461710 21036 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 2.
W20260709 12:17:21.462241 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 88365.8us
I20260709 12:17:21.504161 23268 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.501020 23259 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:21.438283 22892 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.505509 23259 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.507536 22892 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.403303 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:21.508023 22804 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.508203 21737 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.508555 23090 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:21.508955 23090 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.510140 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.511195 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.512277 23368 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.513931 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.514122 23309 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:21.470469 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 66607us
I20260709 12:17:21.504799 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.473150 21031 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:21.523356 21184 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:21.481869 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.523967 21029 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:21.514225 23374 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:21.483915 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.524618 23374 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.525012 21030 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:21.525911 21711 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.526672 23137 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:21.528885 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:21.530085 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.530902 21029 raft_consensus.cc:2410] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:21.531383 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:21.531582 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.532516 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.533213 21032 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:21.534016 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.534518 21032 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:21.488632 21180 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:21.535490 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.536345 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.536551 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.536921 21180 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.537587 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.465103 20930 rpcz_store.cc:276] 0709 12:17:12.343490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.343638 (+   148us) service_pool.cc:224] Handling call
0709 12:17:12.480037 (+136399us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5400002490. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c8700b2 00007fcba57e9759 00007fcba5781a76 00007fcba5752d58 00007fcba585104e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc
0709 12:17:12.637289 (+157252us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5400002490. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fe9c 00007fcb9c8700f6 00007fcba57e9759 00007fcba5781a76 00007fcba5752d58 00007fcba585104e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc
0709 12:17:13.026579 (+389290us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400002490. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c870640 00007fcba5747846 00007fcba585190e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc 00007fcba3d11392 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:21.411188 (+8384609us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:15.682014 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:15.682523 (+   509us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:15.682556 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:17:15.682581 (+    25us) tablet.cc:662] Decoding operations
0709 12:17:15.685600 (+  3019us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:15.685676 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:15.685703 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:17:15.686812 (+  1109us) tablet.cc:701] Row locks acquired
0709 12:17:15.686832 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:17:15.687015 (+   183us) write_op.cc:270] Start()
0709 12:17:15.687130 (+   115us) write_op.cc:276] Timestamp: P: 1783599435686970 usec, L: 0
0709 12:17:15.687156 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:17:15.687771 (+   615us) log.cc:844] Serialized 5191 byte log entry
0709 12:17:16.127960 (+440189us) op_driver.cc:464] REPLICATION: finished
0709 12:17:16.551321 (+423361us) write_op.cc:301] APPLY: starting
0709 12:17:16.551403 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:16.593581 (+ 42178us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:16.646014 (+ 52433us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:16.729069 (+ 83055us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:16.729302 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:17:16.729343 (+    41us) write_op.cc:312] APPLY: finished
0709 12:17:16.729612 (+   269us) log.cc:844] Serialized 95 byte log entry
0709 12:17:16.729767 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:16.729908 (+   141us) write_op.cc:454] Released schema lock
0709 12:17:16.729955 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:16.730280 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:16.730305 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":894658,"reported_tablets":28,"spinlock_wait_cycles":174572416,"child_traces":[["op",{"apply.queue_time_us":423094,"apply.run_cpu_time_us":3546,"apply.run_wall_time_us":178943,"num_ops":13,"prepare.queue_time_us":103310,"prepare.run_cpu_time_us":16144,"prepare.run_wall_time_us":35221,"raft.queue_time_us":302816,"raft.run_cpu_time_us":18048,"raft.run_wall_time_us":331084,"replication_time_us":378147,"spinlock_wait_cycles":45824,"thread_start_us":478840,"threads_started":4,"wal-append.queue_time_us":28940,"wal-append.run_cpu_time_us":34144,"wal-append.run_wall_time_us":2041593}]]}
I20260709 12:17:21.489240 22980 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.490343 21185 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:21.495043 23036 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.423341 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.499785 21177 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:21.534425 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.469715 23279 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.489974 21186 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:21.500445 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.475539 23324 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.516000 23325 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.469067 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.517221 21109 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:21.518370 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 98334.5us
I20260709 12:17:21.551972 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:21.502017 21076 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.516911 21179 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:21.458499 23264 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:21.534869 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.525930 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.532493 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.400979 22714 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.539119 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.549649 22899 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.550323 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.550525 21110 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:21.487195 23334 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:21.500962 23278 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.560490 21107 raft_consensus.cc:2368] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6.
I20260709 12:17:21.483858 23328 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.566766 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.567619 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.568259 21179 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:21.570472 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.572889 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.574419 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.575573 21184 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:21.576476 21029 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:21.576900 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.577353 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.550360 23324 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.579917 21183 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:21.563076 23167 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.582631 22899 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.583181 23167 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:21.587117 21030 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:21.588061 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:21.589048 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.586921 23258 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:21.591337 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.592382 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.593564 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.594501 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.556836 23264 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:21.595064 21108 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.595161 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.595952 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:21.598306 21077 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:21.595610 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.595235 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.595610 23264 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.589589 21030 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:21.619768 21182 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:21.620680 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:21.562368 23296 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:21.573340 22980 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:21.631341 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:21.573565 23378 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.620393 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.630528 21029 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:21.548717 23133 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.633164 21111 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.634713 21103 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:17:21.635017 23341 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:21.635422 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.639062 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.635783 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:21.636059 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.643393 21033 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:21.636384 23167 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.636826 23365 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:21.637810 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:21.638468 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 61806.5us
I20260709 12:17:21.647660 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.635219 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:21.639384 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 137439us
I20260709 12:17:21.649075 21183 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:21.650276 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:21.639062 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:21.643705 21036 raft_consensus.cc:2393] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:21.652281 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.586429 23134 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.578651 22959 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:21.644688 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:21.647233 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.648283 21033 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
W20260709 12:17:21.639752 23388 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:17:21.645036 23360 consensus_meta.cc:287] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
I20260709 12:17:21.655292 21032 raft_consensus.cc:2368] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7.
I20260709 12:17:21.652446 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.659870 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.630190 21737 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:21.647825 22899 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.630817 22980 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:21.660470 21036 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:21.644317 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:21.656807 21183 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:21.670650 21027 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:21.658987 21178 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:21.661358 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.644420 23167 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.656139 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:21.664633 21742 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:21.675493 21743 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:21.673623 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:21.667500 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 234783us
I20260709 12:17:21.666973 21030 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:21.669924 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:21.676299 21747 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:21.688856 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:21.695886 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 208490us
I20260709 12:17:21.652901 23296 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.654359 23258 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:17:21.648129 23341 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.700707 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:21.667601 22899 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:21.674507 22980 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.701364 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.709096 21183 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:21.710319 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:21.675757 23264 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.703034 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.709024 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.678093 21741 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:21.694304 23301 consensus_meta.cc:287] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 12:17:21.712045 21106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:21.731139 21106 raft_consensus.cc:606] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.673780 23317 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.714460 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.678270 23167 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:21.718537 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 98914.3us
I20260709 12:17:21.719954 21180 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:21.718276 21740 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:21.673671 23365 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.724462 21185 raft_consensus.cc:1240] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:21.716140 22899 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.669839 23259 consensus_queue.cc:1059] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:17:21.732031 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.733443 21184 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.735364 21712 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:21.736443 21177 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:21.737216 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:17:21.725703 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 70813.1us
I20260709 12:17:21.678241 23090 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.721067 23360 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:21.745481 21075 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.741794 20999 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.748011 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:21.747776 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 87645.5us
I20260709 12:17:21.751588 21027 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:21.750129 21076 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:21.757123 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55806.3us
W20260709 12:17:21.758574 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 60001us
I20260709 12:17:21.755637 21002 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:21.761296 21149 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.749972 23280 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:21.762248 21151 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.750569 23360 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:21.734462 23301 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.775274 21149 leader_election.cc:400] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6.
I20260709 12:17:21.781651 21149 leader_election.cc:403] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:21.698333 23334 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.789278 21108 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:21.778443 21709 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.779887 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:21.785144 22323 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:21.785995 23396 log.cc:927] Time spent T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:17:21.791466 22323 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.808776 22323 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:21.791625 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 49906.7us
I20260709 12:17:21.786931 23016 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.762621 23102 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.762368 23258 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.757031 23325 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:21.794168 21111 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:21.812031 21740 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:21.812784 20999 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.790699 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:21.776634 23404 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:21.817376 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55201.9us
W20260709 12:17:21.818651 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54962.5us
I20260709 12:17:21.780884 23360 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.776765 23205 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:21.819291 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 84003.1us
I20260709 12:17:21.768502 23303 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:21.790330 23259 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:21.822365 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 72320.7us
I20260709 12:17:21.823199 21179 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:21.815425 23378 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:21.809916 23386 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:17:21.826507 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.843436 23084 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:21.845947 21709 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.841281 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.848104 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.848493 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.809149 23408 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:21.789844 22804 consensus_queue.cc:1059] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:17:21.823310 21034 consensus_meta.cc:287] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.000s
I20260709 12:17:21.839514 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.855028 21034 raft_consensus.cc:2410] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:21.855475 22980 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.835258 23259 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.857445 23259 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.857623 22980 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.853197 23102 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.840829 21108 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:21.841205 21027 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:21.819727 23280 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.862455 23280 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.862866 23280 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.820729 23258 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.863198 23409 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:21.863581 23409 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:21.864286 23301 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:21.864604 23258 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.852123 23134 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.865566 23365 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.865890 23090 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.866729 21034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:21.867344 21034 raft_consensus.cc:606] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:21.867938 21151 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.829277 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:21.869226 21110 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:21.850221 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:21.869603 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:21.825738 23133 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:21.822711 23205 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:21.846768 23337 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:21.821274 23403 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6.
I20260709 12:17:21.819340 23404 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:21.822889 23325 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:17:21.853145 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 108537us
I20260709 12:17:21.883409 22980 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:21.883661 22892 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:21.849612 23378 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:21.884924 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 75100.8us
I20260709 12:17:21.885741 21709 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:21.943975 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 104503us
I20260709 12:17:21.944568 21102 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:21.885109 23401 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:17:21.925725 23090 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:21.881508 23412 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:21.986378 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 208099us
I20260709 12:17:21.884647 23301 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:21.988282 21076 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:21.882858 23304 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:21.945438 23404 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.948807 22980 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:21.993564 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:21.994019 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 47796.1us
I20260709 12:17:21.934216 23303 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:17:21.992848 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.997442 21002 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:21.999202 21002 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:21.973199 23337 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:21.885277 23411 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:21.998479 22980 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:21.945639 23016 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.000005 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:22.004380 23036 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.005060 23374 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:22.043563 23414 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:17:22.044503 23429 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:22.044943 23429 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.045248 23429 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:22.001127 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aaaf493e892d4ee9839b45b601fc8400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:17:22.048012 20920 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 225160us
I20260709 12:17:22.049739 23328 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.038995 22323 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:21.864389 23409 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.052251 23309 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.052776 23409 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.054209 21184 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:22.054291 23341 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:22.011437 23400 log.cc:927] Time spent T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:17:22.013298 21741 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:21.988094 23090 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:21.997551 23167 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:22.063408 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 72474.2us
I20260709 12:17:22.064201 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:22.064556 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:22.028070 21077 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:22.011469 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:21.999083 23296 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.051290 23337 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.007316 23303 raft_consensus.cc:3055] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:22.055959 21033 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:22.014802 23398 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.064924 23167 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:21.996513 23410 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 12:17:22.063328 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:22.069968 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.020231 23397 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:22.101104 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 101067us
I20260709 12:17:22.001825 23334 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.158169 22323 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:22.141441 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 255701us
W20260709 12:17:22.162570 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 293015us
W20260709 12:17:22.165131 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 57867.8us
I20260709 12:17:21.989950 23205 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.154120 23368 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.153808 22980 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.171062 23365 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.156397 23374 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:22.037739 23423 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:22.171900 23324 consensus_meta.cc:287] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 12:17:22.196765 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:22.156584 23304 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.151036 23252 consensus_queue.cc:1059] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:17:22.223691 23415 raft_consensus.cc:3055] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:22.224071 23415 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:22.224884 23415 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.226101 23415 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.229213 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:22.230126 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:22.231853 23398 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.232329 23398 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.232628 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.236266 23324 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.237442 21181 raft_consensus.cc:2368] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:22.206712 23417 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:22.229528 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.241273 21102 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:22.232339 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.243149 21104 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:22.023554 23325 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.143464 23408 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.256407 21104 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:22.156513 23303 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:22.198525 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 134033us
I20260709 12:17:22.165190 21000 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:22.199728 22323 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:22.202252 23279 consensus_meta.cc:287] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.001s
I20260709 12:17:22.271783 23279 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.275112 23365 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:22.275295 22323 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:22.275648 22323 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.275688 23365 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.276477 22323 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.276649 23365 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.277717 22323 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.202615 23268 consensus_queue.cc:1059] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:22.268582 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 103472us
I20260709 12:17:22.204234 23429 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.151755 23280 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.206758 23264 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:22.063382 23090 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:22.206367 23404 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.208060 23427 consensus_queue.cc:1059] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:22.206666 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 211045us
W20260709 12:17:22.211695 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 200274us
I20260709 12:17:22.169390 23397 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.149251 23259 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.215837 22714 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.170271 23334 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.212958 23374 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.171308 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:22.222324 21151 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.268992 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:22.281744 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.068589 23278 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.279428 22980 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:22.335788 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 164662us
I20260709 12:17:22.225346 22899 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:22.340617 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 118538us
I20260709 12:17:22.322191 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.275211 23205 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.328853 21181 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:22.329087 21104 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:22.295153 21033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
W20260709 12:17:22.337466 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 68609us
I20260709 12:17:22.338433 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.229226 23430 consensus_queue.cc:1059] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:17:22.286387 23301 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:17:22.353363 21033 raft_consensus.cc:606] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:22.355240 21033 raft_consensus.cc:614] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:22.319995 23397 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.358585 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:22.359157 21743 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.337874 22323 consensus_queue.cc:1059] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:17:22.354352 21151 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.357112 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:22.332310 23374 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:22.320530 23279 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.408169 23404 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.609907 23411 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:22.610366 23411 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.610720 23411 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:22.616012 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 258970us
W20260709 12:17:22.616144 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 261835us
I20260709 12:17:22.463934 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:22.431584 23422 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:17:22.423172 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.524055 23280 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.423722 23268 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.622375 23441 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:22.622749 21110 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:22.412978 21737 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:22.623423 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.624277 21102 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:22.624538 23439 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:22.624938 23439 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.625064 22980 consensus_queue.cc:1059] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:22.625712 23439 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.626783 23280 consensus_queue.cc:1059] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:22.627770 23280 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:22.628062 23280 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:22.628885 23280 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.629971 23280 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:22.631845 23443 raft_consensus.cc:3055] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:22.632222 23443 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.632977 23443 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.634281 23443 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:22.636204 23438 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:17:22.410194 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 113970us
I20260709 12:17:22.481637 21743 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:22.391430 23296 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:22.431522 23432 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:17:22.335108 23264 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:22.332132 23334 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.321012 23378 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.522578 21181 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:22.455752 23278 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.664857 21712 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.456092 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:22.392606 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 70510us
I20260709 12:17:22.453366 23258 raft_consensus.cc:3055] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:22.395063 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.460036 23429 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.394546 23431 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:22.357606 23324 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.456875 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:22.667766 23258 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:22.670616 21747 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.453871 23102 raft_consensus.cc:3055] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:22.423875 23016 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.350975 23433 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:22.553949 23303 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.341320 21738 raft_consensus.cc:1240] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:22.683027 21030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:22.683573 21030 raft_consensus.cc:606] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:22.405634 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.459352 22714 raft_consensus.cc:3055] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:22.464349 22899 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:22.528964 21742 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:22.452359 23259 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:22.400432 23360 consensus_meta.cc:287] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.006s
I20260709 12:17:22.263399 23423 consensus_queue.cc:1059] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:17:22.622856 23441 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.686033 22714 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:22.696241 23441 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.696851 22714 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.697779 22714 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.698827 23360 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.701223 23423 raft_consensus.cc:3055] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:22.701578 23423 raft_consensus.cc:740] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:22.421231 23426 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:17:22.420255 23419 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.645320 23374 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.639653 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.648289 21108 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:22.650336 23398 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.637882 23439 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.639073 21002 leader_election.cc:400] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:22.712309 21002 leader_election.cc:403] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:22.657948 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.637099 23411 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.663244 21102 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:22.689695 23090 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.669189 21184 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:22.669566 21103 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:22.667007 23134 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:22.675976 20999 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:22.671155 23258 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:22.567193 23435 log.cc:927] Time spent T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
W20260709 12:17:22.718293 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 101490us
I20260709 12:17:22.672623 23378 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.670895 21741 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.719573 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:22.681408 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:22.680128 23102 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.684463 23016 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.711018 23360 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:22.687299 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:22.687587 21738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 348) took 1130 ms. Trace:
I20260709 12:17:22.688885 23303 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.690919 21150 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.702358 23423 consensus_queue.cc:260] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.707167 21740 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:22.710873 21747 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
W20260709 12:17:22.710896 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 71320.2us
I20260709 12:17:22.742201 21151 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.680342 23431 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.746577 23431 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:22.745906 23423 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.666618 21744 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:22.703099 23324 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.718497 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:22.680620 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:22.752444 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.752271 23324 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.754333 23324 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.689831 23397 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.718366 23134 raft_consensus.cc:697] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:22.757324 23134 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.686836 23433 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:22.726714 23102 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.759877 23102 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.745183 23411 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.763557 23365 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.737293 22899 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.763738 21149 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:22.729966 23398 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:22.713231 23419 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.765858 23411 raft_consensus.cc:2764] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:17:22.767422 23419 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.730675 23258 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:22.767699 23415 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:22.768215 23415 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.769040 23431 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.771317 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.772619 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:22.772868 23431 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.759559 23433 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.776862 23415 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.773375 23397 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:22.779942 23090 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:22.737720 21738 rpcz_store.cc:276] 0709 12:17:21.557450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.558921 (+  1471us) service_pool.cc:224] Handling call
0709 12:17:22.214188 (+655267us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b5800004598. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86feee 000000000036eb39 00007fcba48e31e0 00007fcba49ac0c4 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:17:22.214342 (+   154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:22.683038 (+468696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.687332 (+  4294us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54004bc654. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:22.687516 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267925248}
I20260709 12:17:22.773289 21106 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:22.783175 21149 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:22.733037 21741 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:22.783916 23431 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:22.784385 23431 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.784729 23431 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:22.773298 23365 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.788004 23365 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.736002 22323 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:22.791426 22323 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:22.682555 23264 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.791831 22323 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:22.737951 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 62053.6us
W20260709 12:17:22.739462 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 48645.9us
I20260709 12:17:22.743511 23360 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.743359 23418 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:22.744273 23374 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:22.744382 23427 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.745010 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:22.745132 23442 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:22.745532 21151 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.739835 23420 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:22.746027 23278 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.713063 23296 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:22.794637 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.820745 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:22.821324 21179 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.822029 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:22.772619 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.800853 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:22.805544 22323 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.824188 21741 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:22.816059 21075 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:22.770303 23016 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.822562 21150 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:22.827625 21183 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:22.828146 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:22.828545 22323 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:22.742652 23205 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:22.832301 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:22.833019 21740 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:22.835917 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:22.836798 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:22.837301 21182 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.836470 21181 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
W20260709 12:17:22.838999 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 93523.7us
I20260709 12:17:22.839419 21186 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:22.839663 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.839767 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:22.840413 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:22.840337 21177 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.833671 23420 raft_consensus.cc:697] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.842542 21180 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:22.837734 23411 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:22.843070 23420 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.847069 21185 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.848121 23016 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:22.849116 22323 raft_consensus.cc:993] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:17:22.849529 22323 raft_consensus.cc:1081] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:17:22.850950 23442 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.852030 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:22.853060 23442 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.853806 22899 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:22.840507 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:22.857358 21178 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.859510 21179 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:22.860440 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:22.864472 21182 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:22.865332 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:22.880231 21151 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:22.865840 21000 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:22.860288 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:22.881280 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.831606 23415 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:22.872807 21185 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:22.838637 23280 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.879215 21108 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:22.879201 21181 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:22.877508 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:22.841307 23205 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:22.889914 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:22.901019 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:22.875293 23411 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:22.827275 23090 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:17:22.902323 23411 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.903124 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:22.904070 21180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:17:22.904430 23415 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:22.827353 23360 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.905835 20999 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.905871 21002 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:22.907505 21180 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:22.875097 23404 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:22.912863 21743 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:22.831357 23378 consensus_queue.cc:1059] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:17:22.910704 21180 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.919945 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:22.921953 21151 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.847000 23431 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.921454 23404 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.888978 23397 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:22.888819 23365 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:22.905159 23280 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.931476 22323 consensus_queue.cc:1059] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:22.838752 23441 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.888492 23279 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:22.932260 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:22.933387 23378 consensus_queue.cc:1243] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer a1b891e53adc40a6a1ae813238321e93 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:22.933786 23325 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:22.840821 23427 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:22.932744 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 105191us
I20260709 12:17:22.939143 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:22.918949 22899 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:22.912472 23374 consensus_queue.cc:1059] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:17:22.956768 22899 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.957274 23374 raft_consensus.cc:3055] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:22.957639 22899 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.959985 23431 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:22.921708 23268 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:22.934171 23442 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:22.960856 23268 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.961731 23268 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:22.965375 21178 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:22.927170 23324 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.962803 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:22.969658 21108 raft_consensus.cc:3055] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:22.956106 21180 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.972007 21103 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:22.931058 23404 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.972687 21108 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:22.934211 23397 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.935698 23439 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:22.974468 22323 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:22.975298 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:22.938084 23304 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.979264 21180 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:22.937644 23280 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.936017 23365 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.954952 23279 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:22.977742 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.957643 23374 raft_consensus.cc:740] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.984515 21108 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:22.988204 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:22.971686 23324 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:22.995411 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:22.995689 23279 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:22.997040 23452 log.cc:927] Time spent T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:17:22.983875 23397 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:22.983706 23398 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:23.038452 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aaaf493e892d4ee9839b45b601fc8400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:23.007339 21744 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.007779 22323 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:23.034906 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 46745.8us
I20260709 12:17:23.001698 21108 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:23.037388 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 55250.9us
I20260709 12:17:23.040660 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.041783 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.044165 22323 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:23.045428 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:23.034363 23444 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 12:17:23.000006 23365 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.033919 23324 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.999871 23423 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:23.054718 23102 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.055884 22323 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:23.059628 23449 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:17:23.059906 23334 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.057060 23303 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:22.994428 23415 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.057020 23398 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:22.999600 23439 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:23.064857 21108 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:17:23.082427 21108 pending_rounds.cc:85] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 7
I20260709 12:17:23.070082 21151 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.044812 23378 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:23.047516 23420 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:23.077731 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 97224.8us
I20260709 12:17:23.080439 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.079929 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.082721 21108 pending_rounds.cc:107] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:17:23.083456 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.086725 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.069336 23360 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:23.090104 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.091830 21108 raft_consensus.cc:2889] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:23.092211 21107 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.090198 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.092428 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.089936 21711 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.096832 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.097748 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.097841 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.098547 21110 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:23.099416 23259 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:23.099924 23259 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.099339 23398 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.101802 23259 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:23.101878 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.099269 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.098830 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.011075 23205 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.109215 21711 leader_election.cc:400] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7.
I20260709 12:17:23.109565 21711 leader_election.cc:403] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:23.109349 21107 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:23.110926 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:23.111289 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.111768 23016 raft_consensus.cc:3055] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:23.112133 23016 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:23.102804 23368 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:17:23.114863 23137 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7.
I20260709 12:17:23.115281 23303 raft_consensus.cc:2764] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:17:23.116063 23427 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:23.117154 21151 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.117944 23303 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:23.118314 23303 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.118618 23303 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.120391 23279 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.121428 21180 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:23.095561 23378 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.122643 21111 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:23.123899 23378 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:23.124783 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.126794 23279 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:23.127264 23412 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.128525 23334 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:23.138762 21177 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:23.131907 21103 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:23.140301 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.141139 21149 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:23.108799 23411 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.131223 23412 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.109325 23360 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:23.087628 23404 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:23.132385 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.128453 23303 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.135907 23325 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.175426 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:23.179145 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.145279 23279 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:23.178544 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.178573 21029 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:23.144671 23443 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:23.106016 23439 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.188711 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.131969 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.189419 21029 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.190088 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.191366 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.189464 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:23.192678 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.193151 21177 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:23.195768 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.196035 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.196857 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.198292 21034 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:23.093183 23374 consensus_queue.cc:260] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.183063 23334 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.207451 21181 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:23.204411 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.208251 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:23.210215 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:23.183316 23427 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:23.214329 21741 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:23.215564 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:23.217666 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 85749.8us
I20260709 12:17:23.195868 23304 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.216377 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:23.218683 21028 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:23.199857 23441 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:23.226043 21181 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:23.221323 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:23.232929 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.234477 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.202596 23279 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:23.237146 21036 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:23.240648 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.247694 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.246781 21034 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:23.215705 23378 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:23.251210 23378 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.251560 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.253367 23378 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:23.254951 23455 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:17:23.200361 23360 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.201836 23443 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.231281 23258 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:23.231531 22714 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.216979 23334 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.262784 23258 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:23.259963 23458 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 12:17:23.275405 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.236413 23304 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.260977 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:23.247356 23412 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:23.269970 21034 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:23.270809 23258 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.271407 23404 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:23.219583 23427 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.308408 23427 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:23.309074 23264 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.310781 23360 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:23.314395 23334 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:23.301649 21032 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.304090 23467 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:23.304601 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.305543 21186 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:23.305361 23412 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:23.306298 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45413.1us
I20260709 12:17:23.320294 21180 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:23.321215 21108 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:23.323575 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.323280 21029 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:23.328869 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.320456 21186 pending_rounds.cc:85] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 1
I20260709 12:17:23.329092 23412 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:23.329164 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:23.320570 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.314812 21035 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:23.321544 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.322309 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.254501 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.322952 21185 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:23.314999 21031 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:23.328781 23404 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:23.317746 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.685272 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.438289 21032 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:23.690798 21034 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:23.680823 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:23.691107 21030 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:23.519075 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:23.693562 21028 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:23.679527 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.330729 21744 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
W20260709 12:17:23.693763 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 439281us
I20260709 12:17:23.694527 21740 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:23.412266 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:23.696683 21181 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:23.642014 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.418834 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:23.414172 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:23.698940 21036 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
W20260709 12:17:23.682042 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 119052us
I20260709 12:17:23.329483 21186 pending_rounds.cc:107] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:23.700517 21186 raft_consensus.cc:2889] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:23.450780 21743 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:23.376065 21182 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:23.446481 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.704192 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:23.666447 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.705330 21184 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:23.410275 23016 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:23.600952 23280 consensus_meta.cc:287] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.004s
I20260709 12:17:23.706290 23280 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.707372 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.708093 23374 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.564320 23360 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:23.260232 23468 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:23.450970 23090 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.709414 23468 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:23.709523 23090 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.710320 23468 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.712389 21179 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:23.714253 21030 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:23.381568 21178 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:23.714623 21150 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:23.451213 23325 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.435756 23264 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:23.456842 23463 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:17:23.715585 23439 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:23.716063 23090 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:23.716528 23325 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.721956 23325 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:23.415848 23443 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:23.519325 23429 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:17:23.317453 23304 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:23.716658 23264 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.398378 23334 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.725915 23264 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:23.708881 23360 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.331439 23279 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.727847 23404 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:17:23.403700 23461 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 12:17:23.728209 23404 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:23.723203 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:23.729070 23404 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.729804 21034 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:23.730190 23404 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:23.730275 23397 consensus_meta.cc:287] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.680s	user 0.000s	sys 0.009s
I20260709 12:17:23.317106 23303 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:23.731148 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.730774 23397 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.730723 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.732039 21034 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:23.628408 23450 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.005s	sys 0.008s
W20260709 12:17:23.732601 23450 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.005s	sys 0.010s
I20260709 12:17:23.318171 23467 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.734016 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:23.734723 21183 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:23.729823 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:23.735508 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.735702 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:23.735862 21035 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:23.734894 21110 raft_consensus.cc:2368] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6.
I20260709 12:17:23.736399 21183 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:23.737116 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:23.737427 21744 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:23.405944 23258 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.725487 23334 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.740762 23258 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:23.742605 23258 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.733017 21002 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:23.748135 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:23.700184 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:23.749495 21034 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:23.752581 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:23.743999 23443 consensus_queue.cc:1059] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:23.744798 23472 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:17:23.699237 21029 raft_consensus.cc:2393] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:23.745848 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:23.743126 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.749675 21183 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.757629 21186 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:23.751222 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 59224us
I20260709 12:17:23.752750 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.743099 23258 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.747706 21002 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:23.759286 23427 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:17:23.755527 23442 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:23.772426 23442 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:23.772524 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:23.772840 23442 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.773680 23334 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:23.775064 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 60505.5us
I20260709 12:17:23.775426 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:23.775648 23205 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:23.776120 23205 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:23.777200 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.777894 21179 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:23.778577 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.779395 21179 raft_consensus.cc:2368] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7.
I20260709 12:17:23.780290 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:23.754895 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54766.7us
I20260709 12:17:23.763414 21034 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.782132 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.782996 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.759196 23419 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:23.776940 23205 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.801162 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.801009 21742 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:23.801868 21111 raft_consensus.cc:2368] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7.
I20260709 12:17:23.781451 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:23.760838 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:23.782662 21029 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:23.805827 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.808432 23412 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:23.809013 23412 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:23.810062 23469 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:23.810655 21149 leader_election.cc:400] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6.
I20260709 12:17:23.811018 21149 leader_election.cc:403] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:23.780923 23258 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:23.812743 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 65101.4us
I20260709 12:17:23.813009 23470 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:23.813961 23423 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:23.814318 23470 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.799475 23419 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.800153 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.799755 23420 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:23.800223 23134 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:17:23.808557 21102 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:23.814502 23423 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:23.809892 23412 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.819427 23470 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:23.819783 23470 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:23.820602 23423 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.821081 23420 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.809191 21747 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:23.820767 23470 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.819725 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.827565 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:23.792263 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 44210.8us
I20260709 12:17:23.832486 21151 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.783665 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.845772 23470 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.813864 21076 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:23.820592 23134 raft_consensus.cc:3055] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:23.847682 23134 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:23.845814 23439 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:23.848567 23134 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:23.849617 23439 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.850517 21111 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:23.853194 23304 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:23.853724 23304 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.855062 23303 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:23.759871 23264 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:23.859555 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45754.9us
I20260709 12:17:23.860327 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.860994 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:23.862376 23415 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.863065 23415 consensus_queue.cc:1243] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:23.863304 23264 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:23.860904 23090 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:23.863493 23415 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:23.864600 23415 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:23.865126 23102 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.865628 23102 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.863865 23264 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:23.868763 21110 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:23.865382 23415 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.870376 21738 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:23.873744 21179 raft_consensus.cc:2393] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:23.874576 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.897794 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.898540 21179 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:23.899569 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.900338 21179 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:23.896816 21036 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:23.902540 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.404819 23324 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:23.751057 23259 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 12:17:23.921738 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:23.862007 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.921660 23431 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:23.922956 21031 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:23.913213 21002 leader_election.cc:400] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7.
I20260709 12:17:23.588742 23365 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:23.917008 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 84602us
I20260709 12:17:23.926934 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.938066 21034 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:23.764297 21177 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:23.941689 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:23.919204 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:23.895288 23303 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:17:23.926050 21111 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:23.949038 21186 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:23.965337 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:23.968771 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:23.946561 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 116017us
W20260709 12:17:24.009805 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 159657us
I20260709 12:17:23.940419 21029 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:23.922437 21179 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.942358 21177 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:23.943400 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.916916 23469 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:24.014968 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.943612 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.945130 21743 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:23.924839 21002 leader_election.cc:403] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:24.026957 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 113886us
I20260709 12:17:24.027575 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:23.897425 23134 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:23.910921 23415 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.027413 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:23.868678 23264 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.122370 21184 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:23.897724 23475 consensus_queue.cc:1059] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 12:17:24.032204 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.077284 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.062033 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.076838 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:23.947018 23443 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.126699 21179 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:24.132550 21179 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:24.133711 21179 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:24.083380 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.129015 21109 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:24.129580 21034 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:24.136003 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.136663 21034 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:24.137621 21177 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:24.033130 23431 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.139895 21179 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.137490 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.075945 23427 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7.
I20260709 12:17:24.025883 23090 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:24.164654 21177 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.160120 21184 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:17:24.161430 21034 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:24.166433 21184 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.166613 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.162451 21179 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:24.167474 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.168429 21034 raft_consensus.cc:2368] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3.
I20260709 12:17:24.172634 21029 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:24.174413 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.175344 21034 raft_consensus.cc:2410] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:24.177327 21182 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:24.135571 23296 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:24.181900 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.182771 21034 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:24.184386 21184 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.145309 23420 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.188052 21179 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:24.164084 23258 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.195935 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.198325 21034 raft_consensus.cc:2376] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6. Re-sending same reply.
I20260709 12:17:24.199187 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.200165 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.200718 21034 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:24.201634 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.202255 21034 raft_consensus.cc:2368] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:17:24.202946 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.204054 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.204653 21034 raft_consensus.cc:2368] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5.
I20260709 12:17:24.205480 21034 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.206028 21177 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:24.208482 21177 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.205994 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2008) took 1024 ms. Trace:
I20260709 12:17:24.132897 23469 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.172115 23102 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.160606 23443 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.236243 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:24.212409 23324 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:24.215054 23090 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.215939 23304 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:24.238933 21035 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:24.222348 21185 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:24.209980 23258 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.179245 23419 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.225790 21184 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:24.234768 21177 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:24.220940 21183 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:24.209322 21034 rpcz_store.cc:276] 0709 12:17:23.181043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.205116 (+1024073us) service_pool.cc:224] Handling call
0709 12:17:24.205345 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.205778 (+   433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.205923 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.246151 21183 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:24.251989 21036 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:24.248396 23278 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6.
W20260709 12:17:24.258982 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 68765.8us
I20260709 12:17:24.261027 23258 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:24.249971 23439 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.263082 23467 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.267762 21179 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.269757 21031 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:24.272904 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1212) took 1004 ms. Trace:
W20260709 12:17:24.306989 21028 consensus_meta.cc:287] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.002s
I20260709 12:17:24.307498 21028 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:24.308012 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1199) took 1078 ms. Trace:
I20260709 12:17:24.273274 21031 rpcz_store.cc:276] 0709 12:17:23.268383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.861779 (+593396us) service_pool.cc:224] Handling call
0709 12:17:24.272846 (+411067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.309612 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.310313 21031 raft_consensus.cc:2368] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:17:24.308303 21028 rpcz_store.cc:276] 0709 12:17:23.229632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.742904 (+513272us) service_pool.cc:224] Handling call
0709 12:17:24.307949 (+565045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.252106 23325 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:17:24.321307 23365 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.324821 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.327217 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2012) took 1136 ms. Trace:
I20260709 12:17:24.327639 21028 rpcz_store.cc:276] 0709 12:17:23.181702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.317130 (+1135428us) service_pool.cc:224] Handling call
0709 12:17:24.317438 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.317631 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.317656 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.317698 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:24.317736 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.317787 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.317890 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.337569 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2013) took 1138 ms. Trace:
I20260709 12:17:24.339020 21031 rpcz_store.cc:276] 0709 12:17:23.199476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.325824 (+1126348us) service_pool.cc:224] Handling call
0709 12:17:24.336879 (+ 11055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.337059 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.337085 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.337313 (+   228us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:24.337353 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.337408 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.337513 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:24.338672 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:24.340608 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:24.341105 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:24.341950 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 413089us
W20260709 12:17:24.335317 23481 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:17:24.334529 23486 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:24.347580 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 320217us
I20260709 12:17:24.347311 21031 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:24.350490 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1192) took 1123 ms. Trace:
I20260709 12:17:24.350878 21031 rpcz_store.cc:276] 0709 12:17:23.227294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.339852 (+1112558us) service_pool.cc:224] Handling call
0709 12:17:24.347140 (+  7288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.350229 (+  3089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.350429 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:24.350749 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.335119 23487 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:24.347286 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 381984us
I20260709 12:17:24.345541 23470 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.335309 23494 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:24.356416 21031 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.357115 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1193) took 1129 ms. Trace:
I20260709 12:17:24.357432 21031 rpcz_store.cc:276] 0709 12:17:23.228060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.351700 (+1123640us) service_pool.cc:224] Handling call
0709 12:17:24.356261 (+  4561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.356811 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.357061 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.361095 21747 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:24.360455 23494 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:24.375250 23494 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.374775 23498 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:17:24.374424 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 227) took 1144 ms. Trace:
I20260709 12:17:24.377780 21033 rpcz_store.cc:276] 0709 12:17:23.229914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.360588 (+1130674us) service_pool.cc:224] Handling call
0709 12:17:24.360842 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.360999 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.361021 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.374169 (+ 13148us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:24.374211 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.374275 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.374370 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:24.378425 23442 consensus_meta.cc:287] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.605s	user 0.013s	sys 0.000s
I20260709 12:17:24.379061 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.379758 21033 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:24.383523 23482 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:17:24.378831 23442 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.385897 21028 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:24.386709 23489 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:24.346678 23325 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:24.389147 23325 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:24.389496 23325 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:24.389644 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 1883) took 1066 ms. Trace:
I20260709 12:17:24.390316 23469 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:24.391501 21034 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:24.392146 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 228) took 1162 ms. Trace:
I20260709 12:17:24.392457 21034 rpcz_store.cc:276] 0709 12:17:23.230175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.391036 (+1160861us) service_pool.cc:224] Handling call
0709 12:17:24.391334 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.391892 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.392060 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.392966 23325 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.393918 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 229) took 1163 ms. Trace:
I20260709 12:17:24.394141 23325 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.392320 20999 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.397888 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.398651 23487 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.399387 23398 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.390048 21185 rpcz_store.cc:276] 0709 12:17:23.323244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.735288 (+412044us) service_pool.cc:224] Handling call
0709 12:17:24.389463 (+654175us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b540001c7d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:24.389582 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118241664}
I20260709 12:17:24.394141 23469 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.401467 23469 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.403666 21034 rpcz_store.cc:276] 0709 12:17:23.230399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.393193 (+1162794us) service_pool.cc:224] Handling call
0709 12:17:24.393458 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.393634 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.393658 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.393695 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:24.393727 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.393779 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.393869 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.405292 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 230) took 1174 ms. Trace:
I20260709 12:17:24.354260 23486 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.406740 23469 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:24.405620 21034 rpcz_store.cc:276] 0709 12:17:23.230652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.404545 (+1173893us) service_pool.cc:224] Handling call
0709 12:17:24.404797 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.404977 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.405003 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.405045 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:24.405087 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.405141 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.405244 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.408527 21034 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:24.410682 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:24.411026 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.411576 21111 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:24.410808 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.412900 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.406066 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:24.413260 21149 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:24.413470 21102 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:24.413260 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2014) took 1202 ms. Trace:
I20260709 12:17:24.411572 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1205) took 1178 ms. Trace:
I20260709 12:17:24.414168 20999 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.414711 23102 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.414252 21028 rpcz_store.cc:276] 0709 12:17:23.211132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.335769 (+1124637us) service_pool.cc:224] Handling call
0709 12:17:24.336059 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.386259 (+ 50200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.413037 (+ 26778us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b54000811d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:24.413185 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102890368}
I20260709 12:17:24.415388 23102 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:24.415839 23102 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.416977 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59982 (request call id 79) took 1020 ms. Trace:
I20260709 12:17:24.417337 21028 rpcz_store.cc:276] 0709 12:17:23.396988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.415868 (+1018880us) service_pool.cc:224] Handling call
0709 12:17:24.416898 (+  1030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.418551 23134 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:24.416743 23296 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:24.422345 23429 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:24.414747 21034 rpcz_store.cc:276] 0709 12:17:23.233586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.408098 (+1174512us) service_pool.cc:224] Handling call
0709 12:17:24.408378 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.411327 (+  2949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.411503 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.417430 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1206) took 1183 ms. Trace:
I20260709 12:17:24.424170 21031 rpcz_store.cc:276] 0709 12:17:23.233822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.414372 (+1180550us) service_pool.cc:224] Handling call
0709 12:17:24.414665 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.415893 (+  1228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.415921 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.415960 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:24.415993 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.416042 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.417375 (+  1333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.361621 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:24.422618 23296 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.414861 23397 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:24.422150 20999 leader_election.cc:400] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7.
I20260709 12:17:24.421733 21149 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:24.431324 23469 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.432773 21709 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:24.447224 21031 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:24.440810 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:24.449203 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:24.451057 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 96069.7us
I20260709 12:17:24.451099 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:24.449824 21179 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:24.448982 21076 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:24.452459 21177 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:24.453881 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:24.454856 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.451382 21151 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.454708 23278 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.430410 23296 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.455551 21076 leader_election.cc:400] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3.
I20260709 12:17:24.467969 21076 leader_election.cc:403] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:24.457834 21111 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.458666 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:24.459481 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:24.470880 21184 raft_consensus.cc:2393] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:24.431716 23469 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.460088 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.480487 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.455371 23505 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:24.358412 23470 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.461824 21109 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:24.495877 21109 pending_rounds.cc:85] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 2
I20260709 12:17:24.496085 21109 pending_rounds.cc:107] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:24.496306 21109 raft_consensus.cc:2889] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:24.462044 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.482239 21151 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.474805 21104 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:24.498733 21104 pending_rounds.cc:85] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 3
I20260709 12:17:24.499023 21104 pending_rounds.cc:107] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:24.499251 21104 raft_consensus.cc:2889] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:24.464434 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.474375 21103 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:24.500589 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:24.459033 23137 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.500989 21103 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:24.473881 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.494776 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:24.504207 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.505125 21108 raft_consensus.cc:2410] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:24.506174 21108 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:24.455770 21031 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.459957 23507 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.482362 21105 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
I20260709 12:17:24.511492 21105 raft_consensus.cc:3055] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:24.514726 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.511799 21105 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:24.503034 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:24.502415 21151 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.527061 21151 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.529019 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:24.484135 23497 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.536486 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.537127 21076 leader_election.cc:400] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:17:24.538784 21102 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:24.509932 21103 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.500406 23259 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 2. Current term is 3.
I20260709 12:17:24.497223 23505 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:24.484208 23469 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.537302 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.538097 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.540717 21103 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.540454 23501 consensus_queue.cc:1059] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 12:17:24.568090 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.568970 21076 leader_election.cc:400] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:17:24.575924 23494 consensus_queue.cc:1059] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.576166 23264 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:24.576771 21031 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:24.507046 23304 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:24.577119 23258 raft_consensus.cc:3055] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:24.486958 23504 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.503080 23137 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.509325 23507 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:24.578131 23137 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.578204 23507 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.578516 23504 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.579701 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.545017 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1885) took 1221 ms. Trace:
I20260709 12:17:24.577502 23258 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:24.544530 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:24.460882 23486 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.536109 23470 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:24.463620 23278 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.461259 23102 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.541061 23303 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.569434 21105 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.536367 23404 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.589498 21106 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:24.597283 21106 pending_rounds.cc:85] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 3
I20260709 12:17:24.597522 21106 pending_rounds.cc:107] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:24.597747 21106 raft_consensus.cc:2889] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:24.567921 23471 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.540887 23497 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:24.593511 21105 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.540926 23365 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:17:24.589965 23439 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.599591 23397 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:24.543156 22899 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:17:24.614538 23497 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.607411 23473 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:24.609104 23258 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.641017 23280 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:17:24.641314 23258 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.642271 23296 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.587252 23501 consensus_queue.cc:1243] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:24.638685 21034 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.583808 23467 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:17:24.636854 23415 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:24.585682 23502 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:24.617683 23439 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:24.657567 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:24.614809 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 76787.1us
I20260709 12:17:24.644186 23397 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.645635 23137 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.663228 23016 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.663668 23397 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.664918 23360 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:24.665948 23507 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.667927 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.669075 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.644426 23296 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:24.669037 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.681217 23475 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:24.681723 23137 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.655982 23304 raft_consensus.cc:697] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:24.671213 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.683121 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:24.675727 21033 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:24.667930 23507 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.682379 23398 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:24.688607 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.689066 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.690303 21110 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.693486 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.690924 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.691361 21740 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:24.668576 23439 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.694921 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:24.697875 21180 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.695465 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:24.696581 21151 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.700601 21033 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.682334 23360 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.699621 22899 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:24.704542 22899 raft_consensus.cc:697] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:24.611135 23505 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.705425 22899 consensus_queue.cc:237] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.708706 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1198) took 1479 ms. Trace:
I20260709 12:17:24.709069 21029 rpcz_store.cc:276] 0709 12:17:23.229368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.077047 (+847679us) service_pool.cc:224] Handling call
0709 12:17:24.708538 (+631491us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b54000c53d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:24.708654 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100282752}
I20260709 12:17:24.712033 23102 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.712945 21110 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:24.714481 23268 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:24.714998 23268 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.717017 23268 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:24.699855 23280 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.720502 21180 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:24.721545 21712 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:24.722556 23419 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:24.723047 23419 raft_consensus.cc:697] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:24.733664 21110 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:24.734001 21110 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:24.737162 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.744019 21104 raft_consensus.cc:2393] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:24.661851 23415 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.763478 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:24.764242 21181 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:24.765041 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:24.765380 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:24.766175 21183 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:24.765448 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:24.762547 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:24.768440 21185 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:24.760855 21110 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.767417 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:24.729581 23360 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:24.769877 21177 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 4: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:24.770148 21181 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:24.770789 21178 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:24.770684 21184 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:24.767465 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:24.772394 21180 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.732930 23296 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:24.773293 21110 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.700762 23501 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:17:24.723839 23419 consensus_queue.cc:237] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:24.777566 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.778335 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:24.780539 23469 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.775543 23296 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.784947 23296 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:24.782830 23469 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:24.787928 21180 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:24.789723 21110 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:24.790350 23497 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.791181 21110 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:24.793532 23296 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.746369 23468 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:17:24.793927 23296 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:24.794353 23296 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:24.795065 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 98570.5us
I20260709 12:17:24.795446 23415 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:24.772548 23360 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.796643 21151 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:24.797803 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.746089 23268 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:17:24.759387 23258 consensus_queue.cc:1059] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:17:24.799865 21151 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.798223 23280 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:24.743177 23102 consensus_queue.cc:1059] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:17:24.810627 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:24.820125 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:24.821300 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.821506 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:24.795967 23497 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:24.839287 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:24.839941 21180 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:24.830075 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.819092 23469 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:24.819253 23279 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.826081 23507 raft_consensus.cc:3055] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:24.841396 21151 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.844794 23504 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.848453 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:24.806900 23526 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:17:24.851082 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:24.818113 23304 consensus_queue.cc:237] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.830912 23016 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:17:24.853073 21184 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:24.854493 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:24.856763 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.832881 23397 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:17:24.830794 23324 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:24.858163 23268 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:24.866374 21035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1202) took 1636 ms (client timeout 2133 ms). Trace:
I20260709 12:17:24.866917 21030 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:17:24.866703 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:24.869939 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aaaf493e892d4ee9839b45b601fc8400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:24.831314 23102 consensus_queue.cc:1243] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:24.842809 23278 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:24.885440 21035 rpcz_store.cc:269] 0709 12:17:23.230398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.860058 (+629660us) service_pool.cc:224] Handling call
0709 12:17:24.866221 (+1006163us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b5400063bd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:24.866313 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752507264}
I20260709 12:17:24.890625 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:24.828398 23280 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:24.849449 21002 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:24.931241 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 81865.7us
I20260709 12:17:24.874990 23507 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:24.886093 21030 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:24.886454 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.922824 21029 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:24.926549 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.932026 21002 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.877444 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:24.876713 23473 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.878654 23503 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.934484 21035 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:24.942742 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.937367 21177 raft_consensus.cc:2393] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:24.941730 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 73636.9us
I20260709 12:17:24.938486 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:24.941036 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.850776 23296 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.942914 21035 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.943526 21030 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.949860 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.892421 23504 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.957114 21002 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.954522 21027 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:24.932089 23404 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:24.931479 23415 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.941286 22899 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.934396 23102 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.934798 23324 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:24.884153 23439 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:24.581236 21186 rpcz_store.cc:276] 0709 12:17:23.323712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.011295 (+687583us) service_pool.cc:224] Handling call
0709 12:17:24.011568 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.011752 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:24.314909 (+303157us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.544696 (+229787us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.544749 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:24.544791 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.544852 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.544961 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":323901,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1699,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3349,"thread_start_us":427337,"threads_started":2}
I20260709 12:17:24.939632 23408 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:24.967237 21032 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:24.956059 23467 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.984189 21077 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:24.960407 23502 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.008944 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:25.000610 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.958372 23259 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:24.958659 23365 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:17:24.955886 23501 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:17:24.951568 23473 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.014546 21077 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:25.016125 23280 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.958792 23423 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:17:25.018955 21002 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:24.933285 23268 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:24.961181 23471 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 12:17:24.596868 23090 consensus_queue.cc:1175] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:25.038800 21028 raft_consensus.cc:2368] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5.
W20260709 12:17:25.041252 23531 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:17:25.043680 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:25.044241 21104 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.045396 23360 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.047660 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1217) took 1314 ms. Trace:
I20260709 12:17:25.047983 23296 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:25.048700 22323 raft_consensus.cc:3055] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:25.049033 22323 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:25.049479 23494 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.049707 22323 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.050480 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:25.020592 23258 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:24.976873 23505 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:17:25.004097 23507 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.050613 22323 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.059167 23507 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.062093 23471 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:25.062415 23471 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:25.047986 21034 rpcz_store.cc:276] 0709 12:17:23.732771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.423644 (+690873us) service_pool.cc:224] Handling call
0709 12:17:24.423905 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.646172 (+222267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.047433 (+401261us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540042f9d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:25.047607 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493489408}
I20260709 12:17:25.066831 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:25.058535 21104 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:24.993901 23469 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:25.004165 23526 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.967448 23415 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:25.082782 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 63929.2us
I20260709 12:17:25.069849 21032 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:25.083842 21002 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:25.023415 23102 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.958727 23503 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.086351 23420 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:25.063324 23360 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:25.086437 23264 consensus_queue.cc:1059] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.086620 23540 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:25.086184 21002 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:25.087266 23324 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.086123 22323 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:25.038265 23468 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:24.965591 23504 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.128533 21032 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.129884 21108 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:25.128010 21109 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.059168 22899 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 12:17:25.064157 23429 consensus_queue.cc:1175] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 6 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: [5.4-5.4]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:17:25.136832 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 50710.2us
I20260709 12:17:25.137633 21002 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:25.066604 23470 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:17:25.090068 23443 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:25.090440 23420 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.085646 23259 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:17:25.090463 23526 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.145059 23545 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.113128 23469 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.147969 23415 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:25.037971 23502 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.152964 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.006771 23408 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.172533 21186 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:25.161254 21109 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:25.169795 21180 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:25.092334 23486 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:17:25.171226 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 85294.6us
I20260709 12:17:25.156827 21149 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:25.155162 23420 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.156387 23505 raft_consensus.cc:3055] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:25.187043 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:25.166985 23475 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.203748 21103 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:25.207150 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:25.208729 21109 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.208954 23542 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:25.209532 23542 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:25.210384 23542 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.187664 23505 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:25.185815 23545 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:17:25.184865 23547 consensus_queue.cc:1059] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:17:25.219631 23486 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:25.242242 23439 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:25.204885 23259 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:17:25.209420 23543 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 12:17:25.247027 23535 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:17:25.248678 23526 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:25.249192 23473 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:25.251607 23504 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:25.190178 23280 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:17:25.234315 23540 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.239439 23494 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:25.340067 23507 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:25.338523 23486 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:25.352474 23486 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.356035 23503 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:25.359897 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:25.360492 21111 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:25.343341 23325 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.343811 23304 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:25.344410 23408 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:25.349330 23507 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:25.405009 23475 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.380640 23102 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:25.407384 21077 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.593s (SENT) [suppressed 18 similar messages]
I20260709 12:17:25.389964 23304 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:25.407073 23268 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:25.390522 23325 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.424429 23325 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:25.425349 23507 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.428159 23507 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.429523 23420 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.347735 23505 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.348807 23540 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.431448 23505 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.436551 23540 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:25.449411 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:25.450035 21034 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.465430 23304 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.466670 23304 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:25.469084 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 61726.6us
W20260709 12:17:25.474126 21151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.007s	sys 0.002s
W20260709 12:17:25.474476 21151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.007s	sys 0.002s
I20260709 12:17:25.476220 23423 raft_consensus.cc:3055] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:25.476663 23423 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:25.477506 23423 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:25.479326 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 637937us
I20260709 12:17:25.480165 21034 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:25.481645 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:25.482357 21034 raft_consensus.cc:2393] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:25.484802 21177 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:25.485847 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.486531 21185 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:25.487056 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:25.487251 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:25.487977 21179 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:25.485503 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.488732 21181 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:25.490047 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.491040 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.500471 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:25.501111 21177 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:25.501884 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.502558 21177 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:25.492198 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.504740 21186 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:25.505617 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:25.506700 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:25.507875 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.508455 21179 raft_consensus.cc:2376] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5. Re-sending same reply.
I20260709 12:17:25.509227 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:25.509938 21179 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:25.511961 21177 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:25.513253 21177 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:25.514022 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:25.514387 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.515004 21180 raft_consensus.cc:2376] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4. Re-sending same reply.
W20260709 12:17:25.516283 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.514891 21181 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
W20260709 12:17:25.499496 23553 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.293s	user 0.000s	sys 0.004s
I20260709 12:17:25.525000 21181 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:25.523398 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:17:25.530268 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:25.530695 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:25.534623 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:25.535507 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.546820 21744 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.547832 21105 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:25.548429 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1440) took 1048 ms. Trace:
I20260709 12:17:25.548722 21105 rpcz_store.cc:276] 0709 12:17:24.499773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.511109 (+ 11336us) service_pool.cc:224] Handling call
0709 12:17:24.511373 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.547571 (+1036198us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54001a9da0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f90bdc0 00007fcb9f996d87 00007fcb9f997470 00007fcb9f993d8f 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c
0709 12:17:25.548201 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.548378 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706088192}
W20260709 12:17:25.550745 21772 heartbeater.cc:646] Failed to heartbeat to 127.19.108.62:42247 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.108.62:42247 timed out after 15.000s (SENT)
I20260709 12:17:25.547163 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:25.552520 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:25.552922 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.554369 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:25.555801 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:25.555935 21744 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:17:25.556345 21184 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.563320 21747 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:25.564190 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:25.565471 21028 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.518973 23423 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.581740 23280 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:25.582249 23280 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:25.582624 23280 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.584198 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:25.593158 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.594455 23505 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:25.584846 21105 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
W20260709 12:17:25.601395 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 78084.3us
I20260709 12:17:25.602252 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:25.610329 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:25.678786 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.705018 21741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 577) took 2011 ms. Trace:
I20260709 12:17:25.878412 23205 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:25.712303 23549 log.cc:927] Time spent T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.505s	user 0.001s	sys 0.000s
I20260709 12:17:25.887449 23205 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.887212 21741 rpcz_store.cc:276] 0709 12:17:23.693659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.703861 (+ 10202us) service_pool.cc:224] Handling call
0709 12:17:23.749343 (+ 45482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:23.749632 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:24.077023 (+327391us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.178415 (+101392us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.461020 (+282605us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b480024c0d8. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f 00007fcba49abf37 00007fcba49c055c 00007fcba49c0508 00007fcba49c0488 00007fcba49c0443 00007fcba49bf6ec 00007fcba38e9a96
0709 12:17:25.704548 (+1243528us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b180036cdc0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9f53c4bc 00007fcb9c88a48b 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a4455 00007fcb9f98c060 00007fcb9f99e716 00007fcb9f9af287
0709 12:17:25.704658 (+   110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:25.704708 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:25.704761 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.704829 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.704949 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":471079,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":239954,"raft.run_cpu_time_us":2772,"raft.run_wall_time_us":214096,"spinlock_wait_cycles":8668672,"thread_start_us":429838,"threads_started":3}
I20260709 12:17:25.889569 23205 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:25.669731 23505 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:25.899612 23505 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:25.900054 23505 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:25.900977 21032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.082s	sys 0.118s
W20260709 12:17:25.901324 21032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.082s	sys 0.118s
W20260709 12:17:25.890997 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 288815us
I20260709 12:17:25.676119 21184 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:25.583796 23334 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.308s
I20260709 12:17:25.891829 23404 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:25.904287 23404 raft_consensus.cc:697] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:25.892000 21185 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:25.905148 23404 consensus_queue.cc:237] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.733354 23471 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.786646 23415 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:25.912669 23415 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:25.913973 23415 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.915010 23415 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.729969 23442 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:25.921962 21036 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.922590 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2036) took 1530 ms. Trace:
W20260709 12:17:25.892534 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 282272us
I20260709 12:17:25.949669 21036 rpcz_store.cc:276] 0709 12:17:24.392008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.011615 (+619607us) service_pool.cc:224] Handling call
0709 12:17:25.011875 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.921814 (+909939us) spinlock_profiling.cc:243] Waited 52.8 ms on lock 0x7b54004e0320. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f90bdc0 00007fcb9f9961c0 00007fcb9f997231 00007fcb9f993d8f 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c
0709 12:17:25.922364 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.922537 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121337088}
I20260709 12:17:25.951961 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:25.952747 21036 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:25.954495 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:25.954596 23571 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:25.955935 23571 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:25.956103 21077 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:25.956286 21036 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:25.956787 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f16c07bcae284f65a7c0ee0375e00769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:25.956796 23258 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:25.958039 23543 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.958263 23258 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:25.958544 23543 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.959776 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:25.960958 23543 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:25.961521 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:25.962196 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.962389 23090 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:25.963040 23090 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:25.963675 23090 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:25.965353 21711 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.008s	sys 0.004s
W20260709 12:17:25.965786 21711 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.008s	sys 0.004s
I20260709 12:17:25.713168 23552 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.967271 23552 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.968741 21076 leader_election.cc:400] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5.
I20260709 12:17:25.969135 21076 leader_election.cc:403] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:25.624251 23278 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.271s
I20260709 12:17:25.969723 23090 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.894976 23507 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.599468 23470 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:25.897215 21149 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:25.971570 23507 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:25.972200 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 75064us
I20260709 12:17:25.973464 23507 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:25.974357 23548 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:25.974773 23548 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.975108 23548 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.976079 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:25.977903 23543 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:25.979240 23470 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.979146 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:25.980692 21105 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:25.981763 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:25.983003 23525 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:25.983392 23525 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.983705 23525 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.984512 21077 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:25.985679 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:25.898241 21106 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:25.992075 23525 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:25.992797 20931 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 113) took 15737 ms (client timeout 15000 ms). Trace:
I20260709 12:17:25.992094 23548 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.884862 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:25.583601 23102 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.927415 21030 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.995669 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2044) took 1404 ms. Trace:
I20260709 12:17:25.998114 23502 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:25.996026 21034 rpcz_store.cc:276] 0709 12:17:24.591679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.517452 (+925773us) service_pool.cc:224] Handling call
0709 12:17:25.517761 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:25.520366 (+  2605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:25.520399 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:25.523870 (+  3471us) log.cc:844] Serialized 26 byte log entry
0709 12:17:25.995366 (+471496us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:25.995402 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.995464 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:25.995500 (+    36us) raft_consensus.cc:1685] finished
0709 12:17:25.995510 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.995618 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22861,"raft.queue_time_us":4912,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":12865,"thread_start_us":324553,"threads_started":1,"wal-append.queue_time_us":398983}
I20260709 12:17:26.001267 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:26.001827 21106 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.002082 21030 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
W20260709 12:17:26.002574 23474 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:17:25.526682 23475 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.929152 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2043) took 1340 ms. Trace:
I20260709 12:17:25.933563 23497 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:26.003333 23544 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:26.003988 23475 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.005889 23475 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.006428 23102 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.008222 21106 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:26.008383 23102 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:26.010337 21029 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:26.011736 21028 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:26.003080 21032 rpcz_store.cc:276] 0709 12:17:24.591125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.135263 (+544138us) service_pool.cc:224] Handling call
0709 12:17:25.154351 (+ 19088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.154547 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:25.340664 (+186117us) log.cc:844] Serialized 14 byte log entry
0709 12:17:25.928825 (+588161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:25.928877 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:25.928922 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.928995 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.929098 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27842,"prepare.queue_time_us":29227,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":1787,"raft.queue_time_us":27168,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":723649,"threads_started":2,"wal-append.queue_time_us":560461}
I20260709 12:17:26.012934 21032 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:26.013245 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2049) took 1129 ms. Trace:
I20260709 12:17:26.013602 21028 rpcz_store.cc:276] 0709 12:17:24.883780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.566036 (+682256us) service_pool.cc:224] Handling call
0709 12:17:25.569555 (+  3519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.012055 (+442500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.013034 (+   979us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54000c44d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:26.013192 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016255232}
I20260709 12:17:26.014101 21032 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:25.937039 23504 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:25.942469 23325 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:25.943866 23419 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:25.947870 23296 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.965253 23429 consensus_queue.cc:1059] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:26.031263 23545 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.033311 23419 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.033658 23545 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.030993 22323 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.035333 22323 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.036037 23419 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:26.036693 23296 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:25.979902 21111 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:26.018443 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1452) took 1152 ms. Trace:
I20260709 12:17:26.037704 21108 rpcz_store.cc:276] 0709 12:17:24.865886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.073970 (+208084us) service_pool.cc:224] Handling call
0709 12:17:25.074221 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.132676 (+ 58455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.018233 (+885557us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b540016f8d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:26.018380 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127305472}
I20260709 12:17:26.019337 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1222) took 1565 ms. Trace:
I20260709 12:17:26.038604 23296 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:26.039323 23504 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:26.040256 23325 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.040885 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.036283 23545 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:26.041088 21029 rpcz_store.cc:276] 0709 12:17:24.456137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.044028 (+587891us) service_pool.cc:224] Handling call
0709 12:17:26.009982 (+965954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.010707 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.019150 (+  8443us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400062cd0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:26.019282 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220777728}
I20260709 12:17:26.042430 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:26.042627 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:25.988683 21035 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:26.043485 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2041) took 1544 ms. Trace:
I20260709 12:17:26.044312 21029 raft_consensus.cc:2410] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:26.044203 21033 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:26.045090 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.045517 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2026) took 1886 ms. Trace:
I20260709 12:17:26.045667 21029 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:26.045873 21033 rpcz_store.cc:276] 0709 12:17:24.159556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.701521 (+541965us) service_pool.cc:224] Handling call
0709 12:17:26.043939 (+1342418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.044828 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.045363 (+   535us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002247d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:26.045470 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025542912}
I20260709 12:17:26.046448 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:25.969604 23552 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.003502 23497 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:25.978422 23543 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.048086 23497 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:25.934094 23495 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:26.048810 23525 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:26.049490 23497 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.050089 23543 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:26.037031 22323 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.006131 23498 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.051733 23498 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.053660 23498 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.043848 21035 rpcz_store.cc:276] 0709 12:17:24.499485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.089342 (+589857us) service_pool.cc:224] Handling call
0709 12:17:25.089605 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.988543 (+898938us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b54000224a0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f90bdc0 00007fcb9f9961c0 00007fcb9f997231 00007fcb9f993d8f 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c
0709 12:17:26.043235 (+ 54692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.043433 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180101376}
I20260709 12:17:26.054576 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.055014 23495 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.055660 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.056053 21029 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:26.046995 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.057103 23495 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.059440 21035 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:26.060104 23543 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:26.060364 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:26.060676 23543 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.063010 23545 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.063079 23543 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:26.063584 23545 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:26.064072 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:26.064635 21744 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:26.064473 23545 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.065194 21149 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:26.057399 21033 raft_consensus.cc:2410] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:17:26.044162 21027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2010) took 2862 ms (client timeout 2035 ms). Trace:
I20260709 12:17:26.014787 21028 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:26.068501 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:26.069080 21032 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:26.069088 21027 rpcz_store.cc:269] 0709 12:17:23.181348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.196641 (+ 15293us) service_pool.cc:224] Handling call
0709 12:17:26.043829 (+2847188us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54002247d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:26.043934 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3682806144}
I20260709 12:17:25.583604 23420 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:25.680271 23564 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.001811 21034 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:26.076615 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:26.077768 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 92163.6us
I20260709 12:17:26.071748 21029 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:17:25.702354 23562 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:17:26.074681 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 86945.9us
W20260709 12:17:26.011307 21030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1211) took 2760 ms (client timeout 2237 ms). Trace:
I20260709 12:17:25.991783 23470 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:26.093300 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.078801 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:17:26.098466 21030 rpcz_store.cc:269] 0709 12:17:23.250871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.968531 (+717660us) service_pool.cc:224] Handling call
0709 12:17:24.866788 (+898257us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400024020. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f90bdc0 00007fcb9f997e18 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:25.927184 (+1060396us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b58001b02d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f8f00aa 00007fcb9f972447 00007fcb9f98afe7 00007fcb9f98c7de 00007fcb9f99827c 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c
0709 12:17:26.011216 (+ 84032us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673443840}
W20260709 12:17:26.086810 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.080855 21744 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:26.096146 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:26.083110 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:26.106439 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:25.894515 23280 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.104055 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.203346 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:26.208915 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 88736us
I20260709 12:17:26.193145 21742 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:17:26.166499 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:26.211643 21743 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:26.103205 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:26.212466 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:25.993208 20931 rpcz_store.cc:269] 0709 12:17:10.255491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.256542 (+  1051us) service_pool.cc:224] Handling call
0709 12:17:25.992708 (+15736166us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:21.499052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:21.715873 (+216821us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:21.723361 (+  7488us) write_op.cc:435] Acquired schema lock
0709 12:17:21.723380 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:21.884770 (+161390us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:21.945391 (+ 60621us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:21.947011 (+  1620us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:17:22.024407 (+ 77396us) tablet.cc:701] Row locks acquired
0709 12:17:22.024469 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:17:22.024643 (+   174us) write_op.cc:270] Start()
0709 12:17:22.024791 (+   148us) write_op.cc:276] Timestamp: P: 1783599442024569 usec, L: 0
0709 12:17:22.024811 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:17:22.036397 (+ 11586us) log.cc:844] Serialized 1674 byte log entry
0709 12:17:22.567089 (+530692us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b2000023df8. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f542b91 00007fcb9f564a19 00007fcb9f52f8c3 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169 00007fcb9f538131 00007fcb9f53742d 0000000000388634
0709 12:17:22.951362 (+384273us) op_driver.cc:464] REPLICATION: finished
0709 12:17:23.311559 (+360197us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9c88a0ac 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcba33caef0
0709 12:17:23.682528 (+370969us) write_op.cc:301] APPLY: starting
0709 12:17:23.682637 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:23.682800 (+   163us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:23.682835 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:23.755226 (+ 72391us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:23.779278 (+ 24052us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f99132a 00007fcb9f916f14 00007fcb9f916ec3 00007fcb9f916e38 00007fcb9f916df3 00007fcb9f9160dc 00007fcb9f93fe16 00007fcb9f927cbb 00007fcb9f91239d 00007fcb9f915d75
0709 12:17:23.855103 (+ 75825us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:17:23.855168 (+    65us) write_op.cc:312] APPLY: finished
0709 12:17:23.855497 (+   329us) log.cc:844] Serialized 41 byte log entry
0709 12:17:23.855692 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:23.855784 (+    92us) write_op.cc:454] Released schema lock
0709 12:17:23.855824 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:23.856211 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:23.856240 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2059591,"reported_tablets":16,"spinlock_wait_cycles":1280,"child_traces":[["op",{"apply.queue_time_us":713729,"apply.run_cpu_time_us":2548,"apply.run_wall_time_us":173662,"num_ops":4,"prepare.queue_time_us":149238,"prepare.run_cpu_time_us":11208,"prepare.run_wall_time_us":637465,"raft.queue_time_us":117902,"raft.run_cpu_time_us":18956,"raft.run_wall_time_us":869866,"replication_time_us":904469,"spinlock_wait_cycles":20526592,"thread_start_us":860453,"threads_started":4,"wal-append.queue_time_us":267288,"wal-append.run_cpu_time_us":28116,"wal-append.run_wall_time_us":2552037}]]}
I20260709 12:17:26.194736 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:26.137678 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:26.133953 21108 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.210572 21029 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:26.216349 21746 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:17:26.242923 21746 pending_rounds.cc:85] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Aborting all ops after (but not including) 5
W20260709 12:17:26.115026 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.217638 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:26.136112 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 57377.8us
I20260709 12:17:26.212821 21183 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:26.256860 21077 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:26.165892 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:26.267006 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:26.266952 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:26.268375 21183 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.270488 21744 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:26.270383 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:26.271173 21108 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:26.274374 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:26.275753 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:26.279233 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 325605us
I20260709 12:17:26.283979 21711 leader_election.cc:400] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5.
I20260709 12:17:26.284385 21711 leader_election.cc:403] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:26.165002 23397 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:26.164633 21740 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:26.288973 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1566) took 1069 ms. Trace:
W20260709 12:17:26.255227 23573 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:17:26.291077 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:26.351192 21181 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:26.351912 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:26.291885 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:26.294067 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.311064 21182 rpcz_store.cc:276] 0709 12:17:25.219304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.219454 (+   150us) service_pool.cc:224] Handling call
0709 12:17:25.234129 (+ 14675us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:25.234476 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:25.237624 (+  3148us) log.cc:844] Serialized 14 byte log entry
0709 12:17:25.480688 (+243064us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:25.510488 (+ 29800us) log.cc:844] Serialized 52 byte log entry
0709 12:17:25.510720 (+   232us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:25.511011 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 12:17:25.517281 (+  6270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.517355 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:25.773400 (+256045us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b18001eb2c0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:26.288771 (+515371us) raft_consensus.cc:1685] finished
0709 12:17:26.288793 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:26.288920 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5967,"prepare.queue_time_us":3276,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":14074,"raft.queue_time_us":16241,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":21985,"spinlock_wait_cycles":4468096,"thread_start_us":129293,"threads_started":1,"wal-append.queue_time_us":249628}
I20260709 12:17:26.098086 23552 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:26.243192 21746 pending_rounds.cc:107] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:17:26.358635 22323 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:26.359051 21746 raft_consensus.cc:2889] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:26.359241 22323 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.317332 21032 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:26.114591 23404 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:26.082314 23408 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.107100 23090 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5.
I20260709 12:17:26.254964 23334 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.255268 23420 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.215380 23102 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:26.148378 23325 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:26.082281 23474 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.354959 23398 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.363098 21183 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:26.384375 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:26.388635 21183 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:26.385782 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:26.390360 21180 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:26.119228 23544 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.114485 23431 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:26.373245 22323 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:26.364957 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:26.408689 21181 raft_consensus.cc:1813] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Handling vote request from an unknown peer 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:26.409211 21181 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:26.410375 21181 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:26.266119 23543 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:26.378139 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:26.378796 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 94936.6us
I20260709 12:17:26.413614 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:26.415138 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 318954us
W20260709 12:17:26.417892 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 161099us
I20260709 12:17:26.077396 23548 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:26.288643 23498 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:26.246564 23475 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 12:17:26.202183 23486 consensus_queue.cc:1059] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.156s
I20260709 12:17:26.304998 23205 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:26.165302 23278 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.228s
I20260709 12:17:26.120745 23258 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.251s
W20260709 12:17:26.387112 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 267166us
I20260709 12:17:26.111044 23507 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.258s
I20260709 12:17:26.360422 23268 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.422959 21181 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:26.425725 21077 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:26.426187 21000 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:26.426263 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.427074 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.431026 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:26.432263 21029 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:26.450462 21711 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:26.433444 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.451498 21027 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:26.434144 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.452324 21032 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:26.434767 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.452912 21030 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:26.435590 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.363797 23572 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5.
I20260709 12:17:26.384136 23502 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.441465 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:26.381484 23334 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.381238 23420 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:26.446888 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 156332us
I20260709 12:17:26.454921 21000 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:26.455463 22323 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:26.431018 23552 raft_consensus.cc:2764] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:17:26.356627 23397 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.453765 21034 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:26.442950 23429 consensus_queue.cc:1243] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:17:26.495369 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 53983.7us
W20260709 12:17:26.458017 23505 consensus_meta.cc:287] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.558s	user 0.006s	sys 0.002s
I20260709 12:17:26.392269 23474 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.386377 23102 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.444665 20934 catalog_manager.cc:5697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 2 to 5, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:26.437347 23525 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:17:26.459451 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:26.499517 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 44700us
I20260709 12:17:26.492798 22323 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:26.431574 23431 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.518883 23334 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.519076 23431 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:26.519699 23577 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:26.508054 23505 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.521483 23397 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.522120 23505 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.522797 23429 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:26.480468 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.442291 23490 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:17:26.441375 23404 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:26.514782 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:26.516520 20934 catalog_manager.cc:5697] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:26.517239 23102 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:26.419237 23398 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:26.532866 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 117096us
I20260709 12:17:26.443104 23499 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:17:26.450361 23548 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:26.424549 23544 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.537133 21184 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:26.538187 23544 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:26.529868 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 70486.3us
I20260709 12:17:26.538995 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:26.539685 23548 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.541749 23548 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:26.543673 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 125120us
W20260709 12:17:26.545431 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 98511.7us
I20260709 12:17:26.436961 23543 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.550886 21077 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:26.565003 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 124781us
W20260709 12:17:26.578178 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 63468.3us
I20260709 12:17:26.501817 23419 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:26.507072 23540 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:26.581715 21711 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:26.520242 23205 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.456341 23268 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.531467 20934 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 2 to 4, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:26.585485 21103 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:26.586189 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:26.585929 22323 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.591809 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:26.591650 20934 catalog_manager.cc:5697] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:26.592417 21103 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.494103 23502 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.551303 23495 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:26.582260 23258 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.598547 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:26.581944 23102 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:26.605924 20934 catalog_manager.cc:5697] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:26.618762 20934 catalog_manager.cc:5697] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 3 to 4, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 4 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:26.620875 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:26.628028 21106 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:26.593057 23423 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:26.626574 21103 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:26.593722 23205 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:26.581611 23572 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:17:26.609495 23408 raft_consensus.cc:697] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:26.597641 23495 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.603493 23499 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:26.598157 23280 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:26.591506 23550 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 12:17:26.637652 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 51511.9us
I20260709 12:17:26.623980 23296 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.646461 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:26.615551 23505 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:26.623610 23540 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.666244 21149 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:26.643124 20934 catalog_manager.cc:5697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 2 to 5, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 5 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:26.620041 23593 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:26.687062 21182 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:26.619874 23258 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.642108 23611 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:26.693607 21077 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:26.693344 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:26.700116 21182 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:26.630029 23102 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.674468 23495 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.678160 23475 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.730685 22323 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.678354 23423 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.743086 20934 catalog_manager.cc:5697] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 4, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:26.745978 21182 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:26.749439 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 55918.8us
I20260709 12:17:26.724953 23507 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:17:26.755153 23505 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:26.636590 23404 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.701279 23525 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.725153 21106 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:26.755509 23615 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.685654 23548 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:17:26.678503 23499 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:26.743239 23596 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:26.718477 23611 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:26.755733 23591 log.cc:927] Time spent T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:17:26.769654 22323 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:26.774365 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 226073us
I20260709 12:17:26.814543 21105 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:26.742146 23486 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:17:26.825729 23423 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.826241 23423 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:26.698665 23296 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.779829 23599 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.752571 23593 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:26.782943 21182 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:26.783393 20934 catalog_manager.cc:5697] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:26.704620 23540 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.788343 23548 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:26.789981 23590 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:17:26.795128 23499 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.904265 23504 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.905434 23504 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:26.795585 23586 log.cc:927] Time spent T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:17:26.795920 23615 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:26.726534 23605 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:17:26.895730 23601 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.907850 23601 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:26.908208 23605 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:26.771577 23420 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:26.819360 23580 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:17:26.821592 23102 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:26.765466 23408 consensus_queue.cc:237] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:26.822539 23415 consensus_meta.cc:287] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.907s	user 0.004s	sys 0.003s
I20260709 12:17:26.908715 23601 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.823261 23268 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.774417 23475 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.862733 23611 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.864917 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:26.926411 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 61578.3us
I20260709 12:17:26.927860 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:26.928954 21151 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:26.934788 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:26.877856 23505 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:26.933259 20934 catalog_manager.cc:5697] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 2 to 5, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 5 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:26.947690 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 399841us
I20260709 12:17:26.865420 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:26.865453 22323 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.866961 21106 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:26.871812 21105 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:26.703763 23205 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:26.875761 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 294114us
I20260709 12:17:26.877504 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.951818 21711 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:26.952761 21032 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:26.878815 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:26.879979 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:26.954200 21027 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:26.954619 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.954730 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:26.955451 21106 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:26.880985 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.956959 21029 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:26.881994 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:26.957820 21028 raft_consensus.cc:2376] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5. Re-sending same reply.
I20260709 12:17:26.882965 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.885699 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:26.958707 21036 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:26.958869 21033 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:26.826668 23423 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.892027 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:26.797748 23596 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:26.937214 23544 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:26.826625 23258 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.895783 21035 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:26.885106 23599 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.897903 23296 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:26.876698 23397 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:26.899163 23608 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:26.900887 23543 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:26.903424 23597 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:26.917438 21107 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:17:26.921326 21002 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:26.802892 23525 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.950647 21102 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:26.953615 20934 catalog_manager.cc:5697] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 2 to 6, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 6 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:26.959867 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:26.931782 23304 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.932766 23502 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:26.931455 23550 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.980023 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:26.885540 23469 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:17:26.980907 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:26.982648 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:26.936821 23280 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:26.889218 23486 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:17:26.989264 21027 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:26.886068 23598 consensus_queue.cc:1059] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:17:26.997820 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:27.003750 23419 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.003896 23605 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:27.007491 23296 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:27.007711 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:26.960106 23589 raft_consensus.cc:2764] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:27.010066 23408 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.891424 23593 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:26.907795 23615 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:26.979410 23572 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:26.988624 23596 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:27.406968 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 447320us
I20260709 12:17:27.407222 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.011190 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:27.408134 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 507748us
I20260709 12:17:27.407080 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.324246 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.409818 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:27.409982 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.394977 20934 catalog_manager.cc:5697] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 4, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.325629 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1577) took 1159 ms. Trace:
I20260709 12:17:27.410984 21184 rpcz_store.cc:276] 0709 12:17:26.166661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.356935 (+190274us) service_pool.cc:224] Handling call
0709 12:17:27.325463 (+968528us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400387054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:27.325572 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289305472}
I20260709 12:17:27.411527 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.321156 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.312021 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.065337 22323 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.395834 21106 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.197227 21180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 275) took 1277 ms. Trace:
I20260709 12:17:27.311722 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.321499 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.413566 21180 rpcz_store.cc:276] 0709 12:17:25.920267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.391051 (+470784us) service_pool.cc:224] Handling call
0709 12:17:26.391305 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.594520 (+203215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:26.594552 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:26.594592 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:26.594620 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.196955 (+602335us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400386654. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:27.197002 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.197165 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466919296}
I20260709 12:17:27.412695 21746 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:27.408768 21002 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:27.196455 23429 raft_consensus.cc:3055] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:27.090339 23619 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:27.416131 23610 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:27.416483 23619 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.416563 23610 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.417982 23610 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:27.418970 23502 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:27.419365 23502 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.419724 23502 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.419629 23475 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.412714 22323 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.320263 23259 raft_consensus.cc:3055] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:27.164217 23258 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.491020 21034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.010s	sys 0.050s
W20260709 12:17:27.499274 21034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.010s	sys 0.050s
W20260709 12:17:27.322121 23564 consensus_meta.cc:287] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 1.226s	user 0.003s	sys 0.006s
I20260709 12:17:27.491750 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.501307 21102 raft_consensus.cc:1813] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Handling vote request from an unknown peer 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:27.015444 23608 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.501775 21102 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:27.502023 23495 consensus_meta.cc:287] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.725s	user 0.006s	sys 0.003s
I20260709 12:17:27.502415 23495 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.410569 23090 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:27.407519 23605 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:27.163741 23624 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:17:27.462966 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 47222.5us
W20260709 12:17:27.063462 23614 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 12:17:27.419080 22899 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:27.185565 23268 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.318569 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.519325 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:27.522033 21151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.020s	sys 0.058s
W20260709 12:17:27.522351 21151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.020s	sys 0.058s
I20260709 12:17:27.494737 21105 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:27.522742 21002 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:17:27.522670 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 586577us
I20260709 12:17:27.422832 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 280) took 1359 ms. Trace:
I20260709 12:17:27.422107 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 274) took 1502 ms. Trace:
I20260709 12:17:27.498061 21106 raft_consensus.cc:2410] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:27.063202 23587 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:27.418635 23619 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:27.458114 23611 consensus_meta.cc:287] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.509s	user 0.000s	sys 0.008s
I20260709 12:17:27.185581 23594 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.535s
I20260709 12:17:27.348510 23398 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.010066 23599 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:27.540622 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:27.410739 23631 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:17:27.502923 23606 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:27.416136 23429 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:27.459215 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.012634 23397 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:27.517038 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 489587us
W20260709 12:17:27.596203 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aaaf493e892d4ee9839b45b601fc8400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:27.501335 23628 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:27.631734 23628 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.632488 23605 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.633862 23628 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.540386 23611 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.636860 23611 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.595456 23608 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:27.405335 23572 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:27.639010 23572 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.639842 23593 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:27.020702 23544 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.495s
I20260709 12:17:27.642958 23606 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.523521 21179 rpcz_store.cc:276] 0709 12:17:26.063169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.098102 (+ 34933us) service_pool.cc:224] Handling call
0709 12:17:27.324104 (+1226002us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:17:27.422770 (+ 98666us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11029888}
I20260709 12:17:27.644395 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.644925 23606 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.645466 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.348549 23423 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:27.532207 21710 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.011s	sys 0.035s
W20260709 12:17:27.648489 21710 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.011s	sys 0.035s
I20260709 12:17:27.533178 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.651036 21740 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:17:27.499604 23259 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:27.534570 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:27.532496 22323 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.528841 21178 rpcz_store.cc:276] 0709 12:17:25.919949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.942385 (+ 22436us) service_pool.cc:224] Handling call
0709 12:17:27.321361 (+1378976us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:17:27.422051 (+100690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368362752}
W20260709 12:17:27.522886 23601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.028s	sys 0.016s
I20260709 12:17:27.499451 23540 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:27.606781 23630 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:17:27.502986 23592 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.668010 21742 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:27.564745 21111 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:27.407409 23408 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.517376 23598 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.522637 20934 catalog_manager.cc:5697] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 3 to 4, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:27.597118 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.597394 21000 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:27.676578 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 79248.4us
I20260709 12:17:27.599159 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.676661 20934 catalog_manager.cc:5697] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 2 to 4, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
W20260709 12:17:27.599798 21737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33006 (request call id 371) took 1395 ms (client timeout 1589 ms). Trace:
I20260709 12:17:27.678153 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.599488 23429 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.526484 23268 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.601596 23397 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.603622 23620 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.604112 23603 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:27.515551 23090 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.407473 23419 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:27.604831 23602 consensus_queue.cc:1175] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:27.532829 23564 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.614500 23622 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:27.616134 23524 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.616544 23296 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.616952 23543 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.617954 23526 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.618335 23599 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.621212 23474 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:27.625538 23632 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:17:27.520141 22899 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:27.648181 21179 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:27.652143 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.421595 23597 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.538589 23587 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.538858 23469 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:17:27.569774 23398 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:27.660802 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.663249 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.664253 21181 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:27.694380 23360 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.654071 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:27.518041 23258 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:27.665100 23601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.029s	sys 0.017s
I20260709 12:17:27.673718 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.693852 23589 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:17:27.679208 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.816789 21184 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:27.761615 22899 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:27.817772 21184 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:27.690701 20934 catalog_manager.cc:5697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 2 to 4, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:27.691448 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:27.666896 23498 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:27.653707 23423 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:27.696305 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.702180 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.824407 21746 raft_consensus.cc:2410] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:17:27.747335 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:27.824899 21027 raft_consensus.cc:606] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:27.825233 21027 raft_consensus.cc:614] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:27.756652 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.758414 21109 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:27.681201 21738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 370) took 1481 ms. Trace:
W20260709 12:17:27.683621 21737 rpcz_store.cc:269] 0709 12:17:26.204122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.208744 (+  4622us) service_pool.cc:224] Handling call
0709 12:17:27.318402 (+1109658us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b5800004598. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:17:27.599715 (+281313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16155904}
I20260709 12:17:27.690084 23540 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:27.693612 23544 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:27.759315 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.838253 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.838953 21104 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:27.759923 23506 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:27.840328 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 271) took 1921 ms. Trace:
I20260709 12:17:27.763440 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.693099 23490 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:27.847440 23490 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.848277 23258 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:27.849202 23495 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.406610 23550 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.744352 23611 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:27.805330 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.760151 23268 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.837102 23090 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:27.695415 23620 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.851608 23550 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.826565 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:27.852684 23620 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.744042 23608 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:17:27.819227 21178 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.819408 20934 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:27.800500 23429 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.853523 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1346) took 1878 ms. Trace:
I20260709 12:17:27.850449 23611 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.853937 21107 rpcz_store.cc:276] 0709 12:17:25.975135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.976026 (+   891us) service_pool.cc:224] Handling call
0709 12:17:25.976279 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.399996 (+1423717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.853294 (+453298us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b540022d8d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:27.853446 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2163703168}
I20260709 12:17:27.854951 23408 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.855182 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.855463 23611 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:27.803952 23605 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.860586 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.861718 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.862284 21104 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:27.863066 21107 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:27.864015 21149 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:27.866400 21178 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:27.823565 23525 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:27.877192 21149 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:27.875360 20934 catalog_manager.cc:5697] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 4, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.881753 20934 catalog_manager.cc:5697] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 4, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 4 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:27.885167 20934 catalog_manager.cc:5697] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 4 to 5, term changed from 2 to 4, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4), VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New cstate: current_term: 4 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:27.760890 23296 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:27.812126 23499 consensus_meta.cc:287] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.908s	user 0.008s	sys 0.001s
W20260709 12:17:27.828810 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.914438 21077 leader_election.cc:336] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.593s (SENT)
I20260709 12:17:27.683944 23598 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.673418 23592 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.836776 21000 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:27.754946 23543 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.810936 23398 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:27.860056 23594 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:27.835407 23423 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.747537 23259 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.840721 21183 rpcz_store.cc:276] 0709 12:17:25.919076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.389371 (+470295us) service_pool.cc:224] Handling call
0709 12:17:26.389604 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.519891 (+130287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:26.519922 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:26.519961 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:26.519991 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.840092 (+1320101us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540033cf54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:27.840141 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.840271 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299187072}
I20260709 12:17:27.840010 23506 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:27.950101 21709 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:27.846037 23470 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:27.846549 23597 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:27.846947 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1361) took 1021 ms. Trace:
I20260709 12:17:27.977644 21109 rpcz_store.cc:276] 0709 12:17:26.825164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.885324 (+ 60160us) service_pool.cc:224] Handling call
0709 12:17:26.895629 (+ 10305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.826108 (+930479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.846707 (+ 20599us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b5400241154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:27.846886 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983436160}
I20260709 12:17:27.763954 23599 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.826932 21181 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:27.979288 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.745721 23603 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.844537 23587 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:27.894822 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 372099us
I20260709 12:17:27.923137 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:27.837314 23540 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:27.925607 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:27.933364 23268 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.849989 23490 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:27.873750 23605 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.939267 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:27.940943 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:28.003157 21029 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
W20260709 12:17:27.945148 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 108444us
I20260709 12:17:27.811874 23610 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.841325 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 273) took 1921 ms. Trace:
I20260709 12:17:28.007033 21185 rpcz_store.cc:276] 0709 12:17:25.919645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.017720 (+ 98075us) service_pool.cc:224] Handling call
0709 12:17:27.696152 (+1678432us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:17:27.841249 (+145097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195571584}
I20260709 12:17:28.008121 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:28.009380 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:28.010411 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:27.755659 23524 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.752422 23622 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.760721 23526 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.890913 23324 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:27.850005 22899 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:27.977205 23470 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:27.970805 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:28.038443 21183 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
W20260709 12:17:27.844656 23575 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:17:27.911594 23431 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:27.926733 23615 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:27.854036 23596 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.975677 21108 raft_consensus.cc:2410] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:27.950480 21032 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:28.055028 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:27.857622 23544 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.055392 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:28.055833 21032 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:27.982865 21002 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:28.056818 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:27.982795 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 68397.7us
I20260709 12:17:27.936986 23474 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.062705 23474 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.064036 22899 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:28.064644 23474 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:28.064946 22899 consensus_queue.cc:1059] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.065774 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2031) took 3747 ms. Trace:
I20260709 12:17:27.975929 20934 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 3, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 3 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:28.066900 21035 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:28.027249 23490 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:28.066164 21031 rpcz_store.cc:276] 0709 12:17:24.317946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.717122 (+399176us) service_pool.cc:224] Handling call
0709 12:17:24.717411 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:25.895615 (+1178204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:25.895645 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:25.896205 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 12:17:26.213370 (+317165us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:26.356820 (+143450us) log.cc:844] Serialized 14 byte log entry
0709 12:17:26.357137 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 12:17:26.357313 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.796284 (+438971us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b180045f5e0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f
0709 12:17:26.889112 (+ 92828us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4800080358. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f 00007fcba49abf37 00007fcba49c055c 00007fcba49c0508 00007fcba49c0488 00007fcba49c0443 00007fcba49bf6ec 00007fcba38e9a96
0709 12:17:26.908628 (+ 19516us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540042f4d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:26.908671 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:27.602116 (+693445us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b180045f5e0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:27.844087 (+241971us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:28.065546 (+221459us) raft_consensus.cc:1685] finished
0709 12:17:28.065566 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.065712 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28103,"prepare.queue_time_us":223538,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":4051,"raft.queue_time_us":326742,"raft.run_cpu_time_us":3889,"raft.run_wall_time_us":531735,"spinlock_wait_cycles":2084562048,"thread_start_us":316815,"threads_started":1,"wal-append.queue_time_us":531182}
I20260709 12:17:27.948518 23397 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:27.853550 23608 raft_consensus.cc:3055] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:28.002978 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 277874us
I20260709 12:17:27.973765 23640 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.013121 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:28.214635 21027 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:28.022810 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:28.215679 21178 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:28.011581 21179 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:28.051276 23641 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.047551 21182 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:27.994975 23540 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:27.994787 23408 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.968569 23611 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:27.992957 23597 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:27.972309 23325 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:17:28.037441 23324 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:28.059968 23639 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:17:28.061887 23598 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:28.062105 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:28.295727 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 233677us
I20260709 12:17:28.296495 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:28.297806 21077 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:27.874092 23571 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 12:17:28.056089 21029 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:28.067612 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1362) took 1141 ms. Trace:
I20260709 12:17:28.305773 21108 rpcz_store.cc:276] 0709 12:17:26.925826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.458921 (+533095us) service_pool.cc:224] Handling call
0709 12:17:28.067446 (+608525us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400227c54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:28.067562 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873891200}
I20260709 12:17:28.306986 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:28.307549 21108 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:28.308312 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:27.935984 23499 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:27.972545 23594 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.071774 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:28.315153 21032 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:28.077641 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:28.078896 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:28.098348 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:28.316670 21031 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:28.054486 23431 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.031831 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:28.327306 21185 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:28.218148 20934 catalog_manager.cc:5697] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 1 to 3, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 3 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:28.006618 23268 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.074954 23608 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:28.292085 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:28.069028 23644 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.304508 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:28.302188 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:28.058354 23593 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.188s
I20260709 12:17:28.072228 23587 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.249s
I20260709 12:17:28.051424 23615 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.359763 21741 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:28.218972 23474 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.327531 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:28.325372 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:28.291390 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:28.335736 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:28.364804 21032 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:28.340582 21185 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:28.368566 21185 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:28.341276 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:28.369640 21108 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.346802 21180 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:28.317377 21031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:28.370595 21031 raft_consensus.cc:606] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:28.370931 21031 raft_consensus.cc:614] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:28.371834 21031 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.298971 23324 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:28.080049 23507 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.248s
I20260709 12:17:28.353569 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:28.287967 23490 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:28.309571 23505 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:28.309267 23619 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:28.392355 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 64903.4us
I20260709 12:17:28.315652 23564 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:28.357780 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 55778.6us
I20260709 12:17:28.377375 21180 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:17:28.379937 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 429874us
I20260709 12:17:28.366792 21032 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:28.313273 23597 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.315784 23602 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:17:28.239460 23397 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:28.237694 23640 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.243328 23641 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.289211 23398 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.412070 23598 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:28.398244 23543 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:28.590471 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 387122us
W20260709 12:17:28.603833 21103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.027s	sys 0.031s
W20260709 12:17:28.806514 21103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.036s	sys 0.036s
I20260709 12:17:28.668956 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1472) took 1768 ms. Trace:
I20260709 12:17:28.822610 21111 rpcz_store.cc:276] 0709 12:17:26.900611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.674143 (+773532us) service_pool.cc:224] Handling call
0709 12:17:27.674486 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:27.685520 (+ 11034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.685551 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:27.692832 (+  7281us) log.cc:844] Serialized 52 byte log entry
0709 12:17:28.128076 (+435244us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:28.668314 (+540238us) log.cc:844] Serialized 14 byte log entry
0709 12:17:28.668601 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:28.668686 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.668731 (+    45us) raft_consensus.cc:1685] finished
0709 12:17:28.668743 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.668891 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":366799,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":131872,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":11400,"thread_start_us":733606,"threads_started":2,"wal-append.queue_time_us":664348}
I20260709 12:17:28.363111 23615 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:28.642973 21029 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:17:28.710776 21031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:28.934237 21031 raft_consensus.cc:606] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:28.934610 21031 raft_consensus.cc:614] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:28.630347 21027 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:28.399287 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:28.628924 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:28.938024 21180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1584) took 1312 ms. Trace:
I20260709 12:17:28.441745 21108 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:28.938436 21180 rpcz_store.cc:276] 0709 12:17:27.625387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.376850 (+751463us) service_pool.cc:224] Handling call
0709 12:17:28.377140 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:28.937733 (+560593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:28.937958 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:28.366923 23589 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:28.767601 21002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.004s	sys 0.008s
W20260709 12:17:28.943461 21002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.006s	sys 0.009s
W20260709 12:17:28.943758 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 960895us
I20260709 12:17:28.841679 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1466) took 1942 ms. Trace:
W20260709 12:17:28.880033 20999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.007s	sys 0.010s
W20260709 12:17:28.946560 20999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.008s	sys 0.010s
W20260709 12:17:28.947053 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 900986us
I20260709 12:17:28.948303 20999 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:27.828212 21738 rpcz_store.cc:276] 0709 12:17:26.194036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.202691 (+  8655us) service_pool.cc:224] Handling call
0709 12:17:26.357807 (+155116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.384709 (+ 26902us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:26.458523 (+ 73814us) log.cc:844] Serialized 14 byte log entry
0709 12:17:27.199068 (+740545us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b180016ee80. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b 00007fcb9f533d23 00007fcb9f53423a 00007fcb9f99ea2a
0709 12:17:27.646372 (+447304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:27.651663 (+  5291us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:27.654098 (+  2435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.667452 (+ 13354us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.675571 (+  8119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20318,"prepare.queue_time_us":26346,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":30885,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":17326848,"thread_start_us":392099,"threads_started":1,"wal-append.queue_time_us":1339219}
I20260709 12:17:28.944906 21105 rpcz_store.cc:276] 0709 12:17:26.899244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.527620 (+628376us) service_pool.cc:224] Handling call
0709 12:17:27.527885 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.528173 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.528200 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.634695 (+106495us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b2c0005c228. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:17:27.635074 (+   379us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.986678 (+351604us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:27.986726 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.986788 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.629455 (+642667us) raft_consensus.cc:1685] finished
0709 12:17:28.629475 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.841591 (+212116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48739,"raft.queue_time_us":10633,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":51478,"spinlock_wait_cycles":19066240,"thread_start_us":351334,"threads_started":1,"wal-append.queue_time_us":843786}
W20260709 12:17:28.462183 23572 consensus_meta.cc:287] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.000s
I20260709 12:17:28.954555 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:28.395318 23504 consensus_meta.cc:287] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 1.489s	user 0.007s	sys 0.004s
I20260709 12:17:28.388315 23644 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:28.995131 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:28.996534 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:28.996620 21111 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:28.997857 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:28.999452 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.001055 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:28.487172 23656 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:17:28.465410 23647 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
W20260709 12:17:29.029070 21151 leader_election.cc:336] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.237s (SENT)
I20260709 12:17:28.429983 23404 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:28.384727 23325 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.625388 23564 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:29.038916 21186 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.004s	sys 0.014s
W20260709 12:17:29.075466 21186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.008s	sys 0.014s
W20260709 12:17:29.002696 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.514353 23524 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:28.629725 23596 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:29.057006 23661 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:17:28.448551 23296 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:17:29.059473 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.086310 21108 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:29.001899 23572 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.063277 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:29.087371 21180 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:29.064114 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1365) took 1375 ms. Trace:
I20260709 12:17:29.065526 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1570) took 3508 ms. Trace:
I20260709 12:17:28.429656 23592 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:28.946561 23622 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:28.508072 23499 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:28.448145 23608 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:29.066655 23324 consensus_meta.cc:287] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.000s
I20260709 12:17:29.067371 23640 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:29.068653 23471 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.491420 23423 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:29.073377 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:28.924916 23543 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:28.466120 23603 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:28.936579 21109 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:28.395102 23490 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.080192 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.113741 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1480) took 1027 ms. Trace:
I20260709 12:17:29.113946 21105 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:29.036654 23408 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:29.083285 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 135035us
I20260709 12:17:28.508641 23599 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:29.007205 21107 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.008s	sys 0.012s
I20260709 12:17:29.121258 21032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e77746cf06a844b28506688985401b7d"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:29.006036 21002 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:17:28.494642 23502 consensus_meta.cc:287] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 1.074s	user 0.007s	sys 0.001s
W20260709 12:17:29.123812 21107 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.012s	sys 0.012s
I20260709 12:17:29.091675 23605 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:28.505635 23429 consensus_meta.cc:287] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.000s
W20260709 12:17:29.092361 21178 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.011s	sys 0.027s
W20260709 12:17:29.127576 21178 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.011s	sys 0.027s
W20260709 12:17:29.074536 23655 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:17:29.127667 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 121705us
I20260709 12:17:29.089039 21177 rpcz_store.cc:276] 0709 12:17:25.557092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.561174 (+  4082us) service_pool.cc:224] Handling call
0709 12:17:26.290105 (+728931us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:17:26.290273 (+   168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.608560 (+1318287us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b1800425680. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9f53c4bc 00007fcb9c88a48b 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a4455 00007fcb9f98c060 00007fcb9f98cbfb 00007fcb9f99764b
0709 12:17:27.608691 (+   131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.608714 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.609262 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.894013 (+284751us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:27.894051 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.894125 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.065336 (+1171211us) raft_consensus.cc:1685] finished
0709 12:17:29.065354 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.065471 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":145466,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5049,"spinlock_wait_cycles":22682624,"thread_start_us":442282,"threads_started":2,"wal-append.queue_time_us":360972}
I20260709 12:17:29.128393 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:29.128717 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:29.088027 21104 rpcz_store.cc:276] 0709 12:17:27.688979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.863097 (+174118us) service_pool.cc:224] Handling call
0709 12:17:27.863388 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.863742 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.863769 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.924931 (+ 61162us) log.cc:844] Serialized 26 byte log entry
0709 12:17:28.359585 (+434654us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:28.359634 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:28.359701 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.063898 (+704197us) raft_consensus.cc:1685] finished
0709 12:17:29.063918 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.064044 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36119,"raft.queue_time_us":5500,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":19663,"thread_start_us":378349,"threads_started":1,"wal-append.queue_time_us":1032851}
I20260709 12:17:29.036899 23304 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.078770 23564 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.106238 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.133414 21108 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:29.108112 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1482) took 1021 ms. Trace:
I20260709 12:17:29.135931 21111 rpcz_store.cc:276] 0709 12:17:28.086263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.997507 (+911244us) service_pool.cc:224] Handling call
0709 12:17:29.107654 (+110147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:29.075975 23404 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.118798 23423 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:28.481504 23610 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:29.078015 23589 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:29.114254 21109 rpcz_store.cc:276] 0709 12:17:28.085829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.364357 (+278528us) service_pool.cc:224] Handling call
0709 12:17:29.113678 (+749321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:29.114642 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1477) took 1029 ms. Trace:
I20260709 12:17:29.151432 21105 rpcz_store.cc:276] 0709 12:17:28.085208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.079807 (+994599us) service_pool.cc:224] Handling call
0709 12:17:29.114561 (+ 34754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:29.083139 23268 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:29.121316 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:29.121886 21032 raft_consensus.cc:606] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:29.152616 21032 raft_consensus.cc:614] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:29.084547 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.124302 21739 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:29.079149 23325 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.139391 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.124059 23408 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:28.496591 23594 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.111620 23324 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.153779 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 260) took 1069 ms. Trace:
I20260709 12:17:29.127233 23502 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.055990 23644 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:29.116722 23543 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.521520 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:29.514603 21179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1591) took 1885 ms (client timeout 2108 ms). Trace:
I20260709 12:17:29.204630 21032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:29.516134 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:29.527895 21179 rpcz_store.cc:269] 0709 12:17:27.629052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.754728 (+125676us) service_pool.cc:224] Handling call
0709 12:17:29.514410 (+1759682us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540001c2d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:29.514526 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426642816}
W20260709 12:17:29.270433 21028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.020s	sys 0.023s
I20260709 12:17:29.529036 21032 raft_consensus.cc:606] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:29.144609 23662 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.508896 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1372) took 1565 ms. Trace:
I20260709 12:17:29.528554 21104 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:29.527711 21110 rpcz_store.cc:276] 0709 12:17:28.084093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.059110 (+975017us) service_pool.cc:224] Handling call
0709 12:17:29.153714 (+ 94604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:29.547227 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1478) took 1461 ms. Trace:
W20260709 12:17:29.474359 21030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.079s	sys 0.123s
I20260709 12:17:29.191807 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 255) took 1110 ms. Trace:
W20260709 12:17:29.124951 21184 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.007s	sys 0.004s
W20260709 12:17:29.337842 21075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.027s	sys 0.028s
I20260709 12:17:29.251313 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1461) took 2353 ms. Trace:
I20260709 12:17:29.530819 21032 raft_consensus.cc:614] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:29.337492 21149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.333s	user 0.010s	sys 0.002s
I20260709 12:17:29.206265 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 286) took 1553 ms. Trace:
W20260709 12:17:29.521497 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 400216us
W20260709 12:17:29.477289 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 348942us
I20260709 12:17:29.154898 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:29.529295 21028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.027s	sys 0.026s
I20260709 12:17:29.521955 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.457672 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1573) took 3899 ms. Trace:
I20260709 12:17:29.246279 21741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 333) took 1596 ms. Trace:
I20260709 12:17:29.246917 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2061) took 1307 ms. Trace:
I20260709 12:17:29.195166 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2063) took 1255 ms. Trace:
W20260709 12:17:29.450456 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 396061us
I20260709 12:17:29.142715 23304 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.680910 21747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 599) took 2031 ms. Trace:
I20260709 12:17:29.680168 23419 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:29.521035 23507 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:29.698009 23507 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:29.204586 23589 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.187152 23268 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.561673 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1465) took 2662 ms. Trace:
W20260709 12:17:29.194285 23474 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.827s	user 0.007s	sys 0.001s
I20260709 12:17:29.701260 23474 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.397606 23506 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.585134 23662 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:29.614938 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1959) took 1696 ms. Trace:
I20260709 12:17:29.589534 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1586) took 1963 ms. Trace:
I20260709 12:17:29.701835 23525 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:29.548132 21184 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.554s	user 0.011s	sys 0.006s
I20260709 12:17:29.703500 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:29.523464 23597 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.703428 23525 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.559422 23526 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.515048 23397 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:29.509750 23633 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 1.904s	user 0.004s	sys 0.015s
I20260709 12:17:29.705598 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:17:29.697373 21075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.030s	sys 0.032s
I20260709 12:17:29.706212 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1237) took 2831 ms. Trace:
I20260709 12:17:29.713917 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:29.557217 21183 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:29.696941 21104 rpcz_store.cc:276] 0709 12:17:28.085414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.139133 (+1053719us) service_pool.cc:224] Handling call
0709 12:17:29.547164 (+408031us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:29.696256 21030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.339s	user 0.080s	sys 0.132s
W20260709 12:17:29.713922 21149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.709s	user 0.012s	sys 0.011s
W20260709 12:17:29.718609 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 1.71406e+06us
I20260709 12:17:29.715335 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1953) took 1798 ms. Trace:
I20260709 12:17:29.718771 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:29.700157 21185 rpcz_store.cc:276] 0709 12:17:27.653005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.384381 (+731376us) service_pool.cc:224] Handling call
0709 12:17:28.384652 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:28.392695 (+  8043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:28.392727 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:28.424393 (+ 31666us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.084766 (+660373us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:29.084803 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.084865 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.206060 (+121195us) raft_consensus.cc:1685] finished
0709 12:17:29.206081 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.206207 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7664,"raft.queue_time_us":25732,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":59548,"thread_start_us":459307,"threads_started":1,"wal-append.queue_time_us":584235}
I20260709 12:17:29.557861 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 256) took 1476 ms. Trace:
W20260709 12:17:29.718005 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 1.32166e+06us
W20260709 12:17:29.702085 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.714830 21034 rpcz_store.cc:276] 0709 12:17:26.874535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.874695 (+   160us) service_pool.cc:224] Handling call
0709 12:17:26.875009 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:26.889445 (+ 14436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:26.889477 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:26.889917 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.499732 (+609815us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:27.683854 (+184122us) log.cc:844] Serialized 14 byte log entry
0709 12:17:27.692539 (+  8685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.692624 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.398566 (+1705942us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:29.705938 (+307372us) raft_consensus.cc:1685] finished
0709 12:17:29.706030 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.706153 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14058,"prepare.queue_time_us":345374,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":23072,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":68813,"spinlock_wait_cycles":93409536,"thread_start_us":692510,"threads_started":2,"wal-append.queue_time_us":662304}
W20260709 12:17:29.215041 23540 consensus_meta.cc:287] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.915s	user 0.007s	sys 0.002s
I20260709 12:17:29.697201 21747 rpcz_store.cc:276] 0709 12:17:27.649215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.649388 (+   173us) service_pool.cc:224] Handling call
0709 12:17:27.649682 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.760818 (+111136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.760847 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.761285 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.973257 (+211972us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:27.973296 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.680534 (+1707238us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400288554. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:29.680576 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.680621 (+    45us) raft_consensus.cc:1685] finished
0709 12:17:29.680633 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.680848 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":934,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":37270,"spinlock_wait_cycles":254754688,"thread_start_us":211659,"threads_started":1,"wal-append.queue_time_us":589982}
I20260709 12:17:29.717856 21186 rpcz_store.cc:276] 0709 12:17:25.557943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.559380 (+  1437us) service_pool.cc:224] Handling call
0709 12:17:27.695339 (+2135959us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:17:27.695538 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.695738 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:27.981869 (+286131us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.457293 (+1475424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.457350 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:29.457399 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.457466 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.457609 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198,"prepare.queue_time_us":665445,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":10019,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":9865,"spinlock_wait_cycles":485178112,"thread_start_us":1710226,"threads_started":3,"wal-append.queue_time_us":1189602}
I20260709 12:17:29.715266 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:29.703073 21178 rpcz_store.cc:276] 0709 12:17:27.625885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.378328 (+752443us) service_pool.cc:224] Handling call
0709 12:17:28.413436 (+ 35108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.413648 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:29.128126 (+714478us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.589168 (+461042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.589227 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:29.589277 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.589346 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.589472 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9204,"prepare.queue_time_us":93154,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":76503,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":40053,"thread_start_us":1119980,"threads_started":2}
I20260709 12:17:29.725184 21105 rpcz_store.cc:276] 0709 12:17:28.081759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.557076 (+1475317us) service_pool.cc:224] Handling call
0709 12:17:29.557364 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.557541 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.557576 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.557619 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:29.557652 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.557701 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.557804 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:29.732288 21105 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:29.717429 21002 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:29.717603 21035 rpcz_store.cc:276] 0709 12:17:27.939191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.939317 (+   126us) service_pool.cc:224] Handling call
0709 12:17:27.970868 (+ 31551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.068256 (+ 97388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.246687 (+1178431us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b540042dbd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:29.246857 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220354432}
I20260709 12:17:29.734709 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:29.688241 23615 consensus_meta.cc:287] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.000s
I20260709 12:17:29.181423 23423 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:29.713654 21036 rpcz_store.cc:276] 0709 12:17:27.939949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.940073 (+   124us) service_pool.cc:224] Handling call
0709 12:17:27.940407 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.944751 (+  4344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.944779 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.945226 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:17:28.384501 (+439275us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:28.384564 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:28.384687 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.194938 (+810251us) raft_consensus.cc:1685] finished
0709 12:17:29.194960 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.195102 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3990,"raft.queue_time_us":60657,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":44628,"thread_start_us":390408,"threads_started":1,"wal-append.queue_time_us":1179943}
I20260709 12:17:29.720187 21183 rpcz_store.cc:276] 0709 12:17:27.916828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.556633 (+1639805us) service_pool.cc:224] Handling call
0709 12:17:29.556915 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.715111 (+158196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.715284 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:29.742218 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.695652 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 257) took 1613 ms. Trace:
I20260709 12:17:29.546926 21107 rpcz_store.cc:276] 0709 12:17:27.943227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.003385 (+ 60158us) service_pool.cc:224] Handling call
0709 12:17:28.003681 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.003878 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:29.124253 (+1120375us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.508525 (+384272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.508581 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:29.508635 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.508717 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.508834 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":442968,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":84,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":1459718,"threads_started":2}
I20260709 12:17:29.743532 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:29.730584 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 258) took 1647 ms. Trace:
I20260709 12:17:29.490695 23667 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:29.748685 21744 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:29.396085 23641 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:29.714284 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1488) took 1402 ms. Trace:
I20260709 12:17:29.697029 23502 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:29.714507 21741 rpcz_store.cc:276] 0709 12:17:27.650276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.651780 (+  1504us) service_pool.cc:224] Handling call
0709 12:17:27.652054 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.363433 (+711379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.246016 (+882583us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54002b2354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:29.246217 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627114752}
I20260709 12:17:29.738077 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:29.738433 21709 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:29.739091 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:29.740059 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:29.679630 23665 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.319s	user 0.000s	sys 0.000s
I20260709 12:17:29.740656 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:29.736809 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1475) took 1652 ms. Trace:
I20260709 12:17:29.713482 21106 rpcz_store.cc:276] 0709 12:17:26.898992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.525915 (+626923us) service_pool.cc:224] Handling call
0709 12:17:27.526213 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.645558 (+119345us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:27.972425 (+326867us) log.cc:844] Serialized 14 byte log entry
0709 12:17:28.338003 (+365578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:28.343126 (+  5123us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:28.343175 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.517427 (+1174252us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18003aca80. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240
0709 12:17:29.518154 (+   727us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18003aca80. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1
0709 12:17:29.519445 (+  1291us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b18003aca80. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:29.561020 (+ 41575us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b18003aca80. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419
0709 12:17:29.561450 (+   430us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000dd4d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:29.561488 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.561603 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27737,"prepare.queue_time_us":693826,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":96,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5814,"spinlock_wait_cycles":365191552,"thread_start_us":688772,"threads_started":2,"wal-append.queue_time_us":649633,"wal-append.run_cpu_time_us":1050,"wal-append.run_wall_time_us":1001077}
I20260709 12:17:29.702585 23662 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.792303 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:29.702894 21179 rpcz_store.cc:276] 0709 12:17:27.918114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.568051 (+1649937us) service_pool.cc:224] Handling call
0709 12:17:29.568348 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.614536 (+ 46188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.614569 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.614614 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:29.614657 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.614739 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.614874 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56253,"raft.queue_time_us":47317,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":37714}
W20260709 12:17:29.202369 23671 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:29.743206 21110 rpcz_store.cc:276] 0709 12:17:28.083412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.561013 (+1477601us) service_pool.cc:224] Handling call
0709 12:17:29.695172 (+134159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.695352 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.695374 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.695410 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:29.695445 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.695495 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.695593 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:29.509071 23635 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 1.903s	user 0.014s	sys 0.015s
W20260709 12:17:29.818620 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aaaf493e892d4ee9839b45b601fc8400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:29.735524 23474 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.696623 21103 rpcz_store.cc:276] 0709 12:17:26.898031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.492618 (+594587us) service_pool.cc:224] Handling call
0709 12:17:27.492896 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.810661 (+317765us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:28.069214 (+258553us) log.cc:844] Serialized 14 byte log entry
0709 12:17:28.816302 (+747088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:28.816362 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:28.816406 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.251075 (+434669us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400306454. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:29.251128 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.251251 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69161,"prepare.queue_time_us":550525,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":14266,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":29741,"spinlock_wait_cycles":730234112,"thread_start_us":991338,"threads_started":2,"wal-append.queue_time_us":1028275}
I20260709 12:17:29.519635 23572 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.559443 23325 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.244882 23470 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.733873 23594 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.516748 23544 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.733191 20999 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:29.559938 23644 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.818652 23593 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:29.753300 21108 rpcz_store.cc:276] 0709 12:17:28.311658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.143112 (+831454us) service_pool.cc:224] Handling call
0709 12:17:29.714227 (+571115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:29.550031 23490 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:29.204141 23404 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.705971 23525 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.791220 23397 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.852995 23502 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.793299 23637 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.746696 21104 rpcz_store.cc:276] 0709 12:17:28.083657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.729855 (+1646198us) service_pool.cc:224] Handling call
0709 12:17:29.730141 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.730305 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.730329 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.730369 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:29.730398 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.730445 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.730535 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:29.838740 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.904629 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.905135 21103 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:29.905980 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.906745 21103 raft_consensus.cc:2410] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:29.907466 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.907989 21103 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:29.908841 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.909742 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.910243 21103 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:29.839969 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.911175 21106 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:29.911924 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.912645 21106 raft_consensus.cc:2410] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:29.913302 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.913798 21106 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:29.815081 23552 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:29.819531 23596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.012s	sys 0.021s
W20260709 12:17:29.915130 23596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.012s	sys 0.021s
I20260709 12:17:29.824492 23643 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.792819 21105 rpcz_store.cc:276] 0709 12:17:28.084765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.731734 (+1646969us) service_pool.cc:224] Handling call
0709 12:17:29.731994 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.736573 (+  4579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.736754 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:29.916136 23643 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.916551 21180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1949) took 2000 ms. Trace:
I20260709 12:17:29.916958 21180 rpcz_store.cc:276] 0709 12:17:27.915842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.097820 (+1181978us) service_pool.cc:224] Handling call
0709 12:17:29.098171 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.101877 (+  3706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.101908 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.112451 (+ 10543us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.490421 (+377970us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:29.490465 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.490539 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.916328 (+425789us) raft_consensus.cc:1685] finished
0709 12:17:29.916351 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.916474 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6342,"raft.queue_time_us":3824,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":13054,"thread_start_us":342697,"threads_started":1,"wal-append.queue_time_us":723953}
I20260709 12:17:29.918159 23643 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:29.745486 23540 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.918391 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.919021 21033 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:29.920255 23540 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:29.849336 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 116225us
I20260709 12:17:29.850981 23572 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.923982 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:29.730911 23507 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:29.850446 23471 consensus_meta.cc:287] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.739s	user 0.009s	sys 0.000s
I20260709 12:17:29.547781 21109 rpcz_store.cc:276] 0709 12:17:28.081502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.155526 (+1074024us) service_pool.cc:224] Handling call
0709 12:17:29.191310 (+ 35784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.191496 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.191520 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.191563 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:29.191600 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.191649 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.191749 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:29.925091 21103 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:29.925346 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2066) took 1984 ms. Trace:
I20260709 12:17:29.925760 21109 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:29.831738 23408 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:29.753732 23615 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.925727 21030 rpcz_store.cc:276] 0709 12:17:27.940721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.941422 (+   701us) service_pool.cc:224] Handling call
0709 12:17:27.972708 (+ 31286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:28.233011 (+260303us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:28.356382 (+123371us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.716332 (+1359950us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.716783 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.716912 (+   129us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:29.716942 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.717156 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.925148 (+207992us) raft_consensus.cc:1685] finished
0709 12:17:29.925166 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.925294 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123262,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":92761,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":11794,"spinlock_wait_cycles":145280,"thread_start_us":1619339,"threads_started":2,"wal-append.queue_time_us":1485843}
I20260709 12:17:29.928486 23615 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.896689 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:29.929728 21181 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:29.915102 23552 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.932615 23552 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:29.935259 23324 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.936910 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:29.937907 23540 consensus_queue.cc:1059] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:29.938923 23588 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.939559 23423 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:29.939455 23588 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.939976 23423 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:29.940901 23423 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.941780 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2064) took 2001 ms. Trace:
I20260709 12:17:29.942201 21028 rpcz_store.cc:276] 0709 12:17:27.940211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.949407 (+  9196us) service_pool.cc:224] Handling call
0709 12:17:27.949702 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:28.351930 (+402228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:28.351959 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:28.360782 (+  8823us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.712870 (+1352088us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:29.712906 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.712967 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.941552 (+228585us) raft_consensus.cc:1685] finished
0709 12:17:29.941573 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.941707 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114624,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":1655222,"threads_started":2,"wal-append.queue_time_us":1406639}
I20260709 12:17:29.943909 23661 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:29.944285 23661 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.944617 23661 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:29.899596 23683 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.946084 23683 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.948222 23683 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.952378 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:29.942003 23423 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.954342 23668 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.954726 23668 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:29.955088 23668 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.956007 23431 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.960796 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:29.961179 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:29.755594 23667 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:29.792481 23641 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:29.902384 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 87150us
I20260709 12:17:29.751149 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:29.924530 21742 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:29.962417 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:29.967967 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 216897us
I20260709 12:17:29.899928 23644 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.847129 23594 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:29.975028 21149 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:29.899803 23544 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:29.918457 23543 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:29.966143 23470 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:30.010002 23544 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.012477 23544 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:29.970521 23474 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.015034 23474 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:30.015420 23474 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:30.024362 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 49397.6us
I20260709 12:17:30.025364 21149 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.026706 21742 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:30.029047 21000 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:30.070677 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 45357.3us
I20260709 12:17:29.943846 23637 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:30.099362 21077 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.033s	sys 0.047s
I20260709 12:17:30.100095 21149 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:30.103138 21077 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.033s	sys 0.047s
I20260709 12:17:29.970765 23641 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:30.103453 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 664535us
W20260709 12:17:30.110917 21182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1590) took 2478 ms (client timeout 3224 ms). Trace:
W20260709 12:17:30.111321 21182 rpcz_store.cc:269] 0709 12:17:27.628799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.805095 (+176296us) service_pool.cc:224] Handling call
0709 12:17:30.106679 (+2301584us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540001c7d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:30.106794 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451721600}
I20260709 12:17:29.903828 23593 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.034494 23205 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:30.112604 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2062) took 2173 ms. Trace:
I20260709 12:17:30.118156 21033 rpcz_store.cc:276] 0709 12:17:27.939601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.939704 (+   103us) service_pool.cc:224] Handling call
0709 12:17:27.945601 (+  5897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.919368 (+1973767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.112362 (+192994us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54003a4154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:30.112550 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4537966336}
W20260709 12:17:30.122294 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.122726 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.123540 23525 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.114915 21149 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:30.129956 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 413051us
I20260709 12:17:30.105441 23683 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:30.123960 23525 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:30.118559 23564 consensus_meta.cc:287] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.966s	user 0.009s	sys 0.000s
I20260709 12:17:30.107467 23360 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:30.133634 21104 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:30.136502 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:30.186854 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 50402us
W20260709 12:17:30.189172 21181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 1957) took 2266 ms (client timeout 1525 ms). Trace:
I20260709 12:17:30.193356 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:30.127139 23205 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:30.189612 21181 rpcz_store.cc:269] 0709 12:17:27.917695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.979038 (+ 61343us) service_pool.cc:224] Handling call
0709 12:17:30.183776 (+2204738us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54002625d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:30.183907 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4483789056}
I20260709 12:17:30.195415 21077 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.201031 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.137117 23431 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.207800 21077 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.133399 23683 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:30.136987 23525 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.224857 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.244688 21181 raft_consensus.cc:2376] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6. Re-sending same reply.
W20260709 12:17:30.194023 23475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.593s	user 0.034s	sys 0.074s
W20260709 12:17:30.245761 23475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.645s	user 0.035s	sys 0.076s
I20260709 12:17:30.245949 23602 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:30.246378 23602 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:30.246740 23602 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.247375 23475 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:30.247905 23475 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:30.248733 23475 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.251904 23641 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.257341 23696 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:30.257936 23696 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.211890 23431 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:30.259472 23431 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:30.262534 21739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 597) took 4053 ms (client timeout 1606 ms). Trace:
I20260709 12:17:30.200446 23205 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:30.262985 21739 rpcz_store.cc:269] 0709 12:17:26.209359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.214608 (+  5249us) service_pool.cc:224] Handling call
0709 12:17:27.813355 (+1598747us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b5800004598. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:17:30.262350 (+2448995us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400123754. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:30.262454 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933151872}
I20260709 12:17:30.267292 23526 consensus_queue.cc:1059] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:30.269703 23324 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:30.270047 23324 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:30.192771 23544 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:30.274747 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.300444 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 112555us
W20260709 12:17:30.305864 21709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.010s	sys 0.011s
W20260709 12:17:30.306259 21709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.010s	sys 0.011s
I20260709 12:17:30.193266 23471 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:30.306713 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 568303us
W20260709 12:17:30.307976 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.185915 23552 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:30.184520 23661 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.182039 23564 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.309288 21149 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:30.267222 23593 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:30.194881 23634 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:17:30.199667 23408 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:30.206710 23617 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.246182 23497 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.244050 23502 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.328297 21111 raft_consensus.cc:2393] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:30.315626 21184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.011s	sys 0.021s
I20260709 12:17:30.318562 21149 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:30.246196 23692 log.cc:927] Time spent T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:17:30.353266 23662 consensus_meta.cc:287] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 12:17:30.306876 23544 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.353973 23544 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:30.311542 21177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.009s	sys 0.026s
I20260709 12:17:30.305104 21738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 344) took 1202 ms. Trace:
I20260709 12:17:30.326050 23497 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.363816 23497 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.362572 21738 rpcz_store.cc:276] 0709 12:17:29.103111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.105640 (+  2529us) service_pool.cc:224] Handling call
0709 12:17:29.150006 (+ 44366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.181317 (+ 31311us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:29.697333 (+516016us) log.cc:844] Serialized 14 byte log entry
0709 12:17:30.202827 (+505494us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:30.209552 (+  6725us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:30.230934 (+ 21382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.245239 (+ 14305us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.301002 (+ 55763us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43738,"prepare.queue_time_us":641988,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":49,"raft.queue_time_us":64659,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":32758,"thread_start_us":926885,"threads_started":2,"wal-append.queue_time_us":641761}
I20260709 12:17:30.364409 23588 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.311383 23490 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:30.365309 23490 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.367367 23490 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.368377 23431 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.309404 23571 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:17:30.362504 23593 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:30.369958 23593 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.370330 23593 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.377274 23593 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.379443 23593 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.379848 23304 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.381130 23431 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.382043 23602 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.326655 23617 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.382982 23617 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.332150 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.383553 21103 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:30.384047 23497 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.384388 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.337597 23626 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:30.384953 23626 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:30.385949 23497 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.385771 23626 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.339671 21108 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:30.340205 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:30.322752 23596 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:30.386929 23626 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.314921 23471 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.387387 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.387523 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.388269 21103 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:30.388414 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.389035 23471 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.340881 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:30.345594 23668 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.349699 23397 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:30.350808 23637 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.389605 21110 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:30.391256 23668 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.346339 23696 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:30.374253 23205 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.299501 23683 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:30.362111 21177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.009s	sys 0.026s
I20260709 12:17:30.327301 23408 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:30.332044 21184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.011s	sys 0.021s
I20260709 12:17:30.384681 23474 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.389219 21109 raft_consensus.cc:2410] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:30.329782 23502 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:30.311271 21075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.019s	sys 0.002s
W20260709 12:17:30.434530 21075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.019s	sys 0.002s
I20260709 12:17:30.346969 23594 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.382066 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.394491 21149 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.397244 21107 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:17:30.440011 21107 pending_rounds.cc:85] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 7
I20260709 12:17:30.440291 21107 pending_rounds.cc:107] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:17:30.440594 21107 raft_consensus.cc:2889] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:30.441504 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:30.353469 23661 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.314083 23552 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.409128 21110 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:30.443586 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:30.444164 21110 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.445932 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:30.447757 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:30.446484 21109 raft_consensus.cc:2376] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6. Re-sending same reply.
I20260709 12:17:30.457386 21075 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:30.460146 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.460796 21109 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:30.445420 23659 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:30.464653 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 435653us
I20260709 12:17:30.472285 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.472944 21109 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:30.473420 23408 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.464294 23659 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:30.474268 23659 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.475925 23525 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.477414 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.478209 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1963) took 1542 ms. Trace:
I20260709 12:17:30.478464 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:30.479029 23602 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.464453 23588 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:30.340258 23564 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:30.398320 23398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.013s	sys 0.012s
W20260709 12:17:30.480952 23398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.013s	sys 0.012s
I20260709 12:17:30.411717 23490 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:30.481685 23490 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.483801 23490 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.479024 21105 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.428157 23506 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.396745 23662 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.489809 23659 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.490397 23662 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:30.440129 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 45724.3us
I20260709 12:17:30.491178 21738 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:30.399019 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:30.492110 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 93160.5us
I20260709 12:17:30.492599 23552 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:30.495009 23698 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:30.438694 23502 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.467620 23474 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:30.494525 21709 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.500118 23490 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:30.500847 23490 raft_consensus.cc:697] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:30.503312 23490 consensus_queue.cc:237] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.473800 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:30.504552 21109 raft_consensus.cc:2368] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7.
I20260709 12:17:30.505389 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:30.506469 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:30.497613 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 289856us
I20260709 12:17:30.511925 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:30.512326 23589 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:30.514094 21709 leader_election.cc:400] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7.
I20260709 12:17:30.514545 21709 leader_election.cc:403] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:30.515147 23634 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:30.415371 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 445827us
I20260709 12:17:30.517370 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:30.518564 23661 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:30.518949 23661 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.519312 23661 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:30.501617 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.491341 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.521451 21149 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.522465 21149 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.496018 21177 rpcz_store.cc:276] 0709 12:17:28.936090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.548046 (+611956us) service_pool.cc:224] Handling call
0709 12:17:29.548351 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.611321 (+ 62970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.611353 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.695375 (+ 84022us) log.cc:844] Serialized 26 byte log entry
0709 12:17:30.433001 (+737626us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:30.433046 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.433115 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.478012 (+ 44897us) raft_consensus.cc:1685] finished
0709 12:17:30.478030 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.478151 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85202,"raft.queue_time_us":62611,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":40373,"thread_start_us":675405,"threads_started":1,"wal-append.queue_time_us":721123}
W20260709 12:17:30.523366 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 298056us
I20260709 12:17:30.525202 21177 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:30.525653 21106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.026s	sys 0.062s
W20260709 12:17:30.526010 21106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.026s	sys 0.062s
I20260709 12:17:30.526638 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:30.526939 21149 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.528326 23544 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.530362 23544 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.523451 23552 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:17:30.532061 23602 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:30.532402 23602 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:30.533188 23602 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.534083 23602 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:30.535305 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.535952 21177 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:30.540172 23696 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.540582 23696 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:30.540946 23696 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.542341 21712 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:30.531000 23637 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:30.545653 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.523011 23594 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:30.549484 21105 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:30.551188 21105 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:30.414916 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 452530us
I20260709 12:17:30.552488 20999 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.553768 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.543783 23525 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.553412 21149 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.544178 23368 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:30.595558 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 351407us
I20260709 12:17:30.548059 23596 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:30.542944 23701 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:17:30.547833 23637 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:30.550803 23594 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:30.554589 23304 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.610854 23596 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.575799 23708 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:30.640769 23661 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.641762 23683 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.642475 23661 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.643944 23683 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.627530 23708 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.645663 23708 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:30.672008 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 118092us
W20260709 12:17:30.676370 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 149691us
I20260709 12:17:30.679942 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:30.681576 21036 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:30.686326 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:30.687577 21034 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:30.691949 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.579275 21110 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
W20260709 12:17:30.699074 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 146844us
I20260709 12:17:30.699204 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:30.700032 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 91207.2us
I20260709 12:17:30.700320 21034 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
W20260709 12:17:30.703470 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 308035us
I20260709 12:17:30.704234 21034 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:30.706888 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:30.707216 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:30.708005 21030 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:30.708194 21034 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.711793 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:30.712316 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1483) took 2496 ms. Trace:
I20260709 12:17:30.712728 21028 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:30.713687 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1486) took 2420 ms. Trace:
I20260709 12:17:30.714051 21111 rpcz_store.cc:276] 0709 12:17:28.292775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.144197 (+851422us) service_pool.cc:224] Handling call
0709 12:17:30.713249 (+1569052us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b5400228654. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:30.713507 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413227776}
I20260709 12:17:30.715595 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:30.719789 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.721527 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.722478 21181 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:30.723519 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.724562 21179 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:30.726125 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.726903 21177 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:30.727751 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:30.728763 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:30.729131 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:30.729650 21032 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:30.751657 21036 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:30.753553 21035 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
W20260709 12:17:30.754412 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.731295 21107 rpcz_store.cc:276] 0709 12:17:28.215655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.743930 (+1528275us) service_pool.cc:224] Handling call
0709 12:17:29.744197 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.441046 (+696849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.711828 (+270782us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b5400369cd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:30.712147 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501110016}
I20260709 12:17:30.759753 23268 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.760360 23268 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.760857 23268 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.606083 23617 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.626529 23594 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.613371 23259 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:30.764460 23525 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:17:30.775424 23304 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.776114 23304 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.611068 23368 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:30.777856 23368 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:30.627672 23596 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.769451 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:30.795120 23602 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.796057 23602 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.801481 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:30.802596 21104 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:30.802779 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:30.805490 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1964) took 1868 ms. Trace:
I20260709 12:17:30.814213 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:30.814986 21035 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:30.822122 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:30.822973 21031 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:30.823437 23423 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:30.823915 23423 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:30.824343 23423 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:30.825250 23205 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:30.832891 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:30.835551 23644 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:17:30.838420 21111 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:30.852516 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 85718.5us
I20260709 12:17:30.835497 23404 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:30.855657 23404 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:30.856051 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:30.805938 21183 rpcz_store.cc:276] 0709 12:17:28.936705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.746117 (+809412us) service_pool.cc:224] Handling call
0709 12:17:30.107212 (+361095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:30.114710 (+  7498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.114738 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:30.258226 (+143488us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b2c00061b88. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:17:30.258581 (+   355us) log.cc:844] Serialized 26 byte log entry
0709 12:17:30.608639 (+350058us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:30.608678 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.608750 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.702436 (+ 93686us) raft_consensus.cc:1685] finished
0709 12:17:30.702476 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.805028 (+102552us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540001c7d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:30.805202 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7091,"raft.queue_time_us":7886,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":1730,"spinlock_wait_cycles":837204480,"thread_start_us":349700,"threads_started":1,"wal-append.queue_time_us":375785}
I20260709 12:17:30.854228 23602 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:30.863579 23404 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.867177 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:30.867550 23368 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.871230 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:30.871833 23499 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:30.872038 21032 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:30.872607 23499 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:30.874627 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:30.875900 23725 log.cc:927] Time spent T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:17:30.875936 23608 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:30.872330 23368 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.875564 21739 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:30.885569 21183 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:30.887091 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.897804 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:30.860659 21151 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 3.365s (SENT) [suppressed 34 similar messages]
I20260709 12:17:30.900956 21034 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:30.871752 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:30.916736 21107 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:30.921546 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.925199 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.926653 23423 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:30.930397 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.925858 23499 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:30.935354 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.935892 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 76735.7us
I20260709 12:17:30.937705 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.938687 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.939453 21178 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:30.940634 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.942189 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:30.942945 21110 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:30.942951 21182 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:30.948577 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.949460 21149 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:30.950677 23543 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:30.951294 23543 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:30.952003 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.952395 23543 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.953780 23617 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:30.962709 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.927729 23637 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:30.988268 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:30.929448 23662 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.032918 21102 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:31.033733 23700 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.018458 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.035235 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.035584 21183 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:31.018882 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.037720 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1463) took 4136 ms. Trace:
I20260709 12:17:31.034281 23324 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:31.014273 23268 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.052052 21102 rpcz_store.cc:276] 0709 12:17:26.898503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.502406 (+603903us) service_pool.cc:224] Handling call
0709 12:17:27.502682 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.033371 (+3530689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.034542 (+  1171us) spinlock_profiling.cc:243] Waited 3.46 s on lock 0x7b5400180e54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:31.034785 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7966246656}
I20260709 12:17:31.085477 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.094682 23280 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:31.095495 23280 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.096791 23423 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:31.097626 23324 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.100133 23268 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:31.102115 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 1946) took 3566 ms. Trace:
I20260709 12:17:31.102530 21184 rpcz_store.cc:276] 0709 12:17:27.535529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.818612 (+283083us) service_pool.cc:224] Handling call
0709 12:17:27.822231 (+  3619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.987302 (+165071us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:29.713184 (+1725882us) log.cc:844] Serialized 14 byte log entry
0709 12:17:30.778647 (+1065463us) spinlock_profiling.cc:243] Waited 961 us on lock 0x7b180044d820. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9f53c4bc 00007fcb9c88a48b 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b 00007fcb9f533d23 00007fcb9f53423a
0709 12:17:30.902034 (+123387us) log.cc:844] Serialized 14 byte log entry
0709 12:17:30.923093 (+ 21059us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:31.078104 (+155011us) log.cc:844] Serialized 26 byte log entry
0709 12:17:31.082234 (+  4130us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:31.082300 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.085916 (+  3616us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:31.101716 (+ 15800us) raft_consensus.cc:1685] finished
0709 12:17:31.101736 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.101919 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46814,"prepare.queue_time_us":547400,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":97715,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":10350,"spinlock_wait_cycles":21695616,"thread_start_us":2518737,"threads_started":3,"wal-append.queue_time_us":690742}
W20260709 12:17:31.111182 23502 consensus_meta.cc:287] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.025s
I20260709 12:17:31.111641 23502 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.112251 23507 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.113762 23502 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:31.116729 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 124355us
W20260709 12:17:31.114877 23634 consensus_meta.cc:287] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.013s
I20260709 12:17:31.117846 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.118597 21178 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:31.119056 23634 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7.
I20260709 12:17:31.120340 21104 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:31.131580 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:31.117867 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.133930 23686 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.034304 23700 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.134528 23686 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.136138 23659 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:31.136973 23497 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:31.138104 23686 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:31.035259 23662 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.140916 23662 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:31.141956 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:31.142684 21109 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.146430 23423 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:31.146795 21033 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:31.148743 21036 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:31.147500 21031 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:31.147652 23423 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:31.150202 21109 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
W20260709 12:17:31.151253 23741 log.cc:927] Time spent T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:17:31.149680 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.156025 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.156840 21034 raft_consensus.cc:2410] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:31.157426 21111 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:31.090907 23667 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:31.174642 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.180835 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.165719 23423 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:31.167945 23700 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:31.184804 21178 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:17:31.184048 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.213557 21034 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:31.219913 21036 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:17:31.220001 21107 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
W20260709 12:17:31.223074 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 44517.6us
I20260709 12:17:31.235240 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.245118 21149 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:31.247233 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:31.248621 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.251276 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.252184 21180 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:31.253674 21182 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:31.258728 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.259485 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:31.264736 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.267199 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.272362 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:31.273571 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:31.275035 23280 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:31.276163 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:31.277730 23596 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.278759 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:31.279431 23708 consensus_meta.cc:287] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.002s
I20260709 12:17:31.279991 21102 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:31.281370 21712 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:31.281891 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:31.284082 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:31.313412 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.291728 23700 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:31.292407 23497 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:31.296339 23506 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.809s	user 0.008s	sys 0.003s
I20260709 12:17:31.325100 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.335366 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.335706 21030 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.336536 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.337579 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.338372 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:31.311589 23696 consensus_meta.cc:287] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.005s
I20260709 12:17:31.339001 21034 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:31.339617 23696 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.340297 23596 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:31.299355 23736 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.078s	user 0.003s	sys 0.000s
I20260709 12:17:31.341189 23423 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:31.324705 21104 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:31.341898 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.342561 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:31.342995 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.343328 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:31.343673 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:31.343863 21035 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.344444 21104 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:31.343705 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.346155 21028 raft_consensus.cc:2410] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:31.346583 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.347074 23495 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.347446 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.347652 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.348263 21180 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.348707 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:31.349375 21104 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:31.311203 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.348268 21028 raft_consensus.cc:2393] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.327633 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:31.312536 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 74710us
I20260709 12:17:31.346191 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:31.334534 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:31.306680 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 126564us
I20260709 12:17:31.289960 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:31.315882 23700 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:31.341675 23696 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:31.317981 23733 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:17:31.318984 23683 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:31.320315 23593 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:31.321054 21105 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:31.318611 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.313993 23708 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.332947 21108 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:31.299654 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.302404 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.367673 21036 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:31.325098 21109 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:17:31.338572 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.322832 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.316363 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:31.359711 21027 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.361271 21183 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:31.361755 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 80634.5us
I20260709 12:17:31.369879 21031 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:31.360956 21181 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.368759 21030 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:31.372067 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.372790 21034 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.373812 21111 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:31.374570 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.375141 21182 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.376825 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.376997 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.377540 21028 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.377632 21031 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:31.383957 21035 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:31.395030 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.396137 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.396683 21036 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:31.399101 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.399675 21111 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:31.399888 21178 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:31.400877 21178 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:31.403076 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.403713 21034 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:31.404599 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.387077 23683 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:31.406878 21110 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:31.407608 21185 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:31.369014 23667 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:31.388311 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:31.412927 21178 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:31.415328 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.341753 23423 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:31.418591 21105 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:31.327857 23497 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:31.421090 21149 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:31.422092 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.425485 21030 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.396698 23708 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:31.430095 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:31.432436 21035 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:31.347645 23495 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:31.426030 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:31.404441 23593 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:31.432263 21027 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:31.439029 21107 raft_consensus.cc:2368] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7.
I20260709 12:17:31.439283 21034 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:31.444818 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 59009.4us
I20260709 12:17:31.441807 21150 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:31.451566 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.448935 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.453099 21183 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:31.432089 23634 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:31.459590 21742 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:31.473655 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:31.484854 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.485654 21149 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:31.475179 21031 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:31.453613 21027 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.493052 21180 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:31.496703 21186 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:31.487795 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:31.501355 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.502146 21182 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:31.504602 21031 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:31.467796 23431 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.000s	sys 0.013s
I20260709 12:17:31.505399 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.455246 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:31.449285 23667 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:31.513705 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:31.516312 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.508322 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.456123 23423 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:31.521924 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 243566us
W20260709 12:17:31.511664 23431 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.000s	sys 0.014s
I20260709 12:17:31.449707 23637 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:31.516701 21182 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:31.462066 21737 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:31.518563 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.480597 23683 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:31.468888 23497 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:31.517180 21030 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:31.540760 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:31.522070 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 76603.1us
I20260709 12:17:31.521938 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1401) took 1173 ms. Trace:
I20260709 12:17:31.601223 21034 raft_consensus.cc:2393] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.599380 21031 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:31.469955 23564 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 12:17:31.511093 23740 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:31.515349 21739 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
W20260709 12:17:31.611539 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.614259 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:31.614615 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 183859us
I20260709 12:17:31.615549 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:31.539018 23304 consensus_meta.cc:287] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.010s
I20260709 12:17:31.617529 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.619935 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.629190 21027 raft_consensus.cc:2393] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.603224 23637 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:31.607795 23506 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.622054 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.643740 21034 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.623733 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.616416 23700 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:31.648319 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.630059 23711 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:17:31.646310 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:31.648955 21027 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:31.631315 23525 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:31.564990 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.601404 21108 rpcz_store.cc:276] 0709 12:17:30.348697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.387300 (+ 38603us) service_pool.cc:224] Handling call
0709 12:17:31.516757 (+1129457us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b540036a1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:31.521880 (+  5123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2172538240}
I20260709 12:17:31.558915 23507 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.655045 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:31.671125 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 202689us
I20260709 12:17:31.657065 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:31.686875 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.691542 21028 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:31.694522 21181 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:31.632885 23304 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.653702 23696 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:31.654515 23740 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.719866 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.726246 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:31.732019 21035 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:31.618788 23593 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.734090 21031 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:31.738468 21179 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:31.713367 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:31.686275 23506 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:31.654107 23667 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:31.749382 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:31.988814 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 311557us
I20260709 12:17:31.807482 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:31.725988 23750 log.cc:927] Time spent T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:17:31.992197 21030 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.998881 21034 raft_consensus.cc:2368] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6.
I20260709 12:17:31.999835 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:31.993832 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 305215us
W20260709 12:17:31.746706 23745 log.cc:927] Time spent T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 12:17:31.746941 23594 consensus_meta.cc:287] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.014s
W20260709 12:17:31.748639 23755 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:17:31.737489 23495 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:31.843884 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:31.746904 23749 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 12:17:31.872990 23756 log.cc:927] Time spent T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:32.017006 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:31.726943 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:31.690471 23507 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:31.960163 23497 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:31.897329 23759 log.cc:927] Time spent T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.003s
I20260709 12:17:31.923306 23628 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:17:31.873524 23758 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 12:17:32.034409 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:31.812263 21737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 342) took 3184 ms. Trace:
I20260709 12:17:31.993491 23525 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:31.727325 23740 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.041535 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:32.048913 21028 raft_consensus.cc:2368] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5.
I20260709 12:17:32.031284 23280 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:31.746901 23611 consensus_queue.cc:1059] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.326s
W20260709 12:17:32.056974 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.045640 23711 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:31.843345 23637 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.054042 23696 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:32.036351 23594 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.063271 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:32.069602 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.069113 21743 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:32.071110 21102 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:32.063951 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:32.074405 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:32.074743 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 268826us
I20260709 12:17:32.051368 23628 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:32.085047 23628 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.082932 21105 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.087241 23611 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:32.087354 23495 raft_consensus.cc:3055] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:32.087802 23495 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:32.088220 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.089200 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.053902 23617 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:32.068625 23753 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.065s	user 0.005s	sys 0.002s
I20260709 12:17:32.091831 21034 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:32.082895 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.083765 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:32.092803 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 126876us
I20260709 12:17:32.093058 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.057341 21737 rpcz_store.cc:276] 0709 12:17:28.627886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.799124 (+171238us) service_pool.cc:224] Handling call
0709 12:17:29.035876 (+236752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.602397 (+2566521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.811943 (+209546us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b54006a6b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:31.812187 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5554260224}
I20260709 12:17:32.067185 23304 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:32.100032 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:32.100287 21107 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.096580 23259 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:32.101680 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.105830 21109 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:32.103025 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.107787 21034 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:32.105003 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.113269 21182 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:32.063639 23497 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:32.120965 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 482250us
I20260709 12:17:32.121109 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.099186 23423 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.124228 21034 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:32.101692 23259 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.127108 21712 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:32.128578 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 1968) took 1186 ms. Trace:
W20260709 12:17:32.132597 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 422978us
I20260709 12:17:32.115428 23628 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.134742 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.135669 21027 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:32.128919 21179 rpcz_store.cc:276] 0709 12:17:30.936891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.955397 (+ 18506us) service_pool.cc:224] Handling call
0709 12:17:32.123341 (+1167944us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540015ed54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:32.123457 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611339136}
I20260709 12:17:32.087774 23611 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.118106 23634 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:32.127787 23259 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:32.147003 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1413) took 1143 ms. Trace:
W20260709 12:17:32.147650 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:32.150112 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 66450.7us
I20260709 12:17:32.146699 21108 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:32.147820 21107 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:32.153749 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.148751 21106 rpcz_store.cc:276] 0709 12:17:30.952000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.952783 (+   783us) service_pool.cc:224] Handling call
0709 12:17:30.953148 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:30.953695 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.953720 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:30.954268 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:17:31.306120 (+351852us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:31.306162 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.306223 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.095416 (+789193us) raft_consensus.cc:1685] finished
0709 12:17:32.095435 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.095565 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":815,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":351489,"threads_started":1,"wal-append.queue_time_us":471339}
I20260709 12:17:32.138002 23711 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:32.157768 21027 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:32.159329 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.155727 23507 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:32.173223 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:32.173820 21107 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:17:32.176788 23497 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:32.174583 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1411) took 1224 ms. Trace:
I20260709 12:17:32.183045 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.153350 23423 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.190963 21105 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:32.192481 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:32.169768 23506 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:32.196372 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:32.204263 23771 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:17:32.156658 23696 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.181751 21103 rpcz_store.cc:276] 0709 12:17:30.900029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.903458 (+  3429us) service_pool.cc:224] Handling call
0709 12:17:30.961435 (+ 57977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:31.110291 (+148856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.110319 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:31.110911 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:17:31.357617 (+246706us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:31.357665 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.357726 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.121946 (+764220us) raft_consensus.cc:1685] finished
0709 12:17:32.121962 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.122067 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50220,"raft.queue_time_us":75687,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":325,"thread_start_us":246361,"threads_started":1,"wal-append.queue_time_us":385561}
W20260709 12:17:32.208146 23765 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:32.210229 21711 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:32.201992 23507 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:32.212936 21149 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.213685 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:32.214244 23431 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:32.214684 23431 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.215019 23431 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.216310 21737 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:32.217347 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.218402 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.214298 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.219177 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:32.220523 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.220865 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.221239 21033 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:32.221437 21028 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.221975 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.191468 23761 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:32.203579 23641 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:32.220477 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.252679 21029 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:32.164856 23525 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.255330 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.253036 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:32.258908 21034 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:32.259691 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.225764 23761 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.260272 21027 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:32.258446 21075 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.270366 21149 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.199419 23711 consensus_queue.cc:1059] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:17:32.233100 23506 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:32.288690 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.290453 21033 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:32.291793 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 119221us
I20260709 12:17:32.253908 23641 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:32.303670 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 178285us
I20260709 12:17:32.300922 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.252097 23304 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:17:32.278211 23507 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:32.273902 23761 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:32.304716 21149 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.312863 23615 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:17:32.314191 21077 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.314863 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:32.315603 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:32.317440 21028 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:32.318331 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.320221 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.321379 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:32.291520 23594 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:32.289328 23506 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:32.322105 21737 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:32.322395 23506 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.323145 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:32.302102 23641 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.327221 23497 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:32.327693 23497 raft_consensus.cc:697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:32.328516 23497 consensus_queue.cc:237] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.331130 23643 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:32.331610 23544 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:32.332890 23423 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:32.333623 23423 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:32.334734 23611 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:32.335228 21076 leader_election.cc:336] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.504s (SENT)
I20260709 12:17:32.335704 21076 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:32.337846 21076 leader_election.cc:336] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.525s (SENT)
I20260709 12:17:32.338227 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:32.311131 23677 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:32.311496 23507 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:32.339705 23507 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.343006 23617 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:32.343662 23617 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:32.344250 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:32.344883 21179 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:32.321424 21030 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:32.333623 21150 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:32.345407 23677 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:32.353051 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.358592 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:32.360278 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 55636.8us
I20260709 12:17:32.361279 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:32.395407 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:32.396126 21182 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:32.397814 21151 leader_election.cc:336] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.566s (SENT)
I20260709 12:17:32.402506 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.398036 23615 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:32.407143 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:32.407344 23615 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:32.407696 21076 leader_election.cc:336] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.680s (SENT)
I20260709 12:17:32.407876 21178 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:32.408123 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:32.417127 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:32.417788 21177 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.310911 23773 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:17:32.421659 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:32.422497 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:32.420598 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:32.362387 23740 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:32.397698 23594 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:32.426484 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:32.431807 21104 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.427109 21032 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.427057 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:32.426692 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:32.433001 21184 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
W20260709 12:17:32.427327 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 266469us
I20260709 12:17:32.345595 23495 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.404246 23711 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:32.437319 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:32.440164 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 124615us
W20260709 12:17:32.444067 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 119711us
I20260709 12:17:32.422142 23778 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:32.437566 23617 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:32.435164 23594 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.437422 23544 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.438395 23711 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:32.457684 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:32.468984 21182 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
W20260709 12:17:32.475718 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 94527.6us
I20260709 12:17:32.427646 23259 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.489643 21077 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:32.490674 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 112945us
I20260709 12:17:32.464052 23594 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.472362 23711 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:32.503525 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 95862.8us
W20260709 12:17:32.492779 21711 leader_election.cc:336] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.716s (SENT)
I20260709 12:17:32.430572 23615 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.507638 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:32.507807 21151 leader_election.cc:336] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.589s (SENT)
W20260709 12:17:32.511672 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 77908.3us
I20260709 12:17:32.490942 23495 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.463863 23778 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:32.532966 21076 leader_election.cc:336] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.697s (SENT)
I20260709 12:17:32.475171 23785 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:17:32.484331 23544 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:32.564193 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 50798.1us
W20260709 12:17:32.566174 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 73422.9us
W20260709 12:17:32.568583 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 79025.6us
I20260709 12:17:32.535576 23667 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:32.535440 23617 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:32.572497 21104 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
W20260709 12:17:32.573812 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 73387.7us
I20260709 12:17:32.472498 23677 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.560408 23777 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:32.586483 23781 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:17:32.587028 23259 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:32.587654 23784 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:17:32.588003 23770 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:17:32.588764 23471 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:17:32.590699 23793 consensus_queue.cc:1059] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:32.560256 23626 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
W20260709 12:17:32.596618 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 83995us
I20260709 12:17:32.596851 23792 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:32.597308 23792 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:32.612193 23783 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:17:32.582743 23617 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:32.580974 23798 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:32.624188 21077 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.628477 21185 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:32.629005 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 51848.9us
W20260709 12:17:32.631637 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:32.636227 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 191107us
W20260709 12:17:32.630504 21076 leader_election.cc:336] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.752s (SENT)
I20260709 12:17:32.636924 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:32.637259 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 68899.1us
I20260709 12:17:32.639042 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:32.639789 21182 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:32.640065 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:32.646054 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:32.651012 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:32.652546 23617 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.636401 23786 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:32.651751 23543 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:32.652719 23788 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:17:32.676156 23641 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:32.665061 23782 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:17:32.621001 23777 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.665385 23259 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:32.681769 20999 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:32.696072 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 69691.5us
W20260709 12:17:32.681293 23628 consensus_meta.cc:287] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.001s
I20260709 12:17:32.667466 23506 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.711933 21181 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:32.715859 21177 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
W20260709 12:17:32.717129 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 53057.7us
I20260709 12:17:32.717092 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:32.718868 21032 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:32.711403 23786 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:32.723197 21177 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:32.659621 23792 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:32.729880 21076 leader_election.cc:336] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.931s (SENT)
I20260709 12:17:32.730312 21076 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:32.751847 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.727041 23785 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:32.782146 21739 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:32.785393 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:32.705709 23431 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:32.785089 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 68056.4us
I20260709 12:17:32.737939 23544 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:32.779790 23792 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.739341 23259 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:32.794055 21151 leader_election.cc:336] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.872s (SENT)
I20260709 12:17:32.800439 23431 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:32.801409 23594 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.779524 23778 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:32.805469 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 83265.9us
I20260709 12:17:32.812645 23802 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:17:32.793769 23804 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:32.795686 23787 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 12:17:32.804489 23801 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:17:32.831576 23641 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:32.822911 23800 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:32.847088 21076 leader_election.cc:336] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.049s (SENT)
I20260709 12:17:32.849021 23506 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:32.828859 23778 raft_consensus.cc:2764] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:17:32.850978 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 63216.7us
W20260709 12:17:32.922590 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:32.923187 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 71599.5us
I20260709 12:17:32.858654 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:32.925836 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:32.855671 23809 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:17:32.860065 23790 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.367s	user 0.003s	sys 0.000s
W20260709 12:17:32.940721 21151 leader_election.cc:336] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.958s (SENT)
W20260709 12:17:32.938591 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.946985 21151 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:32.946580 23471 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:32.937201 23507 consensus_meta.cc:287] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 12:17:32.924377 23777 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:32.928053 23785 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:32.831018 23786 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.939605 23798 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:32.985005 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.948925 23778 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.000069 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:33.000859 23431 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:33.001374 23431 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:33.009975 21107 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:32.853773 23711 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.977728 23543 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.002249 23431 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:32.938882 23423 consensus_queue.cc:1059] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:17:32.976951 23507 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.939002 23800 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.987108 23785 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:32.950095 23471 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:33.015661 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:33.016230 23817 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:33.016606 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 169557us
W20260709 12:17:33.016706 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 92507.2us
I20260709 12:17:33.065161 21180 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:33.065490 23643 consensus_queue.cc:1059] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:33.018299 23711 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:33.019578 23634 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:33.019928 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:33.034152 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.034650 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.037214 21104 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:33.019235 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.015450 21743 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:33.074110 21109 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
W20260709 12:17:33.052428 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 111732us
I20260709 12:17:33.086835 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:33.039093 23796 log.cc:927] Time spent T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.386s	user 0.003s	sys 0.001s
W20260709 12:17:33.025650 23761 consensus_meta.cc:287] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.667s	user 0.000s	sys 0.008s
W20260709 12:17:33.041787 23776 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.560s	user 0.001s	sys 0.010s
I20260709 12:17:33.049717 23793 raft_consensus.cc:3055] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:33.028556 23594 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:33.025988 23498 raft_consensus.cc:3055] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:33.038355 23506 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.109366 23617 raft_consensus.cc:3055] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:33.096484 23634 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.073647 23798 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:33.135126 21076 leader_election.cc:336] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.092s (SENT)
I20260709 12:17:33.109663 23808 consensus_queue.cc:1059] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:17:33.020140 23821 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.109275 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:33.181346 21744 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:33.096164 23423 consensus_queue.cc:1059] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:17:33.012763 23778 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.043817 23507 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:33.136451 21151 leader_election.cc:336] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.050s (SENT)
I20260709 12:17:33.136893 20999 leader_election.cc:400] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7.
I20260709 12:17:33.187093 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:33.051994 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:33.047752 23785 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:33.142786 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:33.190493 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 47792.1us
I20260709 12:17:33.040354 23800 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:33.178624 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:33.179033 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:33.179378 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:33.180435 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:33.092093 23817 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.110304 23793 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:33.188550 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:33.188608 20999 leader_election.cc:403] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:33.188933 21741 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.144323 23498 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:33.180056 23798 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:33.192863 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:33.148943 23617 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:33.185495 23821 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.201845 21111 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:33.206398 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 114341us
I20260709 12:17:33.150949 23792 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:17:33.192508 23626 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.173805 23506 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:33.213493 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 77098.9us
I20260709 12:17:33.138311 23761 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:33.221766 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 86695.4us
W20260709 12:17:33.223542 21151 leader_election.cc:336] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.200s (SENT)
I20260709 12:17:33.224002 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.214701 23805 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:17:33.212990 23740 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:33.210930 23798 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7.
I20260709 12:17:33.230451 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.221843 23788 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.234933 21742 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:33.238483 21076 leader_election.cc:336] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.102s (SENT)
I20260709 12:17:33.238796 23828 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:33.239266 23828 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:33.239605 23828 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.226648 23792 consensus_queue.cc:1243] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer a1b891e53adc40a6a1ae813238321e93 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:17:33.241511 21076 leader_election.cc:336] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.189s (SENT)
I20260709 12:17:33.210552 23696 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 12:17:33.243978 21076 leader_election.cc:336] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.227s (SENT)
I20260709 12:17:33.251092 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:33.244285 23793 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.238513 23794 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:33.235553 23740 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.272239 21741 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:33.273422 21150 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:33.273793 21111 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:33.271636 21746 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:33.246816 23775 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.247524 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:33.246153 23821 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:33.280586 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:33.246465 23634 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:33.283746 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.279436 21103 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:17:33.280246 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 57115.7us
I20260709 12:17:33.282691 21109 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:33.276357 23788 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.283926 21747 raft_consensus.cc:2410] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:17:33.293716 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 70207.8us
I20260709 12:17:33.281275 21076 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:33.276316 23740 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:33.347011 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 63440us
I20260709 12:17:33.284314 23594 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:33.324710 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.361809 23778 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:33.361910 23543 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:33.280001 23814 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 12:17:33.374092 21151 leader_election.cc:336] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.477s (SENT)
I20260709 12:17:33.374989 23778 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:33.375406 23304 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.376175 23821 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:33.376688 23821 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.383423 23506 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:33.383960 23506 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.384374 23506 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.386312 23506 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:33.387570 23825 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:17:33.388998 23832 log.cc:927] Time spent T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:17:33.391737 21740 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:33.392416 21106 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:33.393417 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.395810 21742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 384) took 1183 ms. Trace:
I20260709 12:17:33.396173 21742 rpcz_store.cc:276] 0709 12:17:32.212339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.212487 (+   148us) service_pool.cc:224] Handling call
0709 12:17:32.212771 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.238005 (+1025234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.395572 (+157567us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54006d83d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:33.395734 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2346544000}
I20260709 12:17:33.397615 21746 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.272243 23617 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.399996 23617 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.402273 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.402071 23498 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.403527 23498 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.404906 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.406363 21030 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:33.407123 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.407721 21032 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:33.407807 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:33.407461 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.409410 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:33.409741 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.409439 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.410333 21028 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:33.409005 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:33.410820 23641 consensus_queue.cc:1175] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 12:17:33.411480 21106 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:33.406467 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.408953 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.410377 21034 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:33.417426 21102 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.419035 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.419902 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:33.420738 23785 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:33.421125 23785 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:33.421976 23785 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.424978 21107 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:17:33.425364 21107 pending_rounds.cc:85] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 2
I20260709 12:17:33.425590 21107 pending_rounds.cc:107] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 12:17:33.425681 23826 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:17:33.425863 21107 raft_consensus.cc:2889] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:33.427546 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:33.428521 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.429011 21109 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:33.429827 21110 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:17:33.430724 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:33.374558 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.349687 23793 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.439316 21075 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:33.440651 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 93024.2us
W20260709 12:17:33.442003 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 160810us
I20260709 12:17:33.442346 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.447362 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:33.448084 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:33.452106 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.382743 23761 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:33.455701 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:33.459286 21747 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:33.456941 21109 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:17:33.460166 21031 raft_consensus.cc:3055] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:33.460515 21031 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:33.461118 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:33.462623 23611 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:33.464243 21107 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:33.465430 21709 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:33.443202 23817 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:33.456465 23785 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.455830 23497 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:33.375512 23778 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.450294 23594 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:33.458292 23774 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.443096 23811 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:17:33.463150 23611 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:33.477583 21002 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.479825 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.455485 23800 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:17:33.471835 23761 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:33.485080 21034 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.481063 21031 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.483992 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.485982 21028 raft_consensus.cc:2376] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7. Re-sending same reply.
I20260709 12:17:33.455605 23786 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:17:33.470729 23805 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:33.489001 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 128557us
I20260709 12:17:33.478324 23497 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:33.475569 23817 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:17:33.491448 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.491647 21031 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.492147 21028 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:33.487563 23761 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.501518 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.500854 23761 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.499892 23643 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.503531 23737 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:33.502110 23677 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.505560 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.513051 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.512840 23471 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.513873 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.514961 23821 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:33.515235 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.515676 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.516319 23497 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.518206 23800 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:33.518994 23611 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.520358 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.521677 23788 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.515156 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:33.526185 23833 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:17:33.526891 23740 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.615618 23740 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:33.583546 23798 consensus_queue.cc:1059] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:33.618378 23798 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:33.618710 23798 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:33.619524 23798 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.620642 23798 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.604087 23677 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.529762 23792 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:33.626495 23792 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:33.627432 23792 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.628368 23792 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:33.531306 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.534317 23304 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.629537 21035 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:33.536978 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.630574 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.630759 23737 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.629774 23304 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:33.631543 23304 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:33.632675 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.632418 23304 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.633275 21027 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
W20260709 12:17:33.538484 23830 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:17:33.634116 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.539093 23828 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.631078 23471 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.636626 23828 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:33.545382 23774 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:33.546679 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:33.631301 21036 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:33.638190 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.638655 23774 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:33.639210 23774 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:33.639593 23774 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.551208 21108 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:33.639609 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:33.642886 21744 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.554996 23594 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:33.556387 23837 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:33.559243 23786 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:33.646944 23786 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:33.647769 23786 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.648813 23786 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:33.601325 23800 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:33.650106 23800 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.651211 23800 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.560840 23778 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:33.495421 23811 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.652451 21028 raft_consensus.cc:2376] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5. Re-sending same reply.
I20260709 12:17:33.562062 21031 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:33.550474 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:33.655458 23423 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:17:33.655735 23811 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.568262 21034 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
W20260709 12:17:33.658017 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 111401us
I20260709 12:17:33.659019 23304 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.659638 23677 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:33.660486 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.661176 21031 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:33.661788 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 124885us
I20260709 12:17:33.662631 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:33.663865 21151 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.666618 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.666774 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:33.667003 23683 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:33.667507 21746 raft_consensus.cc:2393] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:17:33.667780 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 169408us
I20260709 12:17:33.668958 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.669147 21711 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:33.669996 21002 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.670387 23711 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:33.670763 23711 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:33.671170 23711 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.672370 23811 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.575266 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:33.582927 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 131895us
I20260709 12:17:33.673002 23811 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.674751 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:33.586179 21107 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.587801 21109 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.547370 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:33.680732 23740 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.593171 21029 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:33.684054 23821 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.593120 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.687258 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:33.687922 21739 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:33.687983 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.689117 21150 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:33.689899 23677 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.667649 23683 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.691196 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.691916 23683 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.694000 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.694659 23304 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.634634 21027 raft_consensus.cc:2376] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7. Re-sending same reply.
I20260709 12:17:33.654753 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.697731 21028 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:33.698499 21102 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:33.700935 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 150506us
I20260709 12:17:33.703308 23811 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:33.704005 23778 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.705349 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.690594 23507 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:33.706140 21002 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.596227 21032 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:33.596175 21030 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:33.606413 21103 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.610628 20933 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 6, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:33.638712 21036 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
W20260709 12:17:33.566468 23799 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.385s	user 0.001s	sys 0.001s
I20260709 12:17:33.690480 23677 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:33.708773 23677 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.709110 23677 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.713507 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.704066 23811 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:17:33.715606 23811 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.715837 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:33.716419 21177 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:33.717206 23828 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.718335 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:33.719285 21185 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:33.575318 21104 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:33.706060 23507 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:33.728255 21035 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
W20260709 12:17:33.731101 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 117965us
I20260709 12:17:33.590024 21149 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:33.741154 21744 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
W20260709 12:17:33.741341 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 151401us
I20260709 12:17:33.742220 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:33.742933 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 73852.3us
I20260709 12:17:33.714612 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.730737 21102 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:33.737887 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.739090 20933 catalog_manager.cc:5697] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 2 to 5, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:33.740484 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:33.749022 23737 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:33.749511 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:33.706663 23778 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:33.753682 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:33.760802 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 46258.6us
I20260709 12:17:33.762084 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:33.762776 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.759126 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:33.756855 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.757983 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.750653 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:33.766000 21179 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:33.766505 21077 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:33.745085 21033 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:33.765281 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:33.768787 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:33.764483 21104 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:33.773049 21002 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:33.774326 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:33.775396 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.769311 21033 raft_consensus.cc:2376] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7. Re-sending same reply.
I20260709 12:17:33.771867 20933 catalog_manager.cc:5697] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:33.779201 21029 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.781347 21711 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.773976 23628 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.783097 23506 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:33.783484 23506 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:33.774000 23817 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:33.783941 23506 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.783439 23628 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:33.784631 23628 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:33.784996 23628 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:33.770952 23617 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:33.786285 23817 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.786614 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:33.786762 23817 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.788028 21178 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.749553 23737 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:33.786103 21031 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:33.782922 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.790472 21032 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:33.783519 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:33.789783 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:33.751009 23304 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:33.801347 21178 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:33.790702 21036 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:33.811240 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:33.761032 23778 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:33.814522 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:33.818063 21077 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:33.772202 23785 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.815069 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:33.678151 23711 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.829839 21182 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.830222 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:33.839514 21035 raft_consensus.cc:2410] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:33.841779 20933 catalog_manager.cc:5697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:33.801106 23617 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.814244 23828 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.816278 23641 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.837564 23643 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:33.830896 23816 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.836407 23259 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:33.866128 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 93300.2us
I20260709 12:17:33.800869 23634 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:17:33.858546 23498 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:33.883868 20933 catalog_manager.cc:5697] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 5, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:33.885370 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.887897 21103 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:17:33.830387 23593 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 12:17:33.890547 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 89027.7us
I20260709 12:17:33.896509 21032 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:33.837047 23404 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:33.867990 23788 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.902494 21747 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:17:33.900015 20933 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 2 to 5, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:33.868847 23643 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:33.904989 21036 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.865818 23617 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:33.921970 23617 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:33.870129 23761 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.924010 23761 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:33.860496 23507 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.925855 23677 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:33.927634 21027 raft_consensus.cc:2410] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:17:33.892798 23814 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:33.900321 23778 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:33.920076 20934 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49692 (request call id 197) took 14902 ms (client timeout 15000 ms). Trace:
I20260709 12:17:33.926017 23544 consensus_queue.cc:1059] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:33.915485 20999 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:33.870296 23843 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:17:33.897804 23304 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:33.940330 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.946342 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:33.902448 23793 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:17:33.932375 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 151087us
I20260709 12:17:33.963277 21711 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:33.902281 23819 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:33.910789 23643 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.959026 21105 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:33.991883 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 79107us
I20260709 12:17:33.994006 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:33.997432 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:33.995760 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 93889us
I20260709 12:17:34.024585 23634 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:34.025053 23634 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.025384 23634 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.929982 23828 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:17:34.002218 23821 raft_consensus.cc:2764] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:17:34.027877 20933 catalog_manager.cc:5697] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 5, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:34.029217 23817 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.030289 21110 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:17:34.031186 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.031778 21036 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.033824 23817 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.030141 20933 catalog_manager.cc:5697] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:33.985891 23819 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:33.996268 23788 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:34.058640 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 216534us
I20260709 12:17:34.036334 23792 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:34.064674 20933 catalog_manager.cc:5697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.898332 23737 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:34.067246 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 252222us
I20260709 12:17:34.069656 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:34.070809 21177 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:34.074052 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:34.074539 21177 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.077577 21077 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:34.077785 21036 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:17:34.056465 23778 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.094712 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.036466 23785 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:17:34.040872 23544 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:17:34.111361 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:33.936595 20934 rpcz_store.cc:269] 0709 12:17:19.017110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.017348 (+   238us) service_pool.cc:224] Handling call
0709 12:17:33.919872 (+14902524us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:29.972353 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:30.123052 (+150699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:30.123090 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:17:30.123107 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:30.268037 (+144930us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:30.268103 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:30.268133 (+    30us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:17:30.269512 (+  1379us) tablet.cc:701] Row locks acquired
0709 12:17:30.269530 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:17:30.269678 (+   148us) write_op.cc:270] Start()
0709 12:17:30.269800 (+   122us) write_op.cc:276] Timestamp: P: 1783599450269629 usec, L: 0
0709 12:17:30.269823 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:17:30.347416 (+ 77593us) log.cc:844] Serialized 8277 byte log entry
0709 12:17:30.844724 (+497308us) op_driver.cc:464] REPLICATION: finished
0709 12:17:31.508185 (+663461us) write_op.cc:301] APPLY: starting
0709 12:17:31.508362 (+   177us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:31.508870 (+   508us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:31.509022 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:31.735382 (+226360us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:31.735757 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:17:31.735806 (+    49us) write_op.cc:312] APPLY: finished
0709 12:17:31.736315 (+   509us) log.cc:844] Serialized 145 byte log entry
0709 12:17:31.736520 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:31.736818 (+   298us) write_op.cc:454] Released schema lock
0709 12:17:31.736890 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:31.737387 (+   497us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:31.737416 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2356247,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":585108,"apply.run_cpu_time_us":6558,"apply.run_wall_time_us":285981,"num_ops":21,"prepare.queue_time_us":855308,"prepare.run_cpu_time_us":27714,"prepare.run_wall_time_us":584025,"raft.queue_time_us":186414,"raft.run_cpu_time_us":36628,"raft.run_wall_time_us":367617,"replication_time_us":573428,"thread_start_us":1084908,"threads_started":4,"wal-append.queue_time_us":287963,"wal-append.run_cpu_time_us":6589,"wal-append.run_wall_time_us":2146442}]]}
I20260709 12:17:34.115511 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:34.100538 23641 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:34.119585 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:34.096597 23792 raft_consensus.cc:697] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:34.113119 23423 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.069413 23817 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:17:34.075448 23793 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:34.129971 21002 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.067452 23788 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.026961 21023 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f86692ab0d642a990d934ba6bd6493f with delete_type TABLET_DATA_TOMBSTONED (TS 3ed9deaeb4014e9d87aeebbc6384f81f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59982
I20260709 12:17:34.100878 20933 catalog_manager.cc:5697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 3 to 5, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 5 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:34.104986 23498 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:34.145205 21177 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:34.146476 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:34.118764 23711 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.123292 23641 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.154670 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.161343 21031 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.132333 23617 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.127643 21738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 364) took 1060 ms. Trace:
W20260709 12:17:34.175133 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.108846 23304 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:34.180171 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 50289.3us
I20260709 12:17:34.159232 23843 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.184619 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:34.190995 21151 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.556s (SENT)
I20260709 12:17:34.191177 21002 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.144851 21028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:34.191964 21028 raft_consensus.cc:606] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:34.192297 21028 raft_consensus.cc:614] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:34.163254 23641 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.133358 23774 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.185699 20933 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:34.162940 23828 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:34.184453 21076 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:34.198956 21151 leader_election.cc:336] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.564s (SENT)
I20260709 12:17:34.200827 21711 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.180385 23683 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:34.219110 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.222100 20933 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 7, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 7 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:34.224583 21031 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:34.226648 21711 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:34.227128 21737 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:34.197108 23843 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:34.199352 23617 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:34.228938 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 82456.6us
I20260709 12:17:34.233750 20933 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 3, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 3 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:34.235829 23817 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.213671 23821 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.236197 21747 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:34.216547 23785 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.239126 23811 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.239786 23843 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.229054 23828 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:34.240643 23851 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 12:17:34.241297 23848 log.cc:927] Time spent T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:17:34.241675 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 65531.3us
W20260709 12:17:34.269905 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 50784.9us
I20260709 12:17:34.290555 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:34.275136 21151 leader_election.cc:336] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.640s (SENT)
W20260709 12:17:34.243816 23854 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:17:34.276866 20933 catalog_manager.cc:5697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 3 to 4, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 4 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:34.242687 23847 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:17:34.291813 21151 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.291993 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:34.294694 20933 catalog_manager.cc:5697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:34.300340 20933 catalog_manager.cc:5697] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 3, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 3 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:34.295643 23617 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:34.303458 23617 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:34.304210 23506 consensus_meta.cc:287] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.001s
I20260709 12:17:34.304576 23506 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:34.307348 23855 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:17:34.311118 23711 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:34.311657 23711 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:17:34.312119 23858 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:17:34.312541 23711 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.297506 23593 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:34.314702 21076 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:34.316241 21076 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:34.318137 21076 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:34.243841 23498 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.306581 23506 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:34.268472 23864 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:34.323472 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.232293 23683 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.241856 23628 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.218722 23792 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.300697 23821 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:34.297407 23423 consensus_queue.cc:765] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 4 is ahead of the local log (next sequential op: 4). Destination peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.415s
I20260709 12:17:34.330186 23860 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:34.333448 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.366786 21108 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:34.353489 23786 consensus_meta.cc:287] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.001s
I20260709 12:17:34.358100 23628 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.359645 23683 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:34.402105 21151 leader_election.cc:336] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.767s (SENT)
I20260709 12:17:34.350226 23798 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:34.173460 21738 rpcz_store.cc:276] 0709 12:17:33.067165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.069775 (+  2610us) service_pool.cc:224] Handling call
0709 12:17:33.070087 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.070420 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.070447 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.070902 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:17:33.202779 (+131877us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:33.544481 (+341702us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b1800472120. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a4455 00007fcba338c3c7 00007fcb9f99e9a7 00007fcb9f9ae0bf 00007fcb9f9ae038
0709 12:17:33.773696 (+229215us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.068442 (+294746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.092084 (+ 23642us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.100141 (+  8057us) raft_consensus.cc:1685] finished
0709 12:17:34.110456 (+ 10315us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.120365 (+  9909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":554,"prepare.queue_time_us":228512,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":110971,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":35000,"spinlock_wait_cycles":12424960,"thread_start_us":567855,"threads_started":3,"wal-append.queue_time_us":157557}
I20260709 12:17:34.329809 23865 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:34.347204 23850 log.cc:927] Time spent T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:17:34.348230 23864 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:34.413305 23864 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.349495 23828 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.409160 23798 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:34.418720 23798 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.331616 23881 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:34.333652 23507 raft_consensus.cc:2764] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:34.332067 23497 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:17:34.368884 23860 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:34.405928 23800 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.000s
W20260709 12:17:34.422484 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 104138us
W20260709 12:17:34.423254 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 99864.8us
I20260709 12:17:34.362284 23811 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.353566 23821 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:34.428468 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:34.429080 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.493189 21034 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.347438 23634 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.331712 23876 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:17:34.489951 21076 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:34.429956 23865 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:34.498813 23617 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:34.366564 23643 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.431565 23860 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.494979 23821 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.516669 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.518635 21103 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:34.451900 23641 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.521294 21034 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:34.519163 23774 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.533048 21028 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:34.534284 21028 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:34.535084 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.535684 21035 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:34.536151 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.536561 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.536844 21028 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:34.537566 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.538192 21028 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:34.539695 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.540663 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.541579 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.542163 21035 raft_consensus.cc:2368] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5.
I20260709 12:17:34.542821 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.544494 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.545496 21028 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:34.544607 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.546515 21034 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:34.547520 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.548141 21035 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:34.548919 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.549719 21035 raft_consensus.cc:2368] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7.
I20260709 12:17:34.550408 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.550920 21035 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.551911 23889 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:34.554275 21151 leader_election.cc:336] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.877s (SENT)
I20260709 12:17:34.554682 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.561128 23865 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.566277 23844 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:34.566648 23844 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:34.567435 23844 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.569815 21035 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:34.573606 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.576655 21035 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:34.579743 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.582373 21035 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:34.584163 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.584685 21027 raft_consensus.cc:2376] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6. Re-sending same reply.
I20260709 12:17:34.585429 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.587675 23634 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:34.589329 21029 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:17:34.589653 21029 pending_rounds.cc:85] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 8
I20260709 12:17:34.589860 21029 pending_rounds.cc:107] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:17:34.590086 21029 raft_consensus.cc:2889] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:34.588254 21035 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:34.521822 23843 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.592154 21029 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:34.593328 21029 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:34.593604 23817 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.594485 21029 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:34.594240 21035 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:34.593216 23859 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:17:34.600114 21035 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:17:34.601289 21035 pending_rounds.cc:85] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 2
I20260709 12:17:34.602526 21035 pending_rounds.cc:107] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:17:34.603293 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:34.595162 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 105306us
I20260709 12:17:34.603817 21035 raft_consensus.cc:2889] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:34.585793 21027 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:34.635284 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:34.601624 23677 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:34.602881 23683 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.612813 23634 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:34.643368 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.614975 23761 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:34.651614 21029 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.634982 23844 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.650614 21027 pending_rounds.cc:85] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 2
I20260709 12:17:34.659412 21027 pending_rounds.cc:107] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:34.659725 21027 raft_consensus.cc:2889] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:34.602561 23643 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.614916 23774 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 12:17:34.670680 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 116430us
W20260709 12:17:34.671305 21151 leader_election.cc:336] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.888s (SENT)
I20260709 12:17:34.640965 23817 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:17:34.643187 23471 consensus_queue.cc:1059] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:34.661134 23775 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:34.672508 23880 tablet_replica.cc:333] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:17:34.660781 23634 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.672523 23891 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:34.667580 23761 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:34.699375 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:34.686447 23886 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:34.655970 23683 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.722544 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.723260 21034 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:34.724236 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.724779 21034 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:34.725634 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.728859 21029 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:17:34.729179 23761 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.730523 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.733177 21711 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:34.730751 23890 log.cc:927] Time spent T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:34.731602 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:34.726704 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.737723 21034 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.741981 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.747531 21029 raft_consensus.cc:2376] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7. Re-sending same reply.
I20260709 12:17:34.732060 23860 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.749686 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.752362 23471 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.752889 23471 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.754922 23471 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.772238 23683 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:34.772413 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:34.773437 23593 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.773597 23683 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.694730 23891 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.775405 23860 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.776558 23891 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:34.777493 21151 leader_election.cc:400] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5.
I20260709 12:17:34.777791 21151 leader_election.cc:403] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:34.778555 23683 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5.
I20260709 12:17:34.781184 21151 leader_election.cc:400] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7.
I20260709 12:17:34.742271 23814 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.737748 23866 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:34.788419 23866 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:34.789050 21151 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.789274 23866 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.793133 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.793797 21029 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.748970 23740 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:17:34.782742 23874 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:34.763857 23775 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:17:34.801172 21034 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:34.717072 23886 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.802299 21029 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:34.803927 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:34.781836 23677 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:17:34.806789 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.808248 23891 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:34.810966 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.811653 21034 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:34.824420 21151 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.828265 23862 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.828769 23862 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.830758 23862 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.818712 21029 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:34.846764 21034 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:34.846681 21105 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:34.840723 23901 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.849200 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:34.849815 21106 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:34.853523 23634 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.804684 23874 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.859304 23874 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:34.860743 23886 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:34.865731 23896 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:17:34.869519 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:34.870105 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2000) took 1131 ms. Trace:
I20260709 12:17:34.870285 21181 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:34.823552 23891 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:34.872248 23891 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.876138 23821 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.878135 23821 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.878366 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:34.879016 21182 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
W20260709 12:17:34.879452 23898 log.cc:927] Time spent T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:17:34.879365 23855 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
W20260709 12:17:34.881254 23868 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.613s	user 0.001s	sys 0.001s
I20260709 12:17:34.881853 21712 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:34.884037 23761 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:34.884382 23761 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.884701 23761 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.885001 23843 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.847000 23683 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.886387 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:34.872256 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 47899.4us
I20260709 12:17:34.888824 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2148) took 1113 ms. Trace:
I20260709 12:17:34.889545 23805 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:34.890475 23805 consensus_queue.cc:1059] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:34.891165 23805 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:34.891464 23683 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:34.891732 23775 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:34.892117 23775 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:34.893337 21184 rpcz_store.cc:276] 0709 12:17:33.738652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.740914 (+  2262us) service_pool.cc:224] Handling call
0709 12:17:34.869922 (+1129008us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540015de54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:34.870042 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2360285568}
I20260709 12:17:34.894702 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:34.898449 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:34.899546 21105 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:34.901044 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.889178 21033 rpcz_store.cc:276] 0709 12:17:33.775660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.777391 (+  1731us) service_pool.cc:224] Handling call
0709 12:17:33.777661 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.858387 (+ 80726us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:33.868951 (+ 10564us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.092648 (+223697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:34.092695 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:34.092731 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.888600 (+795869us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b54003d54d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:34.888646 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.888752 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10685,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2841,"raft.queue_time_us":4050,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5523,"spinlock_wait_cycles":185159040,"thread_start_us":223391,"threads_started":1,"wal-append.queue_time_us":347900}
I20260709 12:17:34.915135 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:34.916512 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:34.917150 21184 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:34.895258 23431 raft_consensus.cc:3055] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:34.919114 21036 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:34.919678 21105 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:34.921778 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:34.920995 21077 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:34.927744 23852 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.744s	user 0.001s	sys 0.002s
I20260709 12:17:34.894534 23404 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:34.931609 23404 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:34.931761 21737 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:34.913363 23677 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:34.933089 23677 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:34.933037 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:34.934333 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:34.934104 23677 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.936234 23641 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:34.938038 21106 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:17:34.938933 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:34.939467 21106 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.940301 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:34.943629 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:34.944335 21184 raft_consensus.cc:2393] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:34.945664 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:34.915026 23683 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.892902 23775 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:34.915680 23593 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.948463 21033 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:34.948436 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:34.898243 23543 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:34.953003 21110 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
W20260709 12:17:34.962190 23857 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.736s	user 0.000s	sys 0.002s
I20260709 12:17:34.964514 23617 raft_consensus.cc:3055] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:34.964944 23617 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:34.965742 23617 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.937628 23814 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.967159 23814 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.967517 23814 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.938766 23404 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:34.969074 23404 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.970148 23404 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.933117 21738 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:34.951917 23888 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:34.973809 23888 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:34.974123 23888 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:34.974928 23888 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:34.976040 23888 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.977363 23775 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.952165 23683 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:34.978801 23683 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.921177 23431 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:34.910202 23740 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:17:34.988579 21110 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:34.989499 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:34.989995 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:34.991007 21177 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.951982 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:34.977454 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:34.993786 21028 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.953702 21105 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:34.997213 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:34.990002 21110 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:35.016152 21105 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:35.035298 21105 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:35.035668 21105 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:35.038411 21028 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:35.039331 21110 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:17:35.045261 21177 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:34.995447 23696 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.997999 23617 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:35.051472 23821 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.045826 23506 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:35.055244 23696 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:35.059881 21036 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:35.084875 21036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:35.085441 21036 raft_consensus.cc:606] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:35.061618 21031 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:35.067288 23880 raft_consensus.cc:2243] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:35.036324 21105 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.038573 23792 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.073657 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aaaf493e892d4ee9839b45b601fc8400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:35.091403 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 278) took 1362 ms. Trace:
I20260709 12:17:35.087806 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1477) took 1065 ms. Trace:
I20260709 12:17:35.087852 21105 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:35.033567 23853 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.089285 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:35.091902 21102 rpcz_store.cc:276] 0709 12:17:34.024139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.043242 (+ 19103us) service_pool.cc:224] Handling call
0709 12:17:34.068619 (+ 25377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.068821 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:34.958930 (+890109us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b18002c47c0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9f53c4bc 00007fcb9c88a48b 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a4455 00007fcba338c3c7 00007fcb9f99e9a7 00007fcb9f9ae0bf
0709 12:17:34.959055 (+   125us) log.cc:844] Serialized 14 byte log entry
0709 12:17:35.087507 (+128452us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:35.087563 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:35.087611 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.087667 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.087759 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26521,"prepare.queue_time_us":94090,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2803,"raft.queue_time_us":196,"spinlock_wait_cycles":21413120,"thread_start_us":203665,"threads_started":2}
W20260709 12:17:35.076679 23903 log.cc:927] Time spent T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:17:35.091794 21030 rpcz_store.cc:276] 0709 12:17:33.729358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.740051 (+ 10693us) service_pool.cc:224] Handling call
0709 12:17:33.752277 (+ 12226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.761792 (+  9515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.761821 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.781471 (+ 19650us) log.cc:844] Serialized 26 byte log entry
0709 12:17:34.103517 (+322046us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:34.113770 (+ 10253us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.116172 (+  2402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.116316 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.564205 (+447889us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18002caf40. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:34.961514 (+397309us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:35.091196 (+129682us) raft_consensus.cc:1685] finished
0709 12:17:35.091218 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.091344 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37850,"prepare.queue_time_us":13447,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":14596,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":11677,"spinlock_wait_cycles":14158080,"thread_start_us":247425,"threads_started":1,"wal-append.queue_time_us":341698}
I20260709 12:17:34.991730 23819 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.087054 23696 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:35.114130 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.084180 23821 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.124054 21709 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:35.082161 23431 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.131335 23862 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.131996 23431 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:35.090636 23506 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.099635 23792 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.101271 23853 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.137548 21105 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
W20260709 12:17:35.138247 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 146806us
W20260709 12:17:35.117010 23844 consensus_queue.cc:1175] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a1b891e53adc40a6a1ae813238321e93" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 12:17:35.120963 23819 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.142954 21105 pending_rounds.cc:85] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 6
I20260709 12:17:35.147915 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1481) took 1110 ms. Trace:
I20260709 12:17:35.151604 21103 rpcz_store.cc:276] 0709 12:17:34.038089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.038239 (+   150us) service_pool.cc:224] Handling call
0709 12:17:34.038505 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.519656 (+481151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.147749 (+628093us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54000a8054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:35.147874 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103735168}
I20260709 12:17:35.153806 21105 pending_rounds.cc:107] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:17:35.154101 21105 raft_consensus.cc:2889] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:35.161021 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:35.141530 23880 raft_consensus.cc:2272] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:35.166920 21106 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:17:35.128387 23634 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:17:35.218935 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 52147.8us
I20260709 12:17:35.195888 21028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:35.143911 23865 consensus_queue.cc:1059] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:17:35.159648 23593 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:17:35.233842 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 105987us
I20260709 12:17:35.175246 23805 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:35.155220 23740 consensus_queue.cc:1059] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:35.220846 21028 raft_consensus.cc:606] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:35.175393 23800 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.239320 21028 raft_consensus.cc:614] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:35.195812 23862 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:35.163810 23761 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.273298 21744 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:35.242022 23805 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.271288 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:17:35.283671 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 146314us
I20260709 12:17:35.241235 23788 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:35.280130 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:35.276475 23913 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:17:35.211885 23901 consensus_queue.cc:1059] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:17:35.169019 23774 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:17:35.284260 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:35.316468 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2013) took 1061 ms. Trace:
I20260709 12:17:35.284327 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:35.306041 21744 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:17:35.280167 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 45225.6us
I20260709 12:17:35.320987 21739 raft_consensus.cc:2368] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:35.321147 21184 raft_consensus.cc:3055] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:35.321471 21184 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:35.321671 21742 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:35.322186 23919 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:17:35.323416 21184 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.324368 21184 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:35.325129 21027 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:35.316880 21181 rpcz_store.cc:276] 0709 12:17:34.254741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.264013 (+  9272us) service_pool.cc:224] Handling call
0709 12:17:34.870113 (+606100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.870655 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.316290 (+445635us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540015de50. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:35.316415 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393194368}
I20260709 12:17:35.328661 23934 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:17:35.331871 23641 consensus_queue.cc:1059] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:35.333236 23860 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:35.333580 23860 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:35.335390 21106 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:35.336354 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:35.337450 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:35.337021 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:35.316814 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:35.285194 23805 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:35.344103 21747 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:35.345772 21746 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:17:35.351169 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.263044 23800 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.354478 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.331724 23880 ts_tablet_manager.cc:1916] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:17:35.346725 23917 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:17:35.335382 23821 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:35.334370 23860 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.339181 23864 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.280292 23862 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.330631 23814 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.331723 23788 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:17:35.367956 23304 raft_consensus.cc:3055] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:35.377780 23915 log.cc:927] Time spent T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:17:35.386814 21103 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:35.387306 23593 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.390254 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 149017us
W20260709 12:17:35.429297 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.429724 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 74878.2us
I20260709 12:17:35.431080 21102 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:35.433957 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.396166 23792 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:35.444454 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:35.415668 23304 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:35.459185 23304 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.420408 23740 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:35.460188 23740 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.462067 23740 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:35.419457 23853 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:35.463430 23304 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:35.467670 23916 log.cc:927] Time spent T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
W20260709 12:17:35.473505 23918 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:17:35.437477 23634 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:17:35.432045 23593 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:35.479655 23923 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 12:17:35.478492 23921 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:17:35.497617 23593 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:35.494014 23814 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:35.495085 23506 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:35.495479 23933 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:17:35.495975 21747 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:35.497494 23677 raft_consensus.cc:3055] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:35.481451 23683 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.516000 23788 consensus_queue.cc:1243] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer a1b891e53adc40a6a1ae813238321e93 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:17:35.544796 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 72617us
I20260709 12:17:35.545287 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:35.510248 23761 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:35.485477 23943 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:17:35.515512 23677 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:35.548622 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.487465 23740 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:17:35.549829 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:35.557832 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:35.559283 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45140.7us
I20260709 12:17:35.557843 21184 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:17:35.531332 23800 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:35.543251 23901 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:17:35.595666 21028 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:35.596890 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.597715 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1340) took 1053 ms. Trace:
I20260709 12:17:35.523327 23947 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:17:35.598723 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 50184us
I20260709 12:17:35.597379 23954 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:35.598071 21032 rpcz_store.cc:276] 0709 12:17:34.543910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.934753 (+390843us) service_pool.cc:224] Handling call
0709 12:17:34.935077 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.935383 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:34.935409 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:34.935838 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.093654 (+157816us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:35.103399 (+  9745us) log.cc:844] Serialized 14 byte log entry
0709 12:17:35.104815 (+  1416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.104881 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:35.461940 (+357059us) spinlock_profiling.cc:243] Waited 9.88 ms on lock 0x7b18001f35a0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a7522 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:35.576946 (+115006us) raft_consensus.cc:1685] finished
0709 12:17:35.597539 (+ 20593us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.597663 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1118,"prepare.queue_time_us":10240,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":3826,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":7518,"spinlock_wait_cycles":22726912,"thread_start_us":157454,"threads_started":1,"wal-append.queue_time_us":229935}
I20260709 12:17:35.602384 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:35.604837 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.603148 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.605427 21178 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:35.603330 23931 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:35.577765 23862 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:35.611300 21179 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:35.613101 23899 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.842s	user 0.005s	sys 0.000s
I20260709 12:17:35.613968 23788 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.615132 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2016) took 1187 ms. Trace:
I20260709 12:17:35.615487 21186 rpcz_store.cc:276] 0709 12:17:34.428102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.448011 (+ 19909us) service_pool.cc:224] Handling call
0709 12:17:34.450136 (+  2125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.613333 (+163197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:34.613363 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:34.615154 (+  1791us) log.cc:844] Serialized 26 byte log entry
0709 12:17:34.685799 (+ 70645us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:34.685839 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.685903 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:35.463540 (+777637us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b480024da58. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f 00007fcba49abf37 00007fcba49c055c 00007fcba49c0508 00007fcba49c0488 00007fcba49c0443 00007fcba49bf6ec 00007fcba38e9a96
0709 12:17:35.612413 (+148873us) spinlock_profiling.cc:243] Waited 9.87 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:35.614915 (+  2502us) raft_consensus.cc:1685] finished
0709 12:17:35.614936 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.615065 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171376,"raft.queue_time_us":162930,"raft.run_cpu_time_us":3543,"raft.run_wall_time_us":848437,"spinlock_wait_cycles":28675584,"thread_start_us":39962,"threads_started":1,"wal-append.queue_time_us":126614}
W20260709 12:17:35.616755 23888 consensus_meta.cc:287] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.640s	user 0.004s	sys 0.006s
I20260709 12:17:35.617290 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.617383 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.618306 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.619498 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:35.619766 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:35.620755 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:35.621512 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:35.621662 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.622269 21107 raft_consensus.cc:2410] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:35.621186 21182 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:35.606304 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.607007 23773 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:35.603984 23924 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:17:35.607342 21184 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:35.607668 23737 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 12:17:35.595274 23404 consensus_meta.cc:287] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.625s	user 0.002s	sys 0.009s
I20260709 12:17:35.658792 21178 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:17:35.661317 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:35.663000 21179 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:35.668830 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 52009.5us
I20260709 12:17:35.614388 23957 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.622826 23617 consensus_meta.cc:287] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.000s
I20260709 12:17:35.622944 23800 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.675798 23800 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.677981 23800 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:35.624289 23788 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.658988 23773 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.680886 23611 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.685761 23775 consensus_meta.cc:287] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.708s	user 0.005s	sys 0.005s
W20260709 12:17:35.686295 23935 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:17:35.704736 21106 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
W20260709 12:17:35.754909 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.690826 23404 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.610289 23954 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.756287 21180 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:35.773851 23954 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:35.761893 23696 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.002s
I20260709 12:17:35.774415 23696 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.704406 23957 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.659708 23677 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.774538 23404 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:35.767943 21179 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:17:35.775561 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 106104us
I20260709 12:17:35.797277 21182 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:35.805785 21747 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:17:35.826089 21183 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:35.826757 21737 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:17:35.801710 23819 consensus_meta.cc:287] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.647s	user 0.004s	sys 0.004s
W20260709 12:17:35.803381 23956 log.cc:927] Time spent T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:17:35.832508 23683 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:35.833685 23965 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:35.836381 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:35.846206 21035 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:17:35.754387 23611 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.851888 23891 raft_consensus.cc:3055] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:35.852406 23891 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:35.852715 23507 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.853204 23507 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:35.855314 23507 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:35.856762 23788 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:35.851977 23696 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:35.828382 23800 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:17:35.679823 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:36.007951 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1352) took 1105 ms. Trace:
W20260709 12:17:35.972095 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 122843us
I20260709 12:17:36.007464 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:35.898914 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35652 (request call id 290) took 1038 ms. Trace:
I20260709 12:17:35.916154 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2157) took 1275 ms. Trace:
W20260709 12:17:35.902225 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 563028us
I20260709 12:17:36.036177 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:35.880026 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:36.039837 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.023445 21035 rpcz_store.cc:276] 0709 12:17:34.860293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.869283 (+  8990us) service_pool.cc:224] Handling call
0709 12:17:35.898735 (+1029452us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54002238d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:35.898836 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244728192}
I20260709 12:17:36.024072 21033 rpcz_store.cc:276] 0709 12:17:34.640558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.983778 (+343220us) service_pool.cc:224] Handling call
0709 12:17:34.984054 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.984402 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:34.997907 (+ 13505us) log.cc:844] Serialized 14 byte log entry
0709 12:17:35.336483 (+338576us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800401bc0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b 00007fcb9f533d23 00007fcb9f53423a 00007fcb9f99ea2a
0709 12:17:35.909047 (+572564us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.909442 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.909580 (+   138us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:35.909616 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.909680 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:35.915894 (+  6214us) raft_consensus.cc:1685] finished
0709 12:17:35.915975 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.916088 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":384528,"prepare.queue_time_us":13831,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":375626,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5156,"spinlock_wait_cycles":3276032,"thread_start_us":196912,"threads_started":1,"wal-append.queue_time_us":834340}
W20260709 12:17:36.042109 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:36.043834 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.043903 21746 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:36.044430 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:36.044786 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:36.041023 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:36.046998 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.022894 21034 rpcz_store.cc:276] 0709 12:17:34.902156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.186545 (+284389us) service_pool.cc:224] Handling call
0709 12:17:35.189149 (+  2604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.344136 (+154987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.344168 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.377869 (+ 33701us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.447197 (+ 69328us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:35.472781 (+ 25584us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.007615 (+534834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.007691 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.007730 (+    39us) raft_consensus.cc:1685] finished
0709 12:17:36.007743 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.007887 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":439915,"prepare.queue_time_us":27054,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1146165,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"thread_start_us":207360,"threads_started":2,"wal-append.queue_time_us":104055}
I20260709 12:17:36.048242 21110 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:36.050695 21002 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:36.052446 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:35.882337 23805 consensus_meta.cc:287] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.002s
W20260709 12:17:35.910307 23955 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:36.051831 21002 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.054741 21107 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:35.914973 23932 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.057807 21709 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.062503 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:36.063151 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:36.055889 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 155996us
I20260709 12:17:36.065200 21178 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:35.866568 23611 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:35.875488 23404 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:35.868475 23497 raft_consensus.cc:3055] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:35.906239 23939 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.162952 23939 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.061527 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.165179 21107 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:36.166409 21103 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:36.174960 21032 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:35.904670 23937 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.257s
I20260709 12:17:35.877256 23773 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:35.906615 23938 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:36.041574 23945 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:36.069029 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.042420 23957 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.058604 23888 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:36.123550 21739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 645) took 1191 ms. Trace:
I20260709 12:17:36.055824 23889 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:36.071651 23774 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:36.125473 21110 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:36.057271 23884 raft_consensus.cc:2764] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:36.125864 23862 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.130349 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1486) took 1289 ms. Trace:
I20260709 12:17:36.071306 23792 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.071981 23819 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:36.108616 23936 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.107487 23968 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.106910 23940 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.107903 23929 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:17:36.211645 23774 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:36.133378 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.133284 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.138342 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:36.152679 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 90711.3us
W20260709 12:17:36.153196 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 85603.7us
I20260709 12:17:36.177924 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:36.180884 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.196331 23938 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.248476 21178 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:36.250332 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.250787 21182 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:36.251039 21177 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:36.250350 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.252246 21183 raft_consensus.cc:2410] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:36.252748 23938 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:36.183498 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.130797 23901 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.257050 23901 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.257655 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:36.258239 21186 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.259202 23901 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.132376 23677 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.169564 23497 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:36.261927 23497 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.263052 23497 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:36.061367 23805 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.192234 21149 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:36.273391 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 81223.6us
I20260709 12:17:36.274315 21149 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:36.200439 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 288) took 1465 ms. Trace:
I20260709 12:17:36.198482 21739 rpcz_store.cc:276] 0709 12:17:34.932449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.932784 (+   335us) service_pool.cc:224] Handling call
0709 12:17:36.108142 (+1175358us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54005cce54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:36.123473 (+ 15331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878998400}
I20260709 12:17:36.275141 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:36.208253 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:36.275072 21029 rpcz_store.cc:276] 0709 12:17:34.735031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.054151 (+319120us) service_pool.cc:224] Handling call
0709 12:17:35.054443 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.424958 (+370515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.424989 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.425405 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.557580 (+132175us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:35.557612 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.072384 (+514772us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003a4154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:36.176654 (+104270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.197262 (+ 20608us) raft_consensus.cc:1685] finished
0709 12:17:36.197282 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.200375 (+  3093us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":739473,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":243202816,"thread_start_us":370303,"threads_started":2,"wal-append.queue_time_us":414433}
I20260709 12:17:36.277746 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:36.278151 23976 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:36.278688 23976 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:36.279254 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.279953 21029 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:36.280258 23844 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:36.280921 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:36.211892 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 142933us
I20260709 12:17:36.223562 21109 rpcz_store.cc:276] 0709 12:17:34.841388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.841583 (+   195us) service_pool.cc:224] Handling call
0709 12:17:34.841870 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.842221 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:34.887743 (+ 45522us) log.cc:844] Serialized 14 byte log entry
0709 12:17:35.046127 (+158384us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.127757 (+1081630us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b2c0005c228. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:17:36.128116 (+   359us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.128274 (+   158us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:36.128306 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.128364 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.130102 (+  1738us) raft_consensus.cc:1685] finished
0709 12:17:36.130187 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.130298 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45872,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":160,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":13126,"spinlock_wait_cycles":9147264,"thread_start_us":157901,"threads_started":1,"wal-append.queue_time_us":256212}
I20260709 12:17:36.282112 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:36.198302 23888 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:36.282219 23874 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:36.239077 21035 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:17:36.096081 23932 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.283317 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.230468 23792 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.284413 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.282752 23888 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:36.224223 23866 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:36.285172 23792 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.266978 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:36.285530 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.277778 23543 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:36.286542 23543 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.286911 23543 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.287964 23805 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:36.288780 21181 raft_consensus.cc:2393] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:36.291136 23304 raft_consensus.cc:2764] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:36.055109 23800 consensus_queue.cc:1243] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer a1b891e53adc40a6a1ae813238321e93 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:36.295349 23939 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.268239 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:36.229700 23611 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:17:36.269091 21077 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:36.299798 23880 ts_tablet_manager.cc:1929] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:36.243659 23940 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.301152 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.301932 21035 raft_consensus.cc:2410] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:17:36.302580 23940 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.242009 23968 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:36.296480 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.197201 23945 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.286248 21029 raft_consensus.cc:2368] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:17:36.308128 21076 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:36.308964 21033 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.280815 23844 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.278715 21186 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:36.284544 23932 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.276486 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:36.321781 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 52766.2us
I20260709 12:17:36.320878 21032 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:36.279903 23976 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:36.272608 23934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.010s	sys 0.016s
I20260709 12:17:36.267817 23774 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:36.238255 23819 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:36.320639 23971 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.151s	user 0.003s	sys 0.000s
I20260709 12:17:36.302626 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.066416 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.305208 23880 log.cc:1199] T 0f86692ab0d642a990d934ba6bd6493f P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/wals/0f86692ab0d642a990d934ba6bd6493f
I20260709 12:17:36.343123 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:36.343808 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.347918 23259 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:36.348145 23800 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:36.348675 23800 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:36.349221 23259 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:36.349491 23800 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.352735 21036 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:17:36.353109 21036 pending_rounds.cc:85] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 2
I20260709 12:17:36.353332 21036 pending_rounds.cc:107] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:17:36.353559 21036 raft_consensus.cc:2889] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:36.355450 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:36.356135 21747 raft_consensus.cc:2393] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:17:36.357863 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 291495us
I20260709 12:17:36.358477 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.356767 21076 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:36.368300 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:36.373082 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:36.374158 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:36.374887 21102 raft_consensus.cc:2393] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:36.373939 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.371857 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.377959 21076 leader_election.cc:400] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:17:36.379495 23880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59982 (request call id 84) took 2459 ms. Trace:
I20260709 12:17:36.380064 23880 rpcz_store.cc:276] 0709 12:17:33.920616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.937715 (+ 17099us) service_pool.cc:224] Handling call
0709 12:17:34.645676 (+707961us) ts_tablet_manager.cc:1151] Deleting tablet 0f86692ab0d642a990d934ba6bd6493f
0709 12:17:34.645776 (+   100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:17:35.874007 (+1228231us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:36.299654 (+425647us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:36.379400 (+ 79746us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":280286,"tablet-delete.queue_time_us":455630,"thread_start_us":193253,"threads_started":1}
I20260709 12:17:36.381755 21076 leader_election.cc:403] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:36.382623 23959 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:17:36.383653 23977 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.386078 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:36.387694 23959 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:36.388054 23959 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:36.388381 23959 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.393441 23865 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:36.335026 23934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.010s	sys 0.016s
I20260709 12:17:36.386139 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:36.403343 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:36.339504 23968 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:36.415004 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1357) took 1069 ms. Trace:
I20260709 12:17:36.420083 21028 rpcz_store.cc:276] 0709 12:17:35.345494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.596501 (+251007us) service_pool.cc:224] Handling call
0709 12:17:35.596797 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.909368 (+312571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.909395 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.909802 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.318220 (+408418us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:36.402993 (+ 84773us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.414683 (+ 11690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.414762 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.414801 (+    39us) raft_consensus.cc:1685] finished
0709 12:17:36.414813 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.414946 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":312222,"raft.queue_time_us":313081,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":1623936,"thread_start_us":394422,"threads_started":2,"wal-append.queue_time_us":408367}
I20260709 12:17:36.422152 21028 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:36.425781 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:36.363629 23259 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:36.363844 23932 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.376185 23507 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:36.431708 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.328229 23866 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:17:36.400060 23937 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.400241 23843 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:36.443074 23936 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.444825 23945 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.446920 21035 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:36.429744 23889 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:36.438009 23939 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:36.462661 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 51058.7us
I20260709 12:17:36.467453 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.399909 23711 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:17:36.483537 23924 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:36.483973 23891 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.484699 23924 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.485226 23924 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.486805 21747 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:36.487365 23924 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.494196 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1355) took 1149 ms. Trace:
I20260709 12:17:36.495352 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.448333 23507 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.471366 23860 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.473374 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.474601 21035 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:36.475286 21029 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:36.505146 23959 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.505352 23888 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.495911 21107 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:36.461483 23611 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:36.530038 21149 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:36.485286 23891 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.520136 21028 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:17:36.526809 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 89171.4us
I20260709 12:17:36.511075 23954 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.494925 23798 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:36.513559 21184 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:36.539685 23936 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.544773 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.535296 23611 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.528596 23507 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.553051 21035 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:36.527226 23937 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:36.554636 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.535806 23945 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:17:36.560873 21107 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:36.561291 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.561728 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.561825 21180 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:36.562773 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.563138 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.564093 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.566442 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.568451 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:36.569649 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.573657 21075 leader_election.cc:400] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:36.573966 21075 leader_election.cc:403] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:36.567068 21028 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:36.581723 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:36.583920 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.547641 23948 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:36.585783 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.588975 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.552186 23611 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.553188 23977 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:36.593348 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.552855 23740 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.592772 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.593667 21709 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:36.594406 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:36.547426 23939 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:17:36.610242 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 162336us
I20260709 12:17:36.589715 23259 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:36.580729 23940 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.592721 23792 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:36.592044 23843 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:36.551834 23798 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.552277 23936 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.614604 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.548545 23954 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.615762 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.554813 23889 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:17:36.583778 23929 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:36.611315 23711 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:36.563151 23937 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.610416 23977 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:36.655877 23977 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.659121 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.660229 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.494539 21031 rpcz_store.cc:276] 0709 12:17:35.344989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.345464 (+   475us) service_pool.cc:224] Handling call
0709 12:17:35.345986 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.903536 (+557550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.903566 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.903970 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.298179 (+394209us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:36.466758 (+168579us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.493924 (+ 27166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.493995 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.494033 (+    38us) raft_consensus.cc:1685] finished
0709 12:17:36.494043 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.494147 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":584138,"raft.queue_time_us":585794,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":48,"thread_start_us":562091,"threads_started":2,"wal-append.queue_time_us":410483}
I20260709 12:17:36.611343 23740 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.632016 23932 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:36.640017 23866 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:17:36.666678 23794 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.671366 23959 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.635106 23929 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.633658 23888 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:36.626435 23304 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:36.621121 23792 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.675335 21033 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:36.685055 21077 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:36.686285 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:36.610140 23543 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.623600 23940 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.639930 23936 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.714588 21077 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:36.674134 23711 raft_consensus.cc:697] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:36.719398 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.720031 21033 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:36.648904 23774 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.712491 23792 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:36.724992 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.686463 23794 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.684564 23843 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:17:36.716928 23959 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:36.682999 23932 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:36.730950 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 359122us
I20260709 12:17:36.746284 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.689069 23800 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:36.729976 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.723101 23259 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:36.748934 21033 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:36.751830 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.751291 23259 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.760169 23259 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:36.761070 23794 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.762027 23932 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.763765 23954 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.763908 23995 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:36.765765 23940 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.766413 23711 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.768023 23543 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.770989 23798 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.772413 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 365) took 1223 ms. Trace:
I20260709 12:17:36.772782 21181 rpcz_store.cc:276] 0709 12:17:35.549291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.549591 (+   300us) service_pool.cc:224] Handling call
0709 12:17:36.772249 (+1222658us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002003d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:36.772364 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679560576}
I20260709 12:17:36.775851 23259 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.777233 23507 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.778409 23259 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:36.780848 23497 consensus_meta.cc:287] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.517s	user 0.003s	sys 0.005s
I20260709 12:17:36.786890 23959 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:36.787897 23959 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.747363 23740 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.790136 23611 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.381680 20920 catalog_manager.cc:5028] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): tablet 0f86692ab0d642a990d934ba6bd6493f (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:17:36.800696 23929 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.689797 23865 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 12:17:36.807090 20920 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 425379us
I20260709 12:17:36.807101 23939 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.838258 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.839216 21076 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:36.851495 23404 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:36.851890 23543 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:36.852041 23404 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.854261 23404 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.832208 23939 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:36.852447 23543 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.859444 23939 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:36.851622 23977 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:36.861644 23977 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.862566 23884 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:36.862988 23884 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:36.863554 23977 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.863734 23884 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.864895 23884 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.861065 23543 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.872814 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1350) took 1971 ms. Trace:
I20260709 12:17:36.880126 23773 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:36.880641 23773 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:36.882573 23773 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.873196 21030 rpcz_store.cc:276] 0709 12:17:34.901652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.096655 (+195003us) service_pool.cc:224] Handling call
0709 12:17:35.096984 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.142569 (+ 45585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.142608 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.152478 (+  9870us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.230170 (+ 77692us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:35.261577 (+ 31407us) log.cc:844] Serialized 14 byte log entry
0709 12:17:35.899656 (+638079us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b1800177a00. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c821c0a 00007fcba5f61219 00007fcb9c8a9a40 00007fcb9c8a44e4 00007fcb9c8a4455 00007fcb9f98c060 00007fcb9f99e716 00007fcb9f9af287 00007fcb9f9af208
0709 12:17:36.011035 (+111379us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b1800177a00. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:36.272468 (+261433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.872525 (+600057us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b54000645d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:36.872571 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.872616 (+    45us) raft_consensus.cc:1685] finished
0709 12:17:36.872630 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.872754 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20258,"prepare.queue_time_us":41363,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":2117,"raft.queue_time_us":758038,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8322,"spinlock_wait_cycles":122503552,"thread_start_us":409455,"threads_started":2,"wal-append.queue_time_us":225273,"wal-append.run_cpu_time_us":2883,"wal-append.run_wall_time_us":1365700}
I20260709 12:17:36.889998 23844 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:36.893726 23948 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.894163 23948 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:36.900503 21036 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:36.907739 23819 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:36.915205 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 200671us
I20260709 12:17:36.917829 21182 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:36.918710 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.919214 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.920056 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.920322 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.920737 21182 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:36.921258 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.921569 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:36.926928 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 82450.2us
I20260709 12:17:36.932163 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.948379 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.949743 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.951156 21030 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:36.928288 23507 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.954980 23844 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:36.955859 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:36.958166 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.958523 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:36.986344 21103 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:36.861120 23800 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.987228 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:36.987430 21738 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:36.849613 23936 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:36.962733 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:36.962761 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:36.930775 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:36.991587 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:36.965464 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:36.966647 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:36.988446 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:36.992475 21029 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.992961 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:36.993136 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 62427.5us
I20260709 12:17:36.992129 21186 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.988993 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:36.957167 23774 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:36.992063 21111 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:37.001168 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.002735 23977 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:37.003153 23977 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:37.003489 23977 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.003573 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:37.003947 23954 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:36.993616 23819 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:17:36.961879 23931 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:17:36.990221 23615 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.999019 23936 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.009081 23936 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:36.997393 23507 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.963582 23949 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.011270 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:37.011322 23507 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:37.012244 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.013240 21151 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:37.013655 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.013866 23932 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:37.010603 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 45204.5us
I20260709 12:17:37.014956 23949 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.015617 20999 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.009039 23931 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:37.016696 23931 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:37.017131 23949 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:37.017560 23931 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:37.018680 23931 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:37.021879 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.022485 23819 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:37.024572 23939 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.025605 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.027860 23737 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.028482 23737 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:37.033397 23615 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:37.036134 21742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 385) took 1237 ms. Trace:
I20260709 12:17:37.036513 21742 rpcz_store.cc:276] 0709 12:17:35.799065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.799201 (+   136us) service_pool.cc:224] Handling call
0709 12:17:35.817890 (+ 18689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.871189 (+ 53299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.871217 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.871691 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.263523 (+391832us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:36.263558 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.035763 (+772205us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b54001effd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:37.035808 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.035849 (+    41us) raft_consensus.cc:1685] finished
0709 12:17:37.035862 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.036065 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4531,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":121768192,"thread_start_us":391513,"threads_started":1,"wal-append.queue_time_us":386245}
I20260709 12:17:37.041071 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.041771 21031 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:37.042434 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.043362 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.044238 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.044716 21031 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:37.045500 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:37.014662 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:37.048291 21027 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.049746 21186 raft_consensus.cc:2410] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:37.068441 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.123082 21029 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:37.123327 21036 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:17:37.136521 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:37.137746 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:37.142482 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:37.146304 23740 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:37.013512 23507 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.151739 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:36.962680 23874 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 12:17:37.156085 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:36.996706 23937 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.159575 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.160216 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:37.146705 23740 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.162541 21110 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:37.075170 23932 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.996404 23696 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.162s
I20260709 12:17:37.149784 23856 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:36.996809 23844 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.169535 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.170599 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.154297 23969 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:37.170686 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:37.162976 23891 consensus_meta.cc:287] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.000s
I20260709 12:17:37.174444 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.175336 21104 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:17:37.175803 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.176853 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.177789 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.181479 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2184) took 1016 ms. Trace:
W20260709 12:17:37.193235 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 229431us
I20260709 12:17:37.207404 21034 rpcz_store.cc:276] 0709 12:17:36.164767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.472895 (+308128us) service_pool.cc:224] Handling call
0709 12:17:36.473147 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:36.473321 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:36.716194 (+242873us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.181192 (+464998us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:37.181241 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:37.181280 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.181333 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.181428 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":139602,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":202,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"thread_start_us":706674,"threads_started":2}
I20260709 12:17:37.165107 23740 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:37.148494 23977 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.215373 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.219080 21105 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:17:37.220355 21105 pending_rounds.cc:85] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 6
I20260709 12:17:37.220559 21105 pending_rounds.cc:107] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:17:37.220770 21105 raft_consensus.cc:2889] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:37.221982 20999 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.223155 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.224313 23798 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:37.225025 23798 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:37.218104 23507 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:17:37.233186 23611 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.234306 23977 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.241531 20999 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.241556 21076 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:37.243008 23936 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:37.244264 23507 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:37.244570 20999 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.244755 23507 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:37.245304 23977 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.245623 23507 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.248507 23948 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.250667 21179 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:17:37.252278 23948 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:37.253165 23404 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:37.255156 23844 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.257761 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:37.258317 21183 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:37.258714 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:37.263288 21742 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:17:37.261894 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:37.276199 21186 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:37.197059 23856 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 9 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:37.278513 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:37.218071 23711 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.279489 23711 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:37.280200 23929 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:37.280658 23929 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:37.281531 23711 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:37.279435 23937 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:37.282074 23937 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:37.171681 23932 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:37.283999 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.285497 21077 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:37.197552 23792 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.297448 21077 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:37.299225 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:37.312103 21035 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:37.294800 23959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.013s	sys 0.019s
I20260709 12:17:37.294482 23937 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.293918 23876 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.302639 23891 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:37.281469 23929 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.321736 23259 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:37.389998 24020 log.cc:927] Time spent T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:37.391053 23856 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:37.393805 21027 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:37.395093 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:37.395920 23941 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:37.396023 23792 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.396451 23941 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:37.397307 23941 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.401574 23740 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.349207 23942 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:37.402310 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:37.402937 21178 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:17:37.320617 23959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.014s	sys 0.019s
W20260709 12:17:37.429126 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 131742us
I20260709 12:17:37.431053 21077 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:37.434016 24007 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:37.389048 23891 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:37.346510 23876 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.411093 23794 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:37.410115 23942 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:37.420794 23792 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:37.465873 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 159150us
I20260709 12:17:37.468289 21027 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:37.444844 23977 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:37.448902 23891 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.459811 23792 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.487751 23792 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.490422 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:37.470265 23932 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:37.489212 23959 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:37.510174 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:37.511358 21028 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:37.501317 23884 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.524339 23876 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.497133 23942 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.539359 21104 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.540417 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.542167 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:37.529548 24025 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:17:37.549721 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.550246 21104 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:37.559218 21028 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:37.561656 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:37.562290 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1367) took 1011 ms. Trace:
I20260709 12:17:37.562633 21035 rpcz_store.cc:276] 0709 12:17:36.550763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.614382 (+ 63619us) service_pool.cc:224] Handling call
0709 12:17:37.562129 (+947747us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b5400222ed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:37.562239 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583525632}
I20260709 12:17:37.564097 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.529253 23740 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:37.564160 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.591779 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.591687 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:37.669947 21108 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.564851 23888 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.580687 23967 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:37.665067 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.652072 23942 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.651625 21036 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:17:37.566002 23941 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:37.679322 24035 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:17:37.680378 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:37.702941 23860 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:37.703243 21106 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:37.681596 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.704500 23677 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.704843 21149 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.706491 23901 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:37.707257 21149 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:37.682075 23775 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:37.687372 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:37.692368 23967 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:37.709213 23967 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.713467 23937 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.703305 23860 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:37.719030 23860 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.719920 23860 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:37.730710 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.732832 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1540) took 1171 ms. Trace:
I20260709 12:17:37.733187 21107 rpcz_store.cc:276] 0709 12:17:36.561681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.561805 (+   124us) service_pool.cc:224] Handling call
0709 12:17:36.562067 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.664152 (+102085us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:36.664178 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.664558 (+   380us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.938855 (+274297us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:36.938895 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.732499 (+793604us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400305554. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:37.732544 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.732595 (+    51us) raft_consensus.cc:1685] finished
0709 12:17:37.732608 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.732778 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346,"raft.queue_time_us":605,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":9816,"spinlock_wait_cycles":233954048,"thread_start_us":225464,"threads_started":1,"wal-append.queue_time_us":325070}
I20260709 12:17:37.732401 23788 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:37.742208 23941 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:37.744208 20930 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 3 to 4, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:37.746228 23941 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:37.748725 23497 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.749292 23497 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:37.748679 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.752794 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.753429 21106 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:37.756830 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:37.757426 21102 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.758953 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.765596 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.734804 23615 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:37.768253 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.774052 21111 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:37.769658 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:37.775964 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.771473 21709 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:37.763748 23876 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.774819 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:37.742624 23788 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.840934 21108 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:37.841528 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:37.838019 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:37.843386 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 66336.2us
I20260709 12:17:37.850778 23876 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.851315 24041 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:37.851459 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 70382.1us
I20260709 12:17:37.851939 21110 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:37.852173 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.852921 24041 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.853513 21109 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:37.844312 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 72922.7us
I20260709 12:17:37.774540 23798 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.773432 23939 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:37.773758 23615 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:37.854378 21102 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:17:37.853464 23977 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:17:37.858127 23977 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:37.858461 23977 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:37.859215 23977 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.860301 23977 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:37.855124 24049 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:17:37.856870 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.849107 23874 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:37.863711 23874 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.864044 23874 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.864324 23819 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:37.857448 21149 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.868433 23805 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.869535 23615 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.870115 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 328) took 1273 ms. Trace:
I20260709 12:17:37.870464 21105 rpcz_store.cc:276] 0709 12:17:36.596377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.596490 (+   113us) service_pool.cc:224] Handling call
0709 12:17:36.606059 (+  9569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.221261 (+615202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.869904 (+648643us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54000f8f54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:37.870059 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398000000}
I20260709 12:17:37.843163 24042 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.895486 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.896106 21029 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:37.897455 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.897670 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.898535 21027 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:17:37.880165 21149 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.888334 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:37.899680 21108 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:37.893759 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.898984 21076 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:37.901202 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:37.903033 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.904280 23615 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:37.902704 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:37.906297 23615 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:37.857281 23876 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.904758 23856 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:37.913992 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.914040 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:37.915441 21179 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:37.895285 23497 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:37.919817 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:37.921695 23959 consensus_queue.cc:1059] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:37.922295 21030 pending_rounds.cc:85] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 4
I20260709 12:17:37.922573 21030 pending_rounds.cc:107] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:17:37.922793 21030 raft_consensus.cc:2889] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:37.907284 23939 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.921298 23507 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:37.925655 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2186) took 1528 ms. Trace:
I20260709 12:17:37.929243 21032 rpcz_store.cc:276] 0709 12:17:36.397071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.660987 (+263916us) service_pool.cc:224] Handling call
0709 12:17:36.661256 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.730656 (+ 69400us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:36.760318 (+ 29662us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.839751 (+ 79433us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.840240 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.840367 (+   127us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:36.840403 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.913933 (+1073530us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54001c0a54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:37.913976 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.914019 (+    43us) raft_consensus.cc:1685] finished
0709 12:17:37.925456 (+ 11437us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.925599 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32151,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":1053,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":10285,"spinlock_wait_cycles":158742912,"thread_start_us":79073,"threads_started":1,"wal-append.queue_time_us":81085,"wal-append.run_cpu_time_us":1769,"wal-append.run_wall_time_us":1010596}
I20260709 12:17:37.921578 21035 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:37.928030 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:37.928606 21179 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:37.909178 23773 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.931171 21178 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.909811 23944 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:37.921489 23788 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.936177 21178 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:37.937806 23794 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:37.939939 23939 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:37.943432 21107 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:37.943845 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:37.945204 23874 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:37.947170 23775 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:37.904289 23774 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:17:37.929070 23507 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.952931 21108 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:37.931420 23959 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:37.958086 23891 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:37.959885 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:37.974931 23967 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:17:37.984225 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:37.978434 24018 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.978875 23957 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:37.981940 21177 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:37.986100 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:37.964588 23794 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.038770 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.048626 21077 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:37.981304 23507 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:37.981187 23959 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:38.059587 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:37.978024 23775 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.061570 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:38.064893 21028 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:38.036374 23856 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:37.976339 23860 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:17:38.043870 23936 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:37.967730 23939 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:38.073210 24030 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.573s	user 0.003s	sys 0.000s
I20260709 12:17:38.074386 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1387) took 1035 ms. Trace:
I20260709 12:17:38.074726 21034 rpcz_store.cc:276] 0709 12:17:37.038890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.209100 (+170210us) service_pool.cc:224] Handling call
0709 12:17:37.209401 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:37.248991 (+ 39590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:37.249020 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:37.249518 (+   498us) log.cc:844] Serialized 52 byte log entry
0709 12:17:37.467430 (+217912us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:37.662381 (+194951us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.664908 (+  2527us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.665116 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.665185 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.958672 (+293487us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b1800199de0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:38.072629 (+113957us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:38.074198 (+  1569us) raft_consensus.cc:1685] finished
0709 12:17:38.074217 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.074333 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33373,"prepare.queue_time_us":344856,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":18645,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":7334,"spinlock_wait_cycles":16920576,"thread_start_us":350315,"threads_started":2,"wal-append.queue_time_us":221699}
I20260709 12:17:38.079382 23876 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.081730 23939 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.030812 24018 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.084160 24018 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.085556 23874 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:38.086488 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:38.087184 21034 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:38.057037 23891 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:38.090631 23891 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.091002 23891 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.093225 23775 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:17:38.065474 23865 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:17:38.062927 23788 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:17:38.095533 23788 consensus_queue.cc:1243] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:38.095988 23788 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:38.096280 23788 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:38.097013 23788 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.098040 23788 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.099138 23959 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.100337 23959 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.109774 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:38.110610 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:38.114156 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 201536us
I20260709 12:17:38.064747 23404 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.121697 21028 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:38.124605 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:38.124615 23677 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:38.125240 21106 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.127591 23404 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.129745 23404 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.130884 23936 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.133615 24004 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:38.130906 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1361) took 1581 ms. Trace:
I20260709 12:17:38.134825 21033 rpcz_store.cc:276] 0709 12:17:36.549499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.752720 (+203221us) service_pool.cc:224] Handling call
0709 12:17:36.753002 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.795541 (+ 42539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.795597 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:37.043956 (+248359us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b1800301ae0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a
0709 12:17:37.044356 (+   400us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b2c00058028. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:17:37.044820 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:17:37.295064 (+250244us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:37.475707 (+180643us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.562755 (+ 87048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.562822 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.129043 (+566221us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b1800301ae0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:17:38.130712 (+  1669us) raft_consensus.cc:1685] finished
0709 12:17:38.130732 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.130853 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25155,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":1997,"raft.queue_time_us":56638,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":8687,"spinlock_wait_cycles":24500992,"thread_start_us":488057,"threads_started":3,"wal-append.queue_time_us":306208}
I20260709 12:17:38.134019 23936 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.142974 24042 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.144302 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:38.144829 23773 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.145526 21178 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:38.145923 23937 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.138361 23924 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:38.134114 24004 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.153487 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:38.163373 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:38.163612 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.186916 21186 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:38.142576 23794 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.200142 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:38.202935 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:38.201645 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:38.195508 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:38.208258 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:38.208361 21075 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:38.172857 23924 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:38.219411 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:38.221804 20999 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.222405 21109 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:38.226337 21184 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:38.228020 23774 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:38.228525 23774 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.229575 24004 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.230406 23774 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.227686 23856 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.234993 23967 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:38.235406 23967 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:38.236188 23967 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.237462 23967 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.224947 23497 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.239179 23497 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.239518 23497 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.200783 23932 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:17:38.252558 24041 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.273113 23507 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.274283 21103 raft_consensus.cc:2368] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9.
I20260709 12:17:38.278331 23936 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:38.189620 21178 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:38.187536 21106 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:38.290949 21709 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:38.291886 23874 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:38.292371 23874 raft_consensus.cc:697] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 7 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:38.293165 23874 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:38.301012 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 117908us
I20260709 12:17:38.294353 23891 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.306674 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:38.307379 21036 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:38.305078 21000 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.318251 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:38.320032 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 136926us
I20260709 12:17:38.327212 21000 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.329540 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:38.330054 21035 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.336035 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:38.316157 23969 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.301862 23497 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:38.340487 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 159871us
I20260709 12:17:38.335009 23937 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:17:38.346865 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 287317us
I20260709 12:17:38.333145 24042 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:38.347311 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:38.348712 21106 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:38.351840 21035 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
W20260709 12:17:38.355875 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 149193us
I20260709 12:17:38.342075 23969 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.356837 21077 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:38.360073 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:38.362022 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:38.362588 21028 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.352723 24063 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.352550 23876 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.372751 23773 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.358098 23941 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:17:38.392518 21028 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:38.387620 21150 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.358884 23937 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:38.363524 24007 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.365015 24018 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.365267 23788 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.370940 23860 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:38.411723 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 75414.4us
I20260709 12:17:38.415606 21150 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:38.400549 23507 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.407881 23963 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.459226 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.458189 23404 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.420589 24041 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:38.464327 23404 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.399895 23773 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.466477 23404 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.419152 23932 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:38.467181 23932 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:38.467692 24062 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:17:38.466675 23773 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.469260 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:38.470172 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:38.471192 21106 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:38.415338 23888 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:38.397352 23876 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.478953 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:38.468588 23977 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:38.480641 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:38.410199 24007 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.464982 24041 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.395915 24063 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:38.490269 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 312701us
I20260709 12:17:38.507407 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:38.513343 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 100990us
I20260709 12:17:38.515820 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:38.518834 21000 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.480518 23937 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.472846 24068 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:38.522383 21182 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:38.526999 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.528199 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.519600 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:38.530588 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:38.532658 21028 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.538162 21000 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.539286 23798 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.499488 23977 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:38.516175 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:38.513661 23891 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.542512 21712 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:38.513432 23947 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.515041 23696 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:38.525539 23939 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:38.481263 23888 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.490557 24065 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:38.544353 24066 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:38.570916 21028 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:38.566032 21032 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:17:38.540380 23497 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.564124 23696 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:38.596115 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 53665.8us
I20260709 12:17:38.585862 23696 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.579010 24080 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.569351 24079 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:17:38.598639 21712 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:38.566836 23947 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:38.595696 24069 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 12:17:38.600234 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 74864.9us
I20260709 12:17:38.602487 21151 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:38.601197 24077 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:17:38.609890 23947 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.610759 23876 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.574088 24065 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.618039 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:38.618976 23943 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:17:38.623015 24076 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:17:38.594552 23977 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.613008 24068 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.629843 24063 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.630785 23888 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:38.632117 23959 consensus_meta.cc:287] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.001s
I20260709 12:17:38.633955 24065 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.637959 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:38.630101 23924 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.628808 24041 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.651137 23924 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.660899 23696 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.662061 21181 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:38.663139 23696 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.646490 23969 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.675539 21177 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:38.676519 23969 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.680107 23888 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.681360 23888 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.688796 23888 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:38.697393 24067 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:17:38.702308 23860 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.705309 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:38.705905 21036 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:38.708616 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:38.708881 21030 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:38.709450 21032 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:38.712543 24068 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.713059 24068 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.709614 24065 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:38.720553 24065 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:38.732321 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.733248 21178 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:38.734339 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:38.734874 21178 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.735903 21184 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:17:38.736238 21184 pending_rounds.cc:85] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 4
I20260709 12:17:38.736443 21184 pending_rounds.cc:107] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:17:38.736682 21184 raft_consensus.cc:2889] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:38.737931 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:38.738324 21184 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.738233 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:38.738865 21182 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.740738 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.741528 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.744886 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:38.724960 23943 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.746299 23943 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.748219 23943 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:38.724316 23967 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.748836 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:38.754724 21178 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:38.774330 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:38.776023 21182 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:38.783806 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:38.784534 23954 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:38.785027 23954 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:38.785816 23954 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.784637 21077 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:38.794976 23860 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:38.795449 23860 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:38.796303 23860 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.797013 21184 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:38.798096 21077 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:38.798807 23959 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:38.799312 23959 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:38.800150 23959 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.801491 24065 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.802620 24065 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.799332 24068 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.771384 23788 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:17:38.772774 23967 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.810380 23967 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:38.811069 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:38.812942 23977 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:38.813464 23977 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:38.813862 24088 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:17:38.815426 23977 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.816416 23794 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:38.839097 23932 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.840597 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.840905 21151 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.854233 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.856935 24007 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.859050 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:38.860301 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.863898 21179 raft_consensus.cc:2368] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:38.873435 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.875320 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:38.877283 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:38.884280 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.886080 20999 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:38.888235 21002 leader_election.cc:400] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:38.888550 21002 leader_election.cc:403] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:38.889139 23884 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:38.889776 23884 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:38.899278 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:38.900240 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:38.868152 23794 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:38.868028 23860 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:38.902644 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 304342us
I20260709 12:17:38.891294 23944 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:38.945808 23944 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:38.946214 23944 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.902032 23939 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.902195 23884 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:38.910964 24075 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.912703 23967 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:38.947408 23884 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.881009 23788 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.948717 23788 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:38.949466 23884 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:38.928205 21110 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:17:38.951711 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:38.953642 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:38.954203 21179 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:38.954502 21181 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:17:38.929847 21104 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:38.955408 21181 pending_rounds.cc:85] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 6
I20260709 12:17:38.955695 21181 pending_rounds.cc:107] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:17:38.955909 21181 raft_consensus.cc:2889] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:38.957826 21077 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:38.942322 23993 consensus_queue.cc:1059] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:38.950636 23788 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:38.961688 23860 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:38.980865 24071 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:38.994292 24007 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.002277 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:39.009928 21109 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:39.010265 21107 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:17:39.054593 21107 pending_rounds.cc:85] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 5
I20260709 12:17:39.054836 21107 pending_rounds.cc:107] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:17:39.055088 21107 raft_consensus.cc:2889] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:39.011899 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:39.019634 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:39.056502 21111 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:39.021100 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:39.022248 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:39.023443 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.058209 21741 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:39.022128 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:39.024748 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:39.056375 21030 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:39.025024 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:39.025405 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.025869 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.026304 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.025975 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.032279 24075 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:17:39.042865 21149 leader_election.cc:400] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9.
I20260709 12:17:39.075680 21149 leader_election.cc:403] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:17:39.076128 24087 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:39.078459 23773 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9.
W20260709 12:17:39.043561 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 98468.8us
W20260709 12:17:39.051929 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 56623.4us
I20260709 12:17:39.023494 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:39.070554 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.073081 24056 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:39.081862 21150 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:39.097481 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.097519 21105 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:39.102584 20930 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:37.845621 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:39.112795 21150 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:39.113992 21150 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:39.047362 24065 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:39.115010 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.132228 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:39.134974 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.137677 21149 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:39.138069 21030 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:39.145474 23800 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.145712 23901 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:39.146574 23865 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:39.147562 21149 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:39.148926 23949 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:39.149297 23949 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.149626 23949 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.054194 23774 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:17:39.120596 23404 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:39.126808 24065 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.123112 23805 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:39.161824 23800 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.096987 23711 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:17:39.131922 23615 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:39.066025 24007 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:39.174579 21000 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:39.160251 21150 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:39.191447 24041 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:39.173769 23774 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.194772 23774 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:39.196206 23860 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:39.199005 23774 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:39.200273 24058 raft_consensus.cc:3055] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:39.171890 24065 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.200688 24058 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:17:39.206497 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 46324us
I20260709 12:17:39.243623 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:39.217831 23773 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:39.245541 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 339188us
I20260709 12:17:39.248576 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:39.271564 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:39.244546 23936 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:39.274137 21179 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:39.275365 23977 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.281963 23942 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:39.283144 23936 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.285650 23936 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:39.281724 23977 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:39.294984 24058 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:39.296303 24058 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:39.296453 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:39.297381 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.295627 23977 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:39.298208 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:39.262944 24057 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.064s	sys 0.126s
I20260709 12:17:39.267900 23932 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:39.246045 23944 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:39.314518 24042 consensus_queue.cc:1059] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:17:39.319578 21740 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:17:39.267787 24080 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:17:39.327327 21177 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:39.299849 23865 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:39.304380 23936 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:39.304698 24057 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.064s	sys 0.126s
W20260709 12:17:39.321182 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 187886us
I20260709 12:17:39.336020 21076 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:39.350437 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:39.351303 21036 raft_consensus.cc:2410] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:17:39.351714 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:39.352485 21035 raft_consensus.cc:2410] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:17:39.352746 23800 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:39.359674 24100 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:17:39.332471 24042 raft_consensus.cc:3055] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:39.324292 23932 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:17:39.340657 23865 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:39.373860 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 286876us
I20260709 12:17:39.379160 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:39.361515 24007 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:39.365288 23800 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.367211 24042 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:39.412611 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:39.415359 24102 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:39.376237 23865 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:39.375728 23874 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:17:39.419721 23800 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.444286 23968 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:39.424945 23865 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:39.510031 24103 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:17:39.510391 23800 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:39.497960 23944 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:39.486614 23968 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.488401 24065 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:39.533167 24110 log.cc:927] Time spent T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:39.547744 21178 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:39.493443 24042 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.549392 23874 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:39.550140 24042 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.562999 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:39.541934 23949 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.568014 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:39.574589 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:39.574746 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:39.574044 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:39.549431 23968 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:39.579798 21178 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:39.584671 21179 raft_consensus.cc:2368] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
W20260709 12:17:39.585315 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 113728us
I20260709 12:17:39.590432 23774 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:39.591741 23774 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:39.592555 23774 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:39.593633 23774 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.598907 21108 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:17:39.601452 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:39.583499 23936 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.606882 23936 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.608956 23936 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:39.615852 23949 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:39.617774 23865 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:39.620117 23865 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:39.621387 24065 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:39.632813 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:39.636968 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:39.637555 21108 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.645526 21102 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:39.647663 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:39.649747 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:39.652938 21077 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:39.659696 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:39.660266 21029 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.661725 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:39.662267 21182 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:39.663511 21178 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:39.672830 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:39.673329 21181 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.680922 21181 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:39.681505 21029 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
W20260709 12:17:39.682314 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54035.6us
I20260709 12:17:39.685704 21181 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:39.684842 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:39.687597 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:39.689189 21077 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:39.690265 23860 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:39.690676 23865 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:39.692198 24120 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:39.692683 24120 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:39.693477 24120 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.690622 23860 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.695497 23860 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.699808 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:39.700428 21102 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:17:39.651571 23969 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:39.679051 24119 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:39.707034 21108 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:39.705101 24119 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.730273 24119 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:39.745447 23860 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.750164 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2065) took 1018 ms. Trace:
I20260709 12:17:39.767894 21186 rpcz_store.cc:276] 0709 12:17:38.732046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.732180 (+   134us) service_pool.cc:224] Handling call
0709 12:17:38.732459 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:38.809521 (+ 77062us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:38.867467 (+ 57946us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.251159 (+383692us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.268505 (+ 17346us) log.cc:844] Serialized 26 byte log entry
0709 12:17:39.268650 (+   145us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:39.268861 (+   211us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.280642 (+ 11781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.749772 (+469130us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b5400387054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:39.749820 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:39.749953 (+   133us) raft_consensus.cc:1685] finished
0709 12:17:39.749970 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:39.750105 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10072,"prepare.queue_time_us":59133,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":9415,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":18760,"spinlock_wait_cycles":176376448,"thread_start_us":435266,"threads_started":2,"wal-append.queue_time_us":498993}
I20260709 12:17:39.753633 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:39.760519 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 158749us
W20260709 12:17:39.764935 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.778505 21075 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:39.780375 21150 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:39.781343 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:39.781874 21075 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:39.781978 21186 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:39.784497 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:39.790293 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:39.791206 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 106138us
I20260709 12:17:39.786324 23942 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:39.786545 24105 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:39.787554 24078 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:39.789211 24065 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:39.796511 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:39.797380 21149 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:39.799577 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:39.805445 23942 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:39.805951 23942 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:39.791009 23798 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:17:39.808961 23977 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:39.831851 24101 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:39.832314 24101 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.832645 24101 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:39.857323 24117 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:17:39.860504 24065 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:39.868528 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.856247 23954 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:39.877432 23954 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.806875 23942 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:39.874069 24119 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:41.140503 24119 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:42.099225 20965 debug-util.cc:398] Leaking SignalData structure 0x7b0800089240 after lost signal to thread 19891
I20260709 12:17:43.296027 23954 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:43.305388 24101 consensus_meta.cc:287] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 3.472s	user 0.028s	sys 0.017s
I20260709 12:17:43.318212 24101 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.330590 24147 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.330693 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 355) took 3641 ms. Trace:
I20260709 12:17:43.334966 24147 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.334448 21111 rpcz_store.cc:276] 0709 12:17:39.688778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.689023 (+   245us) service_pool.cc:224] Handling call
0709 12:17:39.689309 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.689637 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.689664 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.690086 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:17:39.757713 (+ 67627us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:39.757752 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.757808 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:43.330041 (+3572233us) raft_consensus.cc:1685] finished
0709 12:17:43.330098 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:43.330393 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2523,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":66169,"threads_started":1,"wal-append.queue_time_us":116100,"wal-append.run_cpu_time_us":2011,"wal-append.run_wall_time_us":1826210}
I20260709 12:17:43.343492 24149 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:43.345770 24149 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.339663 24148 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.349740 24148 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.351503 24150 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.354214 24150 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:43.356976 21709 connection.cc:256] RPC call timeout handler was delayed by -2.3368726840001273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 12:17:43.357805 24145 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.358538 24145 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.361511 24145 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.363160 24143 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.363977 24143 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.366410 24143 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.379071 24122 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.379878 24122 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.382141 24122 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.385421 24122 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.386130 24122 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.388571 24122 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.389194 24122 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.390043 24122 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.401060 24122 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:43.430045 21179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1692) took 4134 ms (client timeout 1752 ms). Trace:
I20260709 12:17:43.432340 23888 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.433122 23888 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:43.430464 21179 rpcz_store.cc:269] 0709 12:17:39.295559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.296222 (+   663us) service_pool.cc:224] Handling call
0709 12:17:43.429571 (+4133349us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540001a9d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:43.429832 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661016960}
I20260709 12:17:43.440174 23259 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.440925 23259 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.443532 23259 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.465507 21105 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:43.499683 24152 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:43.504673 24152 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.516214 24152 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.505102 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:43.527604 24004 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:43.528039 24004 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:43.528467 24004 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:43.502440 24153 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:43.503855 23954 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:43.517803 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 3.72088e+06us
I20260709 12:17:43.634024 24153 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.671527 24152 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.672286 24152 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.674530 24152 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.680943 23937 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.681306 24151 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.681717 23937 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.682014 24151 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.684137 23937 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.684161 24151 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.684448 23954 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.688004 24151 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.693259 24151 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.687111 23954 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:43.704037 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 175810us
I20260709 12:17:43.705606 24151 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.706972 24124 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.711439 24148 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.688200 23937 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.713037 24149 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.714879 24139 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.690868 24004 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.698596 24152 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.735114 24139 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.740327 23937 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.735110 24124 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.748409 24149 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.750345 24139 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.752123 24153 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.755827 23937 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.756512 24149 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.757874 24124 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.758211 24149 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.758383 24156 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.759120 24156 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.760301 24161 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.760874 24161 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.761386 24156 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.761742 24162 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.762171 24153 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.762372 24162 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.762820 24153 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.765210 24153 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.765341 24161 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.765769 24153 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.766676 24153 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.767948 24162 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.766024 24161 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.771065 24161 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.771504 23954 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.772812 23954 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.773304 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 402) took 4673 ms. Trace:
I20260709 12:17:43.773597 24153 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.750355 24004 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:43.773690 21184 rpcz_store.cc:276] 0709 12:17:39.099592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.099863 (+   271us) service_pool.cc:224] Handling call
0709 12:17:39.100142 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.134148 (+ 34006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.134175 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.164539 (+ 30364us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b18001e1d20. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a
0709 12:17:39.165557 (+  1018us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b2c00061b88. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:17:39.165966 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 12:17:39.575788 (+409822us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:39.575824 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.575881 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:39.861045 (+285164us) raft_consensus.cc:1685] finished
0709 12:17:39.861065 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:43.773071 (+3912006us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33658,"raft.queue_time_us":35413,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":7085,"spinlock_wait_cycles":8758016,"thread_start_us":409569,"threads_started":1,"wal-append.queue_time_us":544196,"wal-append.run_cpu_time_us":2084,"wal-append.run_wall_time_us":1203514}
I20260709 12:17:43.776285 24152 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.773707 24161 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.788261 24154 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:17:43.788741 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.791006 24004 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:43.791626 24004 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:43.802342 21105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1594) took 4115 ms (client timeout 1688 ms). Trace:
I20260709 12:17:43.788951 24154 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.807385 24139 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.808105 24139 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.810184 24139 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.814378 24004 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:43.815290 23954 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:43.802770 21105 rpcz_store.cc:269] 0709 12:17:39.687225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.687368 (+   143us) service_pool.cc:224] Handling call
0709 12:17:43.802060 (+4114692us) spinlock_profiling.cc:243] Waited 3.78 s on lock 0x7b5400181354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:43.802232 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8685618944}
I20260709 12:17:43.821761 24101 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.805603 24152 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.823186 24154 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.824069 23884 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.826525 23884 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.827548 23937 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.828209 23937 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.828819 23884 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.829452 24146 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.826825 24148 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:43.833611 24154 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.834450 24152 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.830806 24149 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:43.825438 23954 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:43.835254 21076 connection.cc:256] RPC call timeout handler was delayed by -1.7663998200000606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 12:17:43.835414 24153 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.836095 24153 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.838131 24153 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.831532 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1431) took 4555 ms. Trace:
I20260709 12:17:43.832828 24161 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.835654 23954 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.835258 24152 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:43.839917 21076 connection.cc:256] RPC call timeout handler was delayed by -1.6745998200001395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 12:17:43.840255 21076 connection.cc:256] RPC call timeout handler was delayed by -1.6268998200000624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
I20260709 12:17:43.841102 23954 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.830006 24146 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.830097 23937 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.834211 24148 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.834290 24154 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.831997 24150 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.838610 21034 rpcz_store.cc:276] 0709 12:17:39.276296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.276393 (+    97us) service_pool.cc:224] Handling call
0709 12:17:39.276678 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.276985 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:39.282338 (+  5353us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.557633 (+275295us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:43.489530 (+3931897us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b2c00058028. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:17:43.490313 (+   783us) log.cc:844] Serialized 26 byte log entry
0709 12:17:43.696679 (+206366us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:43.696720 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:43.699044 (+  2324us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:43.824630 (+125586us) raft_consensus.cc:1685] finished
0709 12:17:43.825740 (+  1110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:43.831310 (+  5570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4398,"prepare.queue_time_us":5628,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":38,"raft.queue_time_us":13784,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":1473,"spinlock_wait_cycles":71907072,"thread_start_us":474916,"threads_started":2,"wal-append.queue_time_us":448249,"wal-append.run_cpu_time_us":999,"wal-append.run_wall_time_us":1005887}
I20260709 12:17:43.853861 24161 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.854820 24148 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.850649 24152 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.841831 24101 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.854877 24154 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.855929 24161 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.856262 24101 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.858484 24101 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.835274 24149 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.861536 24149 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.855953 24146 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.864926 24146 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.865482 24146 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.868178 24149 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.867947 24153 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.869220 24146 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.869186 24153 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.868860 24149 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.870677 23860 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.871368 24153 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.872768 24149 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:43.877076 21076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.045s (SENT) [suppressed 40 similar messages]
I20260709 12:17:43.876538 24148 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.878154 24148 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.879196 23937 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.880456 23937 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.882488 23937 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.891712 23932 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.892251 24150 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:43.920811 23932 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.921065 24150 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.895118 23884 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.924219 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:43.924494 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:43.925182 21742 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:43.908038 24166 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.926504 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:43.927179 21743 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 3.
I20260709 12:17:43.927479 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:43.925897 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:43.928341 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:43.928501 24007 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.923460 23884 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.894876 24151 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:43.928989 24007 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.926920 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:43.929721 24151 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.931777 24007 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.932034 24151 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.891677 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 400) took 4842 ms. Trace:
I20260709 12:17:43.900938 24165 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.932546 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:43.932585 24007 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.932972 21738 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:43.935370 23884 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.935128 24007 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.933212 21177 rpcz_store.cc:276] 0709 12:17:39.049055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.050608 (+  1553us) service_pool.cc:224] Handling call
0709 12:17:39.050869 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.327721 (+276852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:43.891209 (+4563488us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540033cf54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:43.891501 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635371904}
I20260709 12:17:43.927716 24164 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.894651 24139 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.937819 24139 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:43.912856 20999 connection.cc:256] RPC call timeout handler was delayed by -2.8083623130000888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:17:43.938911 20999 connection.cc:256] RPC call timeout handler was delayed by -2.5467196520000925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 12:17:43.939214 23936 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:43.939610 24146 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.939967 23936 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.940697 24146 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.942781 23936 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.942894 24146 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.943372 23936 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:43.943531 24146 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.944070 23936 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.944404 24154 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.944257 24146 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.945024 24154 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.946127 23936 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.946543 24146 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.947088 23876 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.955813 23800 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:43.955945 23876 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.947638 23860 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:43.948426 24139 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.937144 24164 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.926733 24166 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.955194 23954 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:43.962873 23954 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.963922 24166 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:43.949328 21002 connection.cc:256] RPC call timeout handler was delayed by -2.9932014339999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 12:17:43.964819 23954 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:43.910185 21077 connection.cc:256] RPC call timeout handler was delayed by -1.8093924489999154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:17:43.892576 24042 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:43.968538 24042 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.968916 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:43.969446 21036 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:43.970562 24042 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:44.037564 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.038261 21036 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:43.933733 24165 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:43.955076 23932 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.956496 23800 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.044572 24165 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:44.044832 23800 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:44.045034 23876 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.884773 24148 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.885202 24101 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:44.045831 24101 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.047809 24101 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.885080 24161 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:44.048528 24161 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.050571 24161 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.937242 24007 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.960029 24164 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.960209 24153 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:44.051854 24153 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.053808 24153 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.966663 23860 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.055238 24147 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:44.056161 23860 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:43.967623 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.056887 21028 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:43.956976 24152 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:44.057664 24152 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.059612 24152 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.900081 23937 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:44.060429 23937 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:43.999934 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:44.001608 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.007864 24150 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:43.958875 24154 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:44.061890 21035 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:44.063009 24154 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:44.063618 24154 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.061064 21030 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:17:44.064580 21030 pending_rounds.cc:85] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 4
I20260709 12:17:44.064829 21030 pending_rounds.cc:107] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:17:44.065114 21030 raft_consensus.cc:2889] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:44.065481 24154 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:44.066004 21075 connection.cc:256] RPC call timeout handler was delayed by -2.12250825000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
I20260709 12:17:44.064011 23937 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:44.067507 21030 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:44.068554 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:44.051851 21109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.298s	user 0.020s	sys 0.043s
W20260709 12:17:44.069164 21109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.316s	user 0.020s	sys 0.044s
I20260709 12:17:44.069669 21111 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:44.071460 24031 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:44.073441 21030 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:44.071398 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 360) took 4319 ms. Trace:
I20260709 12:17:44.084640 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.085268 21031 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:44.075387 21109 rpcz_store.cc:276] 0709 12:17:39.751770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.751903 (+   133us) service_pool.cc:224] Handling call
0709 12:17:39.752213 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.752528 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.752556 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.752940 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 12:17:44.070971 (+4318031us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:44.071031 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.071135 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:44.071173 (+    38us) raft_consensus.cc:1685] finished
0709 12:17:44.071182 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:44.071328 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":148,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":67,"thread_start_us":4316219,"threads_started":1,"wal-append.queue_time_us":3546730}
I20260709 12:17:44.089112 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:44.090889 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:44.091440 21028 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.091660 20930 catalog_manager.cc:5697] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 3 to 6, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:44.093479 24094 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 4.838s	user 0.020s	sys 0.028s
I20260709 12:17:44.094164 20930 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 2 to 5, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 5 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:44.099668 20930 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 3 to 6, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 6 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:17:44.101759 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 224699us
I20260709 12:17:44.134991 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.135680 21109 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:44.137794 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.119179 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.139846 21031 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:44.146031 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.146680 21108 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:44.146896 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.150205 21028 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:44.147564 21103 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:17:44.154034 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.154698 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.156028 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.156682 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.157063 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.157194 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.157744 21033 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
W20260709 12:17:44.156816 20933 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49682 (request call id 219) took 23324 ms (client timeout 15000 ms). Trace:
I20260709 12:17:44.157872 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.155164 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.159044 21035 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:44.157495 20930 catalog_manager.cc:5697] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 5 to 6, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 6 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:44.162081 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:44.162810 21028 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:44.162668 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.168984 21030 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:44.163285 21110 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 2.
I20260709 12:17:44.171537 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.172170 21032 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:44.173061 20930 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 2 to 5, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:17:44.158282 20933 rpcz_store.cc:269] 0709 12:17:20.832084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.837387 (+  5303us) service_pool.cc:224] Handling call
0709 12:17:44.156561 (+23319174us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:34.691773 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:34.715277 (+ 23504us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:34.715322 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:17:34.715339 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:34.722513 (+  7174us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:34.722597 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:34.722624 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:17:34.723772 (+  1148us) tablet.cc:701] Row locks acquired
0709 12:17:34.723817 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:17:34.723983 (+   166us) write_op.cc:270] Start()
0709 12:17:34.724114 (+   131us) write_op.cc:276] Timestamp: P: 1783599454723924 usec, L: 0
0709 12:17:34.724135 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:17:34.724747 (+   612us) log.cc:844] Serialized 6286 byte log entry
0709 12:17:35.260431 (+535684us) op_driver.cc:464] REPLICATION: finished
0709 12:17:35.576383 (+315952us) write_op.cc:301] APPLY: starting
0709 12:17:35.576457 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:35.607004 (+ 30547us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:35.607119 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:35.613013 (+  5894us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:35.613275 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:17:35.613318 (+    43us) write_op.cc:312] APPLY: finished
0709 12:17:35.613643 (+   325us) log.cc:844] Serialized 113 byte log entry
0709 12:17:35.613809 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:35.613968 (+   159us) write_op.cc:454] Released schema lock
0709 12:17:35.614017 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:35.614404 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:35.614441 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":799585,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":301137,"apply.run_cpu_time_us":3844,"apply.run_wall_time_us":37993,"num_ops":16,"prepare.queue_time_us":174886,"prepare.run_cpu_time_us":12654,"prepare.run_wall_time_us":126895,"raft.queue_time_us":224950,"raft.run_cpu_time_us":10204,"raft.run_wall_time_us":317694,"replication_time_us":499073,"thread_start_us":449539,"threads_started":4,"wal-append.queue_time_us":190781,"wal-append.run_cpu_time_us":24358,"wal-append.run_wall_time_us":1697672}]]}
W20260709 12:17:44.178917 20965 debug-util.cc:398] Leaking SignalData structure 0x7b0800039f80 after lost signal to thread 20968
I20260709 12:17:44.174600 20930 catalog_manager.cc:5697] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:44.191640 24131 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:44.192247 24131 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.195084 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.195643 21179 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:44.195678 21110 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:44.194576 24131 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:44.230875 23773 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:44.231516 23773 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.231753 20930 catalog_manager.cc:5697] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 1 to 2, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 2 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:44.233691 23773 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:44.234200 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.233786 20930 catalog_manager.cc:5697] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 6, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:44.231403 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.256458 21110 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:44.223574 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:44.258354 23901 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.258726 24129 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:44.258927 23901 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.259430 24129 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.261471 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.262748 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.263918 24101 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:44.267273 24101 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.269517 24101 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:44.270328 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:44.271528 23968 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:44.272274 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.272070 23968 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.273365 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.274120 23968 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:44.274367 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.275177 20930 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 5, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:44.278927 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.279642 21034 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:44.280926 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.281780 21183 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:44.263972 21182 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:44.263325 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.310170 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.310914 23924 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.311365 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.311457 23924 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.312016 21178 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:44.312568 24072 consensus_queue.cc:1059] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:44.313334 23944 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:44.313580 23924 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:44.313743 24072 raft_consensus.cc:3055] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:44.313918 23944 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.314540 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:44.282320 24150 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:44.312816 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.316145 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.291922 24134 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:44.314110 21179 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:44.263764 24148 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:44.317876 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.328416 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.292263 24130 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:44.324589 21185 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:44.292856 23773 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:44.315640 23968 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:44.339465 23677 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:44.339936 23924 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.340097 23677 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.340160 23968 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.326617 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:44.340701 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.340528 23924 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.341105 23942 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.339636 24068 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:44.342005 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.339387 21110 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:44.338874 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:44.333290 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.340294 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.314163 24072 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:44.346222 21027 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:44.354730 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:44.360076 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 285895us
I20260709 12:17:44.341627 23942 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.355473 24068 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.339794 24148 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.336923 24134 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.369271 24131 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:44.369177 24179 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.354329 21739 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:44.339515 23944 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:44.326747 24150 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.368636 24130 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.716550 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.828696 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:44.845631 21028 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.831830 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.421069 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.832203 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.578487 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.388746 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:44.837213 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:44.834147 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:44.743884 21109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.007s	sys 0.042s
I20260709 12:17:44.847424 21032 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:44.627671 21179 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:17:44.393038 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.651508 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:44.851312 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08003db2c0 after lost signal to thread 21060
W20260709 12:17:44.851881 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08003db2a0 after lost signal to thread 21061
I20260709 12:17:44.850363 21027 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:44.699638 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.857235 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.857852 21105 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:44.389211 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:44.831178 24175 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:17:44.774152 24172 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:17:44.861143 20965 debug-util.cc:398] Leaking SignalData structure 0x7b080035a880 after lost signal to thread 21136
I20260709 12:17:44.859216 21741 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
W20260709 12:17:44.857283 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aaaf493e892d4ee9839b45b601fc8400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:44.871142 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.871393 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.873553 21181 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:44.871748 21032 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:44.374270 23968 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:44.392678 23901 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:44.390730 24129 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:44.874414 21185 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:44.773294 23696 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:44.870244 20965 debug-util.cc:398] Leaking SignalData structure 0x7b080035aac0 after lost signal to thread 21137
W20260709 12:17:44.896036 20965 debug-util.cc:398] Leaking SignalData structure 0x7b0800345320 after lost signal to thread 21211
I20260709 12:17:44.898568 21737 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:44.378938 23773 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.900213 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:44.901027 20965 debug-util.cc:398] Leaking SignalData structure 0x7b080033db20 after lost signal to thread 21212
I20260709 12:17:44.904590 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:44.910245 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:44.911412 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:44.912452 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:44.913592 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.914736 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.914496 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.755820 24072 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.876590 24131 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.857859 21102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:44.927980 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:44.928236 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5920 after lost signal to thread 21771
W20260709 12:17:44.931022 20965 debug-util.cc:398] Leaking SignalData structure 0x7b080021fdc0 after lost signal to thread 21772
I20260709 12:17:44.931123 21031 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:44.931613 21033 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:44.932117 21102 raft_consensus.cc:606] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:44.932641 23259 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:17:44.933307 24068 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:44.934464 24148 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:44.936024 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:44.936585 21182 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:44.942978 21152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.015s	sys 0.004s
W20260709 12:17:44.943291 21152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.015s	sys 0.004s
I20260709 12:17:44.944073 23888 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:44.946220 24130 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:44.899693 23677 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:44.907686 24150 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:44.925180 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:44.960683 21182 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:44.968029 21183 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:44.967499 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:44.966459 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1040 after lost signal to thread 23711
W20260709 12:17:44.969538 21110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.017s	sys 0.070s
W20260709 12:17:44.970256 21110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.018s	sys 0.070s
I20260709 12:17:44.970687 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.894783 24179 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.975716 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.976135 21028 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:44.976504 21110 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:44.972522 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.929872 23924 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:44.978442 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.893559 23696 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:44.979578 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.984541 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.986019 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.986241 21178 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:44.987156 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.987718 21178 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:44.988541 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.988711 21027 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:44.989625 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.990547 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.991472 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.991847 23773 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:44.972107 23259 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:44.972100 24145 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:44.992430 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.993093 21178 raft_consensus.cc:2393] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:44.992918 24145 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:44.993786 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.994271 21178 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:44.995039 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:44.997488 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:44.998652 21028 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:44.999799 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:44.998003 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.000756 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.004407 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:44.997224 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:45.007587 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8ec0 after lost signal to thread 24076
W20260709 12:17:45.007920 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4440 after lost signal to thread 24078
I20260709 12:17:44.995684 23259 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:45.009336 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:45.009905 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08002b60a0 after lost signal to thread 24088
I20260709 12:17:45.011596 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.012161 21028 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
W20260709 12:17:45.013976 20965 debug-util.cc:398] Leaking SignalData structure 0x7b080031fca0 after lost signal to thread 24095
W20260709 12:17:45.014261 20965 debug-util.cc:398] Leaking SignalData structure 0x7b0800239300 after lost signal to thread 24096
W20260709 12:17:45.016197 20965 debug-util.cc:398] Leaking SignalData structure 0x7b080033f660 after lost signal to thread 24100
W20260709 12:17:45.016460 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9000 after lost signal to thread 24106
W20260709 12:17:45.016638 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3540 after lost signal to thread 24107
I20260709 12:17:45.019393 21178 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:45.011813 24181 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:17:45.011162 23259 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.035497 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.038094 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.038549 21028 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:45.035256 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.048310 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.048637 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.049407 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.047883 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.031735 23944 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:45.053246 24179 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:45.059365 24145 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:45.037335 24134 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:45.067368 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.075266 21110 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:45.078980 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 164106us
I20260709 12:17:45.076753 21712 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:45.081229 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.081210 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.083271 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.084254 24145 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:45.084656 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.085057 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.086397 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.106421 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.109133 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.112150 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.111268 21177 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:45.088949 24145 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.114154 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.113161 24145 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.118978 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:45.120164 24177 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:17:45.121932 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.124135 21186 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:45.128582 21102 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:45.068190 23944 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.113049 24131 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:45.131100 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.139605 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.137971 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:45.140914 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 143649us
I20260709 12:17:45.142210 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.142918 21075 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.144869 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.145498 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.150245 21034 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:45.146050 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.146564 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.146136 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.151211 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.151487 21028 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:45.149333 21149 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.156369 21035 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:45.158681 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.159852 21181 raft_consensus.cc:2393] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:45.160503 23615 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:45.160895 23615 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:45.161245 23615 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:45.161674 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:45.162195 21032 raft_consensus.cc:2376] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8. Re-sending same reply.
I20260709 12:17:45.165772 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:45.167125 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.167685 21036 raft_consensus.cc:2376] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7. Re-sending same reply.
I20260709 12:17:45.159734 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.178471 23696 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:45.214890 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.215888 24189 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:45.217388 24189 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.217831 24189 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.218568 24145 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.219494 24131 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.220134 24131 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.222219 24131 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:45.219497 23942 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:45.225246 23944 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:17:45.227746 21177 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.221930 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.230334 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.238440 24031 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:45.239924 24031 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:45.242398 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.243139 21178 raft_consensus.cc:2393] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:45.217545 23615 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.253043 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.251384 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:45.251334 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 69389.2us
W20260709 12:17:45.255491 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 144921us
I20260709 12:17:45.256748 21183 raft_consensus.cc:2368] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
W20260709 12:17:45.258000 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 231620us
I20260709 12:17:45.259037 21000 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:45.260721 21000 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:45.256059 21149 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.249470 23773 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:45.266559 21149 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.271971 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.260174 24150 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:45.267655 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:45.271718 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 161605us
I20260709 12:17:45.275913 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.277235 24186 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:45.277380 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.278486 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.281121 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.287827 21035 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:45.268558 24179 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.290664 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.295435 21077 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.272840 23677 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.296527 21178 raft_consensus.cc:2393] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:45.291811 21149 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.274137 23888 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.298223 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.300037 21712 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:45.279326 24150 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:45.304924 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.302444 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:45.312189 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 169357us
I20260709 12:17:45.311946 24150 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.316761 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.317689 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.318320 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.304078 23924 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.301496 23888 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.320761 23949 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.320564 23740 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:17:45.321164 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.327412 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.292099 24148 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:17:45.331393 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.333201 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.334784 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.322369 23888 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.336809 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.337348 21746 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:45.335310 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.339370 24145 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:45.339687 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.340384 21107 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:45.340654 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.339406 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.341660 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.341853 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.342880 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.338073 21744 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:45.343170 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.342671 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:45.344322 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 52378us
I20260709 12:17:45.346096 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.347378 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.330989 24196 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:45.350302 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 368) took 1202 ms. Trace:
I20260709 12:17:45.351826 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.352412 21102 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:45.349639 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.353127 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.353762 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.356629 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.357095 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.354635 24196 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:45.359068 24196 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.359279 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.363269 23615 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:45.363122 24192 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:45.367206 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.383471 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.385650 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.385569 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.350656 21103 rpcz_store.cc:276] 0709 12:17:44.147717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.948271 (+800554us) service_pool.cc:224] Handling call
0709 12:17:44.948564 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:44.948792 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:17:45.111547 (+162755us) log.cc:844] Serialized 14 byte log entry
0709 12:17:45.349671 (+238124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:45.349721 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:45.350096 (+   375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.350160 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.350253 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174083,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":362101,"threads_started":3,"wal-append.queue_time_us":192512}
I20260709 12:17:45.396104 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.396140 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.397653 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.398633 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.401420 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.401839 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.387539 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.403059 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:45.404275 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 106688us
I20260709 12:17:45.404949 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.411262 21029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81f567d6458f4dddaa94452e04485030"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:45.411847 21029 raft_consensus.cc:606] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.403489 21032 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:45.403584 21036 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
W20260709 12:17:45.431769 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 97215.8us
W20260709 12:17:45.434321 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 134357us
I20260709 12:17:45.351923 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.436091 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:45.436784 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.437326 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.437942 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.412164 21029 raft_consensus.cc:614] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:45.436137 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.442806 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.401039 24123 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:45.446769 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.382527 24192 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:45.443856 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:45.442170 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 91636.6us
I20260709 12:17:45.437999 21030 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:45.448743 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.450412 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.452440 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.449965 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.457580 21036 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:45.459141 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:45.459954 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55087.5us
I20260709 12:17:45.462580 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.463938 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.467149 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.468067 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.468605 21177 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:45.469318 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.469650 23404 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 12:17:45.470317 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.471426 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.472414 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.473670 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:45.432543 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.484807 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.446774 24123 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.475829 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.490626 21075 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.456485 24192 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.430708 24189 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:45.493743 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 134524us
I20260709 12:17:45.493211 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.462870 24148 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:45.468778 24196 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.497428 24148 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.497805 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:45.437386 23259 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:45.499805 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 97972.1us
I20260709 12:17:45.500087 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.459132 24207 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:45.500111 21109 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:45.488521 24072 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.490546 24123 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.507186 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:45.497745 24204 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.511847 21106 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:45.491565 24200 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.503641 24101 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:45.517597 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.500283 24205 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:45.503777 24207 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.520207 21076 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.529572 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.515628 24199 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:45.532020 24199 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.532481 24199 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.532790 24148 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:45.533838 24087 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.534251 24087 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.534637 24087 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.527359 24101 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.538148 24101 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.539294 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:45.543670 24197 log.cc:927] Time spent T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Append to log took a long time: real 0.201s	user 0.002s	sys 0.000s
I20260709 12:17:45.543972 24205 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.545966 24189 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:45.546074 24205 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:45.528251 24195 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:45.547583 24195 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:45.547988 24195 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:45.549631 21151 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.551582 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:45.557063 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.559417 23942 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.563301 24148 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:45.560989 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.515537 24201 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:45.564134 21111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:45.563864 24148 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.564652 21111 raft_consensus.cc:606] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.564982 21111 raft_consensus.cc:614] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:45.565889 24201 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.566256 23901 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.567327 24057 consensus_queue.cc:1059] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:45.568250 24196 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:45.569651 23259 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:45.571127 21150 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:45.566273 24201 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.572808 21107 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:45.575464 24179 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:45.576485 23773 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:45.576522 21102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c68b72acae564588a3a276b7b233d977"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:45.576967 23773 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:45.577185 21102 raft_consensus.cc:606] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.577780 23773 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.579869 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:17:45.580415 21027 raft_consensus.cc:606] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.580781 21027 raft_consensus.cc:614] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:45.582150 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:45.521938 24206 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.583583 24206 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.583987 24206 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.584829 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:45.586068 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:45.587815 24205 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:45.588379 24205 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:45.571789 24193 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 12:17:45.591135 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 75262.5us
I20260709 12:17:45.592725 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:45.580359 24160 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:45.595297 24160 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:45.595495 24186 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:45.595913 24186 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.596302 24186 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:45.597123 23615 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:45.599154 24209 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:45.599669 21150 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.596127 24160 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.595050 24213 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:45.601329 24160 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:45.602499 21742 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
W20260709 12:17:45.603696 21742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33006 (request call id 416) took 1217 ms (client timeout 1516 ms). Trace:
W20260709 12:17:45.604099 21742 rpcz_store.cc:269] 0709 12:17:44.386093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.627715 (+241622us) service_pool.cc:224] Handling call
0709 12:17:45.081041 (+453326us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b5800004598. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:17:45.603511 (+522470us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b540052f154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:45.603615 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216900992}
I20260709 12:17:45.604502 24195 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.605599 21108 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:45.606496 24195 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:45.606794 21104 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:45.615257 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:45.620983 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 116623us
I20260709 12:17:45.607002 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.529282 24207 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.607501 24131 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.607916 23968 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.608522 24199 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.609483 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:45.667367 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 57960.8us
I20260709 12:17:45.668108 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.609910 24205 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:45.610651 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:45.683251 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.684315 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.590438 24101 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.517473 24204 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.520236 24200 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.566650 24148 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:45.668853 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 61924.7us
W20260709 12:17:45.706293 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:45.675220 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 223909us
W20260709 12:17:45.665877 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 168149us
I20260709 12:17:45.667689 21709 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.696326 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.602526 24072 raft_consensus.cc:3055] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:45.708357 21103 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:45.707791 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 97223us
I20260709 12:17:45.708847 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.709288 21076 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.710284 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.705029 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.711202 21747 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 3.
I20260709 12:17:45.666133 23944 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:45.711517 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 249995us
I20260709 12:17:45.713665 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.714339 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.715196 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.716645 21742 raft_consensus.cc:2393] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:45.717615 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.703907 24204 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.727238 21178 raft_consensus.cc:2393] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:45.707039 24160 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.705534 24187 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:45.729184 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.728835 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.614820 24201 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.732965 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.708588 24072 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:45.733623 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.705868 24205 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:17:45.731478 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 63243.2us
I20260709 12:17:45.707978 24200 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.729974 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:45.743880 21709 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.745023 21002 leader_election.cc:400] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:17:45.745404 21002 leader_election.cc:403] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:45.710155 23615 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.737883 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:45.705773 23696 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.712218 24189 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.715266 24031 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:45.741703 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:45.695333 24123 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.743175 21150 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:45.726944 24213 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:45.747648 21747 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:45.748766 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:45.751046 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:45.758832 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 47413.8us
I20260709 12:17:45.759585 21002 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:45.736286 24187 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.761174 24187 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.735793 23968 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:45.768007 21150 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:45.750355 24195 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:45.766168 24205 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:17:45.756425 24031 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.766027 24213 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:45.770980 23740 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:45.797891 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54085.1us
I20260709 12:17:45.771832 23968 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.775521 23696 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:45.780962 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:45.769522 24206 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.795256 24031 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.794989 24195 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:17:45.835927 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 98833.6us
I20260709 12:17:45.837293 21711 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.788908 24179 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:17:45.806089 23696 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.839725 21739 raft_consensus.cc:2368] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:45.800590 24150 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.840072 21077 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:45.804888 24004 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:45.798012 24213 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.802162 23901 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:45.802055 23677 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:45.803424 24221 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.830163 24196 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:17:45.846860 24206 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:45.879192 24230 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:45.879633 24230 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:45.879987 24230 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.884919 24209 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:45.885859 24213 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.887179 23901 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.888269 24213 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:45.847738 24216 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.849617 24179 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:45.869954 21711 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.847064 24178 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:45.889104 24179 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:45.839239 24225 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:45.889413 23901 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:45.889905 24225 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.889994 24179 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.869778 24199 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:45.878304 24101 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:45.846437 23696 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.805707 24160 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.894747 23773 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.889492 24178 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.897955 24178 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:45.902179 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 426362us
I20260709 12:17:45.801003 23968 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.900712 24225 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:45.805545 24072 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.904523 23696 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.874609 24218 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.905460 24218 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:45.887948 24204 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:45.891466 24179 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.906656 24202 raft_consensus.cc:993] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:17:45.907192 24202 raft_consensus.cc:1081] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:17:45.909080 21111 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:45.847399 24224 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.841228 23740 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:45.928601 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 58732.8us
I20260709 12:17:45.874372 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:45.921662 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.905826 24218 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.964242 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.965219 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:45.967020 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 92730.3us
I20260709 12:17:45.968523 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:45.969682 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.969092 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.970688 21077 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:45.971098 21075 leader_election.cc:400] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:45.971426 21075 leader_election.cc:403] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:45.972877 20999 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.973135 24213 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.922348 24204 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:45.980600 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:45.981992 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:45.984009 21185 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:45.984258 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54928.9us
I20260709 12:17:45.964615 24189 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:45.985846 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 289560us
I20260709 12:17:45.989089 21151 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:45.987143 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 253580us
I20260709 12:17:45.989810 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.990131 21076 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.975364 24213 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:45.969861 24201 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:45.996183 20999 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.874852 23677 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.971542 24101 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.993139 24213 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.998626 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.001852 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.001989 21151 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.003479 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.987860 21077 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:46.000289 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:45.985249 24148 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.010555 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:45.986671 24214 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.976560 24123 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.009150 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.053206 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:45.974053 24232 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:46.038867 24201 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:46.057106 24031 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.059024 24221 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.059350 24150 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:46.009596 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.061525 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.012842 23944 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:46.013306 23696 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:46.014317 24215 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:46.020628 24185 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.020499 24187 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.013018 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:46.095642 21179 raft_consensus.cc:2393] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 4: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:45.998708 24205 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.023694 23677 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:46.015585 24196 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:46.016042 23805 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:46.010696 23942 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:46.027190 24236 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.015385 23967 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:17:46.033412 24207 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.037417 24186 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.037889 23968 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:45.988234 24199 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:46.042312 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:46.050776 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:45.965404 23740 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:46.055359 20930 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 114) took 12995 ms (client timeout 15000 ms). Trace:
I20260709 12:17:46.062577 20999 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:46.061479 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 51958.9us
I20260709 12:17:46.001675 24224 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:46.053854 24087 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.004s
I20260709 12:17:46.067116 24150 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:46.089529 23888 consensus_meta.cc:287] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.735s	user 0.002s	sys 0.007s
I20260709 12:17:46.089915 24239 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:46.092381 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:46.095240 21740 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 3.
W20260709 12:17:46.109668 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 121878us
I20260709 12:17:46.115864 23942 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:46.167445 23942 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:46.152263 24230 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.174890 24230 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.157073 24150 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:46.175806 24150 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:46.176947 24213 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.183784 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.131006 21076 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.109885 24196 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:46.146322 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.114449 23805 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:46.147689 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 85162.8us
W20260709 12:17:46.130450 20930 rpcz_store.cc:269] 0709 12:17:33.055340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.055573 (+   233us) service_pool.cc:224] Handling call
0709 12:17:46.050658 (+12995085us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:45.050682 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:45.163461 (+112779us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:45.163506 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:17:45.163525 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:45.164554 (+  1029us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:45.164662 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:45.164689 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:17:45.165662 (+   973us) tablet.cc:701] Row locks acquired
0709 12:17:45.165708 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:17:45.165857 (+   149us) write_op.cc:270] Start()
0709 12:17:45.165993 (+   136us) write_op.cc:276] Timestamp: P: 1783599465165801 usec, L: 0
0709 12:17:45.166014 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:17:45.166687 (+   673us) log.cc:844] Serialized 4458 byte log entry
0709 12:17:45.674401 (+507714us) op_driver.cc:464] REPLICATION: finished
0709 12:17:45.730136 (+ 55735us) write_op.cc:301] APPLY: starting
0709 12:17:45.739559 (+  9423us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:45.792632 (+ 53073us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:45.792774 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:45.797283 (+  4509us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:45.890121 (+ 92838us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:17:45.890180 (+    59us) write_op.cc:312] APPLY: finished
0709 12:17:45.890587 (+   407us) log.cc:844] Serialized 83 byte log entry
0709 12:17:45.890802 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:45.890977 (+   175us) write_op.cc:454] Released schema lock
0709 12:17:45.891051 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:45.891486 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:45.891515 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7220191,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":2849,"apply.run_cpu_time_us":4293,"apply.run_wall_time_us":181390,"num_ops":11,"prepare.queue_time_us":358355,"prepare.run_cpu_time_us":13079,"prepare.run_wall_time_us":279317,"raft.queue_time_us":129392,"raft.run_cpu_time_us":1719,"raft.run_wall_time_us":3084,"replication_time_us":508234,"thread_start_us":431838,"threads_started":4,"wal-append.queue_time_us":166494}]]}
I20260709 12:17:46.064776 24221 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.152689 21106 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:46.157591 21743 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:46.159761 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.154392 21108 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:46.165807 21744 raft_consensus.cc:2368] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:17:46.153838 24186 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.166049 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.105288 24179 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:17:46.083045 24215 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:46.127413 24192 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.000s
I20260709 12:17:46.179548 21185 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:17:46.181989 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.154933 24199 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:17:46.188109 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 57191.6us
I20260709 12:17:46.200878 21076 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.202128 21076 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.189795 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.204552 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.193562 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.149701 24205 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.190519 21000 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:46.175315 24187 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:46.063237 24195 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:46.209075 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 441627us
I20260709 12:17:46.179040 24239 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.209867 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.212282 21000 leader_election.cc:400] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:17:46.212196 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.212671 21000 leader_election.cc:403] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:46.209914 21712 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:46.211403 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.213917 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.190199 24196 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.195640 23805 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.217505 21002 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.231421 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.233393 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:46.234491 21182 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:46.236545 24249 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:46.237025 24249 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.237386 24249 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.237766 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:46.238970 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.240149 21102 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.241109 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.180893 23888 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.206188 24215 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.209631 24202 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:46.216475 24186 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.254776 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:46.196729 24230 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:46.148476 24087 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.245429 21110 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:46.229961 24224 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:46.245220 24205 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.218338 24236 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.211999 24239 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.211830 24201 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:46.263898 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.244757 24101 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:46.267189 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 62714.7us
I20260709 12:17:46.311106 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.242463 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:46.218631 24231 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:46.307941 21103 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:46.305727 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.256740 24202 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.249522 24148 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.208607 24192 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.266377 24235 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:46.256973 21181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:17:46.322163 21108 raft_consensus.cc:2393] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:46.261811 24230 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.326423 21181 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:46.330756 21181 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.325531 21746 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.331224 24202 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.322122 23259 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.338945 21076 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.329056 24231 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:46.325484 24235 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:46.345834 24235 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.349728 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.311633 24201 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:46.257802 24221 consensus_queue.cc:1059] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:17:46.349881 21177 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
W20260709 12:17:46.384912 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 46057us
I20260709 12:17:46.387673 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.330390 24230 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.384946 21110 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:46.392987 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 161641us
I20260709 12:17:46.393770 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.323917 24160 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:46.323169 24245 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.405602 21110 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:46.406169 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.405869 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.409741 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.386328 24201 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:46.344950 24231 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:46.416551 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.418450 21002 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.395206 24208 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:46.419529 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.414916 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.422528 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.425438 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.420614 24209 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:46.428519 24202 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.430889 24251 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.431202 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.423571 24207 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.423679 24213 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.433410 24245 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.434059 24245 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.434644 24245 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.422052 24208 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.435580 24208 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:46.443732 24237 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:17:46.430603 24202 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.447743 23944 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:46.448257 23944 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.449096 23944 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.450196 23944 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.453075 24208 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.454473 24214 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 3. Current term is 4.
I20260709 12:17:46.459725 24087 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.412480 23259 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:46.463238 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 48410.3us
I20260709 12:17:46.465942 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:46.338037 24199 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.468066 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.468807 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.470120 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.472079 21027 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:46.472467 21076 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.472997 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.465375 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.424607 24224 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:46.457118 24221 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.478341 21076 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.474282 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.474258 24202 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:46.479458 24202 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.474486 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.479822 24202 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.480139 24214 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.421293 24160 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.481637 24213 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.483140 24160 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:46.474542 24204 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:46.483983 24204 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.484084 23740 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:46.484426 24204 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:46.490392 24239 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.493913 24239 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.494160 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:46.467408 24246 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:46.483506 24238 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:17:46.495555 24224 consensus_queue.cc:1059] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:46.496572 24248 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:46.497057 24248 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.462248 24232 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:17:46.497555 24253 raft_consensus.cc:3055] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:46.498083 24253 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:46.495435 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:46.499015 24253 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.500298 24253 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.500372 24202 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.502398 24202 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.502863 23888 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:46.496006 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.497438 24248 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.503726 21181 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.507337 21181 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
W20260709 12:17:46.509135 24200 consensus_meta.cc:287] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.765s	user 0.008s	sys 0.001s
I20260709 12:17:46.509598 24200 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.513074 21076 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.514652 23888 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.526644 24221 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:46.524430 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:46.532599 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 101604us
I20260709 12:17:46.478339 24087 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.534111 21002 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.414952 24249 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.544549 21002 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.527930 24208 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.531291 24192 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:46.553494 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:46.551702 21002 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.527029 23805 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.560389 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.530985 24150 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.548825 23888 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:46.552973 24239 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.553324 24221 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.553416 23259 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:17:46.565706 24204 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.568544 24150 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.559543 24191 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.570950 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:46.571630 23942 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.572646 21184 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:46.573544 24072 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.574941 23968 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:46.576453 24215 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.556437 24186 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:46.579041 24246 raft_consensus.cc:993] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:17:46.579502 24246 raft_consensus.cc:1081] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:17:46.580147 21183 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:46.585974 24215 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.582098 23805 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:46.586957 24186 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.587882 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.587006 24205 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:17:46.593806 21002 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.594645 21178 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:46.596168 21712 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.597257 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:46.599498 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 46829.8us
I20260709 12:17:46.605113 21036 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:17:46.588749 24186 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.606483 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.607676 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.608388 21032 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:46.610201 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.610438 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.598106 24221 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.614765 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.604722 24229 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.559787 24255 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.619916 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.604355 24216 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:46.621991 24150 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.566334 23259 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:46.623799 21739 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:46.648622 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.565629 24201 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.628985 23259 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.614281 24214 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:17:46.628852 24150 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.632782 24235 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.634187 24196 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.635658 24207 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:46.637426 24224 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:46.638697 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:46.676733 21747 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:46.639354 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.643292 23942 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:46.644353 24249 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.645898 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:46.628839 24200 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.650969 21000 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.655723 21002 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.656522 21109 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:46.658439 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.661522 24148 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.685510 21036 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:46.662197 21111 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.671942 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.618532 24205 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.692497 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.693002 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.675745 21107 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:46.684849 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.687338 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:46.694396 21740 raft_consensus.cc:2393] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 4: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:46.694994 24229 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.697577 24196 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.680861 24224 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:46.676306 24207 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:46.697973 21738 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:46.698276 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.698962 21186 raft_consensus.cc:2368] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:17:46.698726 24207 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.699944 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:46.700078 24207 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.700639 24235 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.701483 21182 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:46.701944 24224 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.689522 21104 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:46.635675 24218 consensus_meta.cc:287] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.652s	user 0.004s	sys 0.005s
I20260709 12:17:46.702458 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.688302 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.653882 24230 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.700644 21183 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:46.710117 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.708314 21109 raft_consensus.cc:3055] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.710916 21109 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.708369 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.712284 21739 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.711720 21109 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.713724 21109 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.715353 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.716041 21181 raft_consensus.cc:2393] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:46.715938 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:46.713734 21034 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:46.717126 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.712729 24218 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.725075 24218 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:46.725696 21744 raft_consensus.cc:1240] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.716770 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.723230 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.693172 24255 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:46.728701 21076 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.681113 24178 consensus_queue.cc:1059] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:17:46.731580 23942 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.732348 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.756256 23942 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.732997 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.758153 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.758366 23942 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:46.758692 21034 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.759527 24201 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:46.759860 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.730633 24187 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:46.760462 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:46.760917 24187 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:46.761256 24187 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.762048 24187 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.733404 24218 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.733752 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:46.734316 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.764613 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.697819 24179 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:46.765599 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.766283 21028 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:46.735561 23259 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.730906 24255 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:46.768013 24255 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.769048 21746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 437) took 1057 ms. Trace:
I20260709 12:17:46.769410 21746 rpcz_store.cc:276] 0709 12:17:45.711692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.717238 (+  5546us) service_pool.cc:224] Handling call
0709 12:17:45.737497 (+ 20259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:46.333050 (+595553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.768813 (+435763us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54006a6b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:46.768970 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322598656}
I20260709 12:17:46.771039 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:46.736533 21105 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:46.784222 24031 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.784737 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:46.785454 21105 raft_consensus.cc:2393] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:46.738819 21109 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:46.787241 24187 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.788220 24204 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.787951 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.744242 24248 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.790445 24248 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.791719 21102 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:46.791839 21739 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
W20260709 12:17:46.793726 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.794512 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.797869 24236 raft_consensus.cc:3055] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:46.798225 24236 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:46.798521 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.799091 21030 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.798991 24236 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.803858 24213 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:46.804639 24213 consensus_queue.cc:1059] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:46.805348 24213 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:46.805636 24213 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.746272 24230 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:46.807881 24230 raft_consensus.cc:3055] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:46.808205 24230 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.808677 21180 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:46.808918 24230 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.810196 24230 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.812915 21110 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:46.816483 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:46.820140 24261 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.002s
I20260709 12:17:46.822566 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.823146 21029 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.806396 24213 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.825389 24213 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:46.800192 24236 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:46.831255 24134 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:46.831756 24134 raft_consensus.cc:697] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.832037 21747 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:46.832804 24134 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.835539 21712 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.836709 24242 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:46.837256 24242 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:46.837409 21150 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:46.838121 23968 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:46.787375 21105 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:46.840224 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.840245 23968 raft_consensus.cc:697] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.843089 24214 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.844799 23968 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.847329 24242 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.848515 21030 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:46.849514 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.750705 21076 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.742555 21036 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:46.754814 24150 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:46.712450 23967 consensus_queue.cc:1059] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:17:46.726725 24196 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.793730 21102 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:46.763072 24189 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:46.763484 24178 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:46.772531 21032 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:46.773053 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:46.771912 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:46.775334 21743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 677) took 1037 ms. Trace:
I20260709 12:17:46.777086 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.778445 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.779832 21107 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:46.772593 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:46.788597 24263 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:17:46.743038 23805 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:17:46.835640 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 47876.9us
I20260709 12:17:46.752797 24249 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:46.777722 24255 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.843778 24214 consensus_queue.cc:1059] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:46.851608 23967 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.867214 21179 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:46.852111 24189 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.852311 24178 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.871785 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.872040 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.871906 24178 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.873162 24178 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.873207 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.873574 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:46.852946 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:46.853482 21740 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:46.813175 21033 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:46.855177 21028 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.875497 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.875170 21032 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:46.876431 21002 leader_election.cc:400] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
W20260709 12:17:46.851279 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 100662us
I20260709 12:17:46.877480 21076 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.877938 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.879124 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:46.879796 21033 raft_consensus.cc:2393] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:46.855836 23805 raft_consensus.cc:3055] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:46.880311 21000 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:46.880478 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.881086 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:46.881028 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.881418 21033 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:46.881740 24150 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.856892 21027 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:46.860378 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:46.857620 21149 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:46.891710 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.853343 21737 raft_consensus.cc:2368] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4.
I20260709 12:17:46.856654 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:46.893321 21036 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.893431 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.866590 21029 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:46.895886 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:46.896070 21180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c68b72acae564588a3a276b7b233d977"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:17:46.896667 21180 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:46.897025 21180 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.896858 23677 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:46.853628 21743 rpcz_store.cc:276] 0709 12:17:45.738232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.738346 (+   114us) service_pool.cc:224] Handling call
0709 12:17:46.775157 (+1036811us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54006b08d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:46.775279 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918136192}
I20260709 12:17:46.897390 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.897945 21186 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.858621 24249 raft_consensus.cc:3055] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:46.898453 24249 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.899056 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.867334 23967 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.899353 24249 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.900141 23967 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.900689 24249 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.901350 23967 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.880498 23805 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.903398 23805 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:46.903707 21180 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.904521 23805 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.905488 21180 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:46.907258 23740 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:46.907533 23677 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:46.907925 23677 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.908375 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.907671 21000 leader_election.cc:400] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4.
I20260709 12:17:46.909212 21000 leader_election.cc:403] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:46.908782 23677 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.910416 23677 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.907953 23740 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.912714 21028 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:46.913151 23740 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:46.878671 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.917733 23942 consensus_queue.cc:1059] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:46.918226 21104 raft_consensus.cc:2368] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:46.857501 21034 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:46.923830 21036 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:46.924760 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.939441 21107 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.925671 21032 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:46.939764 21107 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.851423 24248 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.925158 21711 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:46.927727 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.927659 21033 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:46.929133 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:46.926761 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:46.962595 21111 raft_consensus.cc:2393] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:46.964020 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.964839 24205 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.966734 21076 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:46.967938 21076 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:46.975450 21102 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:46.859304 24255 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:46.931331 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:46.932646 21028 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.850697 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:46.928452 21186 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:46.936779 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.931902 23901 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:17:46.976384 24228 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:46.957314 24224 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.938416 24187 consensus_queue.cc:1059] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:17:46.988417 24187 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.988756 24187 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:46.957594 21036 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:46.989573 24187 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.977136 24230 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:46.991153 24230 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.991690 23259 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.991999 24230 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.966766 24150 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 3. Current term is 4.
I20260709 12:17:46.977173 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:46.977725 24196 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:46.995900 24196 raft_consensus.cc:697] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.968947 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:46.996767 24196 consensus_queue.cc:237] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.997489 24235 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:46.998028 24235 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:46.937870 21104 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:46.998829 24235 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.936446 23944 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:17:46.983275 23805 consensus_queue.cc:1059] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:46.928966 24101 consensus_queue.cc:1059] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:17:47.000346 24201 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.926399 24189 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:46.987578 24228 raft_consensus.cc:697] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:46.978183 24204 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:47.015208 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:47.003338 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:46.930433 20999 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:46.925972 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.893061 24214 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.009364 21741 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:46.990679 24187 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.984021 21107 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.017120 21182 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:47.019543 21000 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:47.020032 21075 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:47.020218 21107 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.024252 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:47.024303 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:47.023775 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:47.028416 21077 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:47.032310 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 105449us
I20260709 12:17:47.033069 20999 leader_election.cc:400] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:47.033594 20999 leader_election.cc:403] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:47.038910 21109 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:47.043062 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:47.043722 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.044754 21077 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:47.046633 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:47.047145 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:47.047699 21036 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:47.048069 21028 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:47.049186 21030 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:17:47.049605 21030 pending_rounds.cc:85] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 6
I20260709 12:17:47.049863 21030 pending_rounds.cc:107] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:17:47.050092 21030 raft_consensus.cc:2889] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:47.049445 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 91017.8us
I20260709 12:17:47.030869 24202 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:47.027469 24255 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.027367 24031 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:47.054492 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:47.063154 21108 raft_consensus.cc:2410] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:47.054270 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:47.067796 21032 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.071411 21036 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:47.063268 24202 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:47.075412 24202 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:47.034566 24205 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:47.037638 24229 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:47.040614 24246 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.031615 24204 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:17:47.111235 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 65386.8us
I20260709 12:17:47.051335 24253 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:47.063323 24101 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:47.054493 24200 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:47.126123 21107 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:47.126729 24204 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.054817 24228 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:47.117568 21186 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:47.050531 24256 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:17:47.139652 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 94947.7us
I20260709 12:17:47.141837 21077 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:47.136531 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 212981us
W20260709 12:17:47.143726 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 98519.7us
I20260709 12:17:47.144331 24239 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.148794 21031 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:47.145869 21032 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:47.111575 24031 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:47.154948 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:47.156205 21034 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:47.156663 20931 catalog_manager.cc:5697] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 3 to 4, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:47.169605 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.136189 24229 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:47.177942 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:47.180308 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.196120 21077 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:47.198239 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:47.199290 24256 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.200152 24202 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.201112 21103 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:47.201727 23677 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:47.202136 23677 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.203037 23677 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.203682 24205 consensus_queue.cc:1059] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:47.204236 23677 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:47.204871 24236 raft_consensus.cc:3055] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:47.205264 24236 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:47.178342 24195 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:47.197896 20931 catalog_manager.cc:5697] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.210649 24189 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:47.213111 24031 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:47.227031 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45846.3us
I20260709 12:17:47.179734 24072 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:17:47.234742 21741 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.235528 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:47.237758 21107 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:47.219928 24248 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:47.231667 21742 raft_consensus.cc:2955] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:47.257201 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:47.262619 21151 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.206148 24236 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.250916 24208 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:47.234467 24200 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:17:47.260012 24189 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:17:47.268103 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:47.296689 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:47.297120 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.295920 21151 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.276114 20931 catalog_manager.cc:5697] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 3 to 5, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:47.287081 21107 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:47.273391 23773 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:47.305621 23773 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.305712 24208 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:47.306632 24208 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.312132 23901 raft_consensus.cc:3055] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:47.312558 23901 raft_consensus.cc:740] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.313568 21149 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:47.314524 24187 consensus_queue.cc:1059] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:47.313336 23901 consensus_queue.cc:260] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.319144 21741 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:47.316514 20931 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 7 to 8, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 8 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:17:47.315289 24087 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:17:47.273061 24150 raft_consensus.cc:3055] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:47.266280 24179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51888 (request call id 71) took 2029 ms. Trace:
I20260709 12:17:47.272637 23967 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:47.266559 24275 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:47.343183 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 180620us
I20260709 12:17:47.375116 21179 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:47.376720 21181 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:47.378290 20931 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 4 to 8, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 8 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:47.329105 24236 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.329685 24150 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:47.320757 24178 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:17:47.332628 23967 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.284404 24229 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:47.381187 23901 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:47.383294 23942 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:47.384452 23968 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:47.392364 20931 catalog_manager.cc:5697] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 3 to 4, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 4 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.330049 24209 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:17:47.339113 23944 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:17:47.391569 24228 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 12:17:47.405299 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 109443us
I20260709 12:17:47.418743 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.417773 24219 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 12:17:47.424647 24282 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.114s	user 0.001s	sys 0.001s
I20260709 12:17:47.428933 23967 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.431605 24228 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.432128 24228 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:47.432716 23942 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.420023 23944 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:47.442312 20931 catalog_manager.cc:5697] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.440892 23942 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.452630 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:47.468204 24278 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:47.441586 24228 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:47.429714 24255 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.460171 21151 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.460829 24272 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:47.469630 24272 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:47.461246 24187 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.463500 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:47.474078 21182 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:17:47.475492 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:47.465338 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 151824us
I20260709 12:17:47.470036 24272 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.466279 23944 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.502735 24289 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.496416 24273 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:47.506983 21032 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:47.495872 23740 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:47.492421 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.489128 23773 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.479354 24187 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.492723 23967 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.488386 20931 catalog_manager.cc:5697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 5 to 6, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 6 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.532291 21031 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:47.506006 24134 raft_consensus.cc:3055] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:47.578126 24134 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.508579 21104 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:47.519773 21103 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:47.579366 24187 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:47.495366 21109 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:47.496038 24178 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:47.509946 21107 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:47.582217 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:47.523270 24255 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.572664 23740 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:47.583436 23740 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.583863 24290 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.583287 24134 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.585897 24134 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.586665 20931 catalog_manager.cc:5697] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 5 to 6, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 6 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.506950 24150 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.589326 20931 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.592877 24290 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:47.593274 24178 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:47.594640 23805 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:47.595080 23805 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.595432 24290 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:47.595842 24290 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.595932 23805 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:47.596941 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.596700 24290 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.597908 24290 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.600652 20931 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 6 to 8, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 8 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.602334 20931 catalog_manager.cc:5697] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.331524 24179 rpcz_store.cc:276] 0709 12:17:45.218385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.225347 (+  6962us) service_pool.cc:224] Handling call
0709 12:17:45.230155 (+  4808us) log.cc:844] Serialized 494 byte log entry
0709 12:17:45.572896 (+342741us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b54001e9ea0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f90d142 00007fcb9f8edeaa 00007fcb9f8f4d53 00007fcb9f8f4cd9 00007fcb9f8f4c69 00007fcb9f8f4c31 00007fcb9f8f3dfd 0000000000388634 0000000000388479 00007fcb9c8a7475
0709 12:17:47.247856 (+1674960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23579,"raft.queue_time_us":166,"raft.run_cpu_time_us":2388,"raft.run_wall_time_us":248989,"spinlock_wait_cycles":20453248,"thread_start_us":173331,"threads_started":1,"wal-append.queue_time_us":256092,"wal-append.run_cpu_time_us":2190,"wal-append.run_wall_time_us":1048788}
I20260709 12:17:47.564216 21742 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:47.573650 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 81325us
W20260709 12:17:47.616039 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 73941.3us
W20260709 12:17:47.645995 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 69662.1us
I20260709 12:17:47.563282 24206 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:47.563480 24291 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:47.645455 21151 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.657308 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.579164 23773 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:47.649945 24270 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:17:47.665678 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.676343 21742 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:47.679165 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.576455 24289 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.662359 23968 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:47.666065 24275 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:47.583360 24255 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:47.704861 24255 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:47.710203 24187 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:47.651412 24178 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:17:47.566109 23944 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.713335 23944 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:47.714252 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:47.714933 21742 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:17:47.716871 23805 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:47.718688 24298 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:17:47.650877 24291 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:47.728251 24288 log.cc:927] Time spent T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:17:47.729135 24291 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:47.729738 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:47.733177 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:47.737900 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.695363 24235 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:17:47.674959 24279 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:47.739913 24279 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.740288 24289 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:47.740815 24279 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.741230 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:47.744161 24150 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.748631 21000 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:47.749509 24236 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:47.749871 24236 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.750188 24236 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:47.763808 21027 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:47.765213 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:47.773458 21028 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:47.746475 24272 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.799804 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:47.800662 21741 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:47.803036 23942 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.803740 23942 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:47.804859 24287 log.cc:927] Time spent T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:17:47.806025 23942 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:47.807191 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:47.807814 21108 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:47.812070 21149 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:47.814896 24289 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:47.794693 24304 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:17:47.815409 24289 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.815798 24289 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:47.827864 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:47.829427 23942 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.831499 23677 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:47.831930 23677 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:47.832675 23677 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.833752 23677 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:47.852190 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:47.859898 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 180816us
W20260709 12:17:47.869200 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:47.869701 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:47.868502 24295 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.206s	user 0.000s	sys 0.003s
I20260709 12:17:47.858304 23740 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.874890 23740 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:47.876235 23942 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.906698 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:47.909686 24150 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.910553 24150 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.913642 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:47.915872 24206 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:47.916376 24206 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:47.916401 24150 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:47.933079 21077 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:47.935534 21035 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:47.936697 24235 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:47.938375 24235 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:47.939391 24235 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:47.944554 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:47.955585 24272 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:47.957154 20921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f16c07bcae284f65a7c0ee0375e00769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 12:17:47.959827 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:47.960872 21741 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:47.962040 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:47.962625 21035 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:47.970103 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:47.976955 21741 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:47.980159 23677 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:47.988250 21179 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:47.990058 21179 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:47.993072 21180 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:47.995967 21181 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:47.996165 21182 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:47.997684 21184 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:47.997998 21182 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:47.999949 21028 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:48.002143 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:48.000146 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:48.003223 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:48.004079 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:48.004694 21108 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:17:48.004427 21180 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:48.008016 21177 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:48.013401 21032 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:48.018687 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:48.019850 21033 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:48.020186 21031 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:48.026578 24202 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:48.019994 24208 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:17:48.029415 24196 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:48.030746 24196 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:48.032946 24189 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:48.003077 24289 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.034273 24189 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:48.035236 24189 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:48.035553 24189 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:48.035852 24289 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:48.040580 21107 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:48.050284 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:48.051083 21102 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:48.052572 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:48.056871 21109 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:48.044000 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:48.061306 21151 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:48.063665 24208 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:48.020095 23773 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:48.074529 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:48.077966 21105 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.075094 24311 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:48.060281 24229 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:48.026647 24290 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:48.032347 24196 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:17:48.082938 24312 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:48.083309 21149 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:48.060601 24199 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.098592 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:48.098742 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 53431.7us
I20260709 12:17:48.113250 21036 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.099622 21183 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.077395 24179 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.076962 24134 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:48.085104 24229 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.121709 21108 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:48.130376 21179 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:48.066787 24242 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:17:48.076387 24277 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:17:48.140260 21036 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:48.142608 21105 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:48.142691 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:48.122074 24150 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:48.144033 24209 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:17:48.148056 21180 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:48.119900 24310 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:48.129325 24229 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.120410 23740 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:17:48.150467 24279 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.150902 24290 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.148844 21077 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:48.147800 24134 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:48.085429 24189 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:48.168227 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 48167.9us
I20260709 12:17:48.123601 24236 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:48.128021 24179 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:48.121816 24199 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.134104 23677 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:17:48.167943 24325 consensus_queue.cc:1059] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:48.147621 24202 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:17:48.158023 24150 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:48.187167 24318 log.cc:927] Time spent T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:17:48.184293 24134 raft_consensus.cc:697] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:48.200888 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 52121.5us
I20260709 12:17:48.175650 24196 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:17:48.172482 24290 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:48.170706 24279 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.194716 24189 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.201167 24235 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:48.232160 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:48.232843 21108 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:48.228685 24150 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.234114 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:48.201951 24272 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:48.282546 21183 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:48.313758 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 67700.3us
W20260709 12:17:48.286641 24320 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:17:48.281967 24150 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:48.229462 24134 consensus_queue.cc:237] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.350637 24208 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:48.356356 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 122319us
I20260709 12:17:48.362350 21103 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:17:48.333141 24268 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:17:48.330137 24312 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:48.378242 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 137272us
I20260709 12:17:48.286966 24272 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.329905 24200 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:17:48.365708 24224 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:48.360684 24303 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.454828 24325 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.360340 24150 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.376401 24208 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:48.532217 24303 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:48.483063 24295 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:17:48.597193 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 233002us
I20260709 12:17:48.426789 24312 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.486809 24224 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:48.367116 24335 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.143s
I20260709 12:17:48.604498 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:48.498438 24179 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:48.614908 21103 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:48.593071 24328 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.401s	user 0.001s	sys 0.001s
I20260709 12:17:48.571353 24199 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.553588 24338 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:48.487617 24326 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:17:48.619577 24258 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.602780 24235 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:48.645807 24344 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.613761 24224 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:48.651320 21109 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:48.652976 21109 pending_rounds.cc:85] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 4
I20260709 12:17:48.653278 21109 pending_rounds.cc:107] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:48.653496 21109 raft_consensus.cc:2889] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:48.587904 24325 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.627262 24179 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:48.712502 24279 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:48.652866 24290 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:48.718358 24290 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:48.720459 24272 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:48.663058 24344 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.717309 24336 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.721690 24336 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:48.722762 24344 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.724323 24336 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:48.727674 24332 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:17:48.727597 24179 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:48.728286 24337 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 12:17:48.720937 24150 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.718760 24343 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:48.721028 24325 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.647135 24338 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:48.741219 24206 consensus_meta.cc:287] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.823s	user 0.008s	sys 0.007s
I20260709 12:17:48.661937 24258 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:48.801643 21103 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
W20260709 12:17:48.813138 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 47861.7us
W20260709 12:17:48.825656 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:48.755210 21186 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.000s	sys 0.006s
I20260709 12:17:48.797370 24208 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:48.759480 24235 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.799393 24329 raft_consensus.cc:3055] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:17:48.827859 21186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.007s
W20260709 12:17:48.834797 24331 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
I20260709 12:17:48.835880 24341 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.838943 24338 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:48.840682 24189 consensus_meta.cc:287] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
I20260709 12:17:48.799283 24303 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.841822 24350 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:48.809294 24330 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.441s	user 0.001s	sys 0.000s
W20260709 12:17:48.848066 24337 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:17:48.824512 24345 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.755757 24343 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.800784 24206 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:48.867062 24338 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.846910 24329 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:48.847908 24150 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:17:48.899770 21737 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:48.900672 21077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.004s	sys 0.010s
W20260709 12:17:48.901007 21077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.004s	sys 0.010s
W20260709 12:17:48.913965 21150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.031s	sys 0.029s
W20260709 12:17:48.915551 21150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.031s	sys 0.029s
I20260709 12:17:48.866799 24341 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.895818 24312 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:48.873227 24350 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.897034 24352 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:48.894033 24338 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.937808 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:48.940275 21179 raft_consensus.cc:2393] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:48.941412 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:48.922796 24325 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.925839 23901 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.925921 24199 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:48.916625 23773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.000s	sys 0.017s
I20260709 12:17:48.931437 24230 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:48.946223 24229 consensus_meta.cc:287] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.000s
I20260709 12:17:48.885620 24345 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.947026 21186 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:48.956561 23773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.000s	sys 0.018s
W20260709 12:17:48.947474 21181 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.014s	sys 0.051s
I20260709 12:17:48.939371 24179 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:48.969254 21181 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.016s	sys 0.051s
I20260709 12:17:48.951881 24325 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.957937 24230 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.976365 24350 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.937074 24352 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.977468 24230 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.974901 24341 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.978391 24352 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.978914 24352 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.979331 24352 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:48.980600 24342 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:17:48.988615 21151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.004s	sys 0.016s
W20260709 12:17:48.988983 21151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.005s	sys 0.016s
I20260709 12:17:48.993251 24345 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:48.993713 24341 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:48.995780 24338 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.964222 24351 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:48.954829 23901 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.985929 24206 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:48.969746 24329 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:48.965425 24356 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:48.956779 24199 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.004568 24361 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.968076 24358 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.975023 24343 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.011328 24352 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:49.044289 21000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.005s	sys 0.008s
W20260709 12:17:49.044754 21000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.006s	sys 0.008s
I20260709 12:17:48.963179 24229 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.099099 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:49.100368 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54252.5us
I20260709 12:17:49.103812 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:49.112924 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.115067 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.115762 21185 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:49.118099 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.118713 21185 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:49.035531 24289 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.128340 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.121464 24326 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.035501 24338 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:49.134936 21184 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:49.134462 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.136387 21183 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:49.136521 21179 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:49.101527 24369 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.098183 24202 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.101979 24367 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.138175 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.150034 24338 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.151679 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:49.154832 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:49.122897 24343 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.102787 24352 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.231400 21180 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:49.232393 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.242596 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.247557 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.255816 21034 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:49.128952 24365 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:49.258018 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.261873 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.262552 21034 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:49.263422 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.264058 21034 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:49.035277 24351 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.265393 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.270246 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.273487 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.274161 21033 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:49.129627 24289 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.045861 24356 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.280733 24372 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.045110 24358 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.243700 24202 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.155714 24369 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.248296 24367 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.258570 24235 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.046284 24361 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.322906 21031 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:49.279225 24196 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:49.275255 23740 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.318372 21178 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:49.146132 24326 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.324891 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.344259 21180 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:49.326367 24229 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.327487 24202 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.328231 24199 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.329339 23901 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:49.331914 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.257891 24343 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.346057 21742 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:49.271468 24352 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.310822 24325 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.323434 24375 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.354723 21035 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:49.354954 21179 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:49.362484 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:49.336748 24196 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.267235 24365 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.375537 21739 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:49.379974 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.381202 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.382990 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.383656 21180 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:49.385432 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:49.386077 21743 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:49.372867 24219 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.389036 21034 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:49.391746 24358 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.392283 24358 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.392706 24358 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.394783 24367 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:49.379308 24375 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.396636 24375 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.397084 24375 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.397518 24375 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:49.398602 24224 consensus_meta.cc:287] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.000s
I20260709 12:17:49.399636 24351 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.400249 24358 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.402397 21150 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:49.429857 21150 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:49.332959 24235 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.379166 24196 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:49.312562 24372 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.346101 23740 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.408461 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2198) took 1196 ms. Trace:
I20260709 12:17:49.502808 24367 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.420367 24378 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:49.498040 21181 rpcz_store.cc:276] 0709 12:17:48.204693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.204837 (+   144us) service_pool.cc:224] Handling call
0709 12:17:48.205172 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:48.205545 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:48.970593 (+765048us) log.cc:844] Serialized 14 byte log entry
0709 12:17:49.262013 (+291420us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:49.262457 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:17:49.262575 (+   118us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:49.262609 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.262683 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.400947 (+138264us) raft_consensus.cc:1685] finished
0709 12:17:49.400967 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.401116 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32926,"prepare.queue_time_us":36839,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2375,"raft.queue_time_us":38356,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":8196,"thread_start_us":992048,"threads_started":2,"wal-append.queue_time_us":383412}
I20260709 12:17:49.493283 23901 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:49.405139 24219 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.497444 23805 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:49.497803 24358 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.409961 24224 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.524475 24229 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.562258 24134 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.562788 23901 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.566716 23805 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.561576 23773 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.560992 24277 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.586473 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:49.525959 24351 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.570451 24375 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.592007 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:49.579757 24338 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.563437 24367 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:49.636719 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 44816.7us
I20260709 12:17:49.583418 24350 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.638124 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:49.639694 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.641974 21029 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:49.588591 23901 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.590463 23805 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:49.589988 24289 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:49.630999 24345 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.575664 24358 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.651747 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:49.655393 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.572743 24378 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.588260 24229 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.636472 24375 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:49.644465 24325 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:49.661239 21029 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:49.643405 24202 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:49.643602 24338 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.643625 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:49.707674 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 64130.6us
I20260709 12:17:49.708700 21076 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:49.630311 23773 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.647801 24356 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.642098 24387 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.592168 24277 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:49.701488 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 49797us
I20260709 12:17:49.589247 24134 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.631057 24351 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.732959 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:49.648844 24350 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.665735 24352 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.728299 24384 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:49.707856 24325 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.724665 24202 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.702080 24361 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.709364 24343 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.726246 24326 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.709578 24369 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:49.731343 24346 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 1.015s	user 0.008s	sys 0.001s
W20260709 12:17:49.728768 24380 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 12:17:49.751286 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.763406 21029 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:49.747164 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:17:49.748541 24388 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:17:49.731141 24249 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:49.665270 24345 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.708158 24375 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.733614 24365 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:49.742801 24384 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.742650 24289 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:49.728919 24338 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.756321 24202 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.794126 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.756743 24352 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.756911 24386 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:49.781997 21077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.003s	sys 0.013s
W20260709 12:17:49.783448 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 53524us
W20260709 12:17:49.802136 21077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.003s	sys 0.014s
I20260709 12:17:49.750645 24356 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:49.736887 24400 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:49.794035 24289 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.790766 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.780975 24384 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:49.768456 23740 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.766328 24235 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.770123 24361 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:49.750939 24325 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.782120 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:49.804111 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.808459 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.741715 24387 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:49.819819 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 668165us
I20260709 12:17:49.805253 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.770301 24249 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.808037 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.802421 21076 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:49.806756 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.854856 21184 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:49.816944 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:49.847304 21181 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:49.821388 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.855789 21033 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:49.851405 21180 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:49.837787 21075 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:49.809545 24378 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.857122 24377 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.857622 24377 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:49.837252 24389 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:17:49.808264 23773 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.855989 21183 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:49.802981 24400 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:49.867085 21181 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:49.837317 23740 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.865782 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.811236 24229 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.812966 24345 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.828122 23677 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.812898 24372 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.803064 24230 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.808562 24356 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.873863 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:49.803982 24367 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.813939 24277 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.838392 24386 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.802316 24369 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:49.807348 24289 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:49.850695 24365 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.827137 24361 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.866837 24408 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.864848 24249 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:49.876145 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 73809.6us
I20260709 12:17:49.868904 24406 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.863806 24219 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:49.883859 24345 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:49.888295 24369 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:49.890457 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.870745 24235 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.850284 24352 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.873230 24208 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:49.937537 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:49.872892 23773 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:49.911373 24372 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:49.911553 24356 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.913668 24334 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:49.909822 24230 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:49.915413 24200 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:49.940218 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:49.969548 21184 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:49.927697 24361 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:49.882793 23740 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.885275 23677 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.974828 21177 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
W20260709 12:17:49.978645 21741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.004s	sys 0.016s
I20260709 12:17:49.941726 24358 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.971426 24369 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:49.980826 24334 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:49.986276 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 46146us
I20260709 12:17:49.936980 24408 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:49.990509 24392 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:17:49.997134 21741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.004s	sys 0.017s
I20260709 12:17:49.970739 24345 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.979135 24372 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.001325 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.012418 21177 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:49.939303 24365 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.004743 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.013440 21184 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:49.999111 24134 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.974228 24235 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.995343 24277 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:49.941140 24406 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.016894 21077 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:50.025585 24386 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.998103 24350 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:49.998564 24224 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.033864 24134 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:50.026446 24384 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.044389 24258 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.045228 24235 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.045635 24395 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:50.032807 24387 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.046160 24395 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.031208 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.048873 21177 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:50.050707 24406 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.053227 24277 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.053643 24277 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:50.054150 24236 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.055320 24338 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.057197 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.033596 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.057950 21184 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:50.033170 24365 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.043390 24350 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:50.059943 24365 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.060271 24350 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.061352 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:50.062126 21177 raft_consensus.cc:2393] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:50.062335 24350 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.062824 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.063427 21177 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:50.032045 24352 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:50.064345 24340 log.cc:927] Time spent T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 1.466s	user 0.002s	sys 0.007s
I20260709 12:17:50.043515 24134 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.045921 24384 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.066483 24384 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:50.067368 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1528) took 1911 ms. Trace:
I20260709 12:17:50.063344 24230 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:50.067490 24404 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:17:50.070413 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.070997 24350 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:50.071417 24350 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.071645 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.072728 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.074319 24134 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:49.976678 24400 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.060408 24365 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.077695 24365 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:50.078084 24350 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:50.067772 21036 rpcz_store.cc:276] 0709 12:17:48.155726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.156723 (+   997us) service_pool.cc:224] Handling call
0709 12:17:48.185838 (+ 29115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:48.186209 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:48.186236 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:48.188352 (+  2116us) log.cc:844] Serialized 26 byte log entry
0709 12:17:48.354576 (+166224us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:48.626184 (+271608us) log.cc:844] Serialized 14 byte log entry
0709 12:17:48.997209 (+371025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.997304 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:50.050432 (+1053128us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:50.067059 (+ 16627us) raft_consensus.cc:1685] finished
0709 12:17:50.067170 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.067296 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":392101,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":328128,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7286,"spinlock_wait_cycles":13460352,"thread_start_us":711968,"threads_started":3,"wal-append.queue_time_us":240511}
I20260709 12:17:50.080293 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.081336 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.067849 24384 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:17:50.064241 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.077171 24325 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.006803 24326 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:50.085019 24326 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.077275 23901 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.086295 21179 raft_consensus.cc:2368] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:50.087090 24326 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.089146 23901 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.089695 24325 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.089865 21036 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:50.090866 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.091399 21036 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:50.058262 24249 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.978727 24208 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.089892 23805 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.099560 24352 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:50.100299 24352 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:49.980520 23773 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.101835 23805 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.104584 24351 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.108116 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.108654 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.109395 21103 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.110597 21183 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:50.101208 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.113343 21108 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:50.113641 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.114214 21185 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:50.116657 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.117383 21108 raft_consensus.cc:2393] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.007356 24334 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:50.033315 24393 log.cc:927] Time spent T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:17:50.127127 23677 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:50.136283 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2206) took 1030 ms. Trace:
I20260709 12:17:50.136680 21182 rpcz_store.cc:276] 0709 12:17:49.106235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.106335 (+   100us) service_pool.cc:224] Handling call
0709 12:17:49.121478 (+ 15143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:49.121823 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:49.121849 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:49.122306 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:17:49.629268 (+506962us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:49.629307 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.629378 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:50.136065 (+506687us) raft_consensus.cc:1685] finished
0709 12:17:50.136086 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.136223 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89381,"raft.queue_time_us":753,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4859,"thread_start_us":389150,"threads_started":1,"wal-append.queue_time_us":608055}
W20260709 12:17:50.033890 24410 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:17:50.139916 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:50.140113 23773 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:50.140542 21033 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.048249 24395 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.131340 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.131955 24345 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:50.134697 24208 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.027448 24372 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.207780 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:50.208411 21036 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:50.209187 24350 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.210139 24249 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.041724 24336 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:50.119712 24200 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.211143 24336 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.211341 24200 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.212572 21737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 687) took 2253 ms. Trace:
I20260709 12:17:50.213343 24200 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.213804 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2208) took 1102 ms. Trace:
I20260709 12:17:50.214162 21178 rpcz_store.cc:276] 0709 12:17:49.111621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.112659 (+  1038us) service_pool.cc:224] Handling call
0709 12:17:50.213607 (+1100948us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400387a54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:50.213728 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470683008}
W20260709 12:17:50.215085 24196 consensus_meta.cc:287] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.714s	user 0.005s	sys 0.005s
I20260709 12:17:50.114511 24325 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:50.202392 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.218513 21108 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.109807 24326 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.049094 24311 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:50.032811 24408 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.201710 24395 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:50.240285 24395 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.205922 23740 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:50.244525 24372 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.222903 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.215494 24196 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.230502 24326 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.213193 24336 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.238976 24311 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.215723 24202 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.369927 24202 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.226583 21033 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:50.212939 21737 rpcz_store.cc:276] 0709 12:17:47.958970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.961724 (+  2754us) service_pool.cc:224] Handling call
0709 12:17:47.961996 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.900229 (+938233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.212314 (+1312085us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54001effd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:50.212491 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156158848}
I20260709 12:17:50.289409 21036 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:50.301069 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2350) took 1017 ms. Trace:
I20260709 12:17:50.265329 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.143512 24353 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:50.376209 21034 rpcz_store.cc:276] 0709 12:17:49.234930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.270006 (+ 35076us) service_pool.cc:224] Handling call
0709 12:17:50.252184 (+982178us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54000c3ad4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:50.252323 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271659264}
I20260709 12:17:50.223564 24351 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.385172 21108 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.388736 24196 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.390589 24311 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:50.391503 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.391302 24353 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.393607 24353 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.247227 24325 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.439095 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.396859 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.425101 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.485460 21036 raft_consensus.cc:2368] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
W20260709 12:17:50.480674 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 642923us
I20260709 12:17:50.490918 21108 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.491858 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.492669 21103 raft_consensus.cc:2368] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
W20260709 12:17:50.459239 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 406296us
I20260709 12:17:50.493211 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.496454 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.500023 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.458786 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:50.502349 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:50.509670 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 51010.6us
I20260709 12:17:50.503180 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.504423 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.504789 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.511510 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.509866 21102 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:50.513242 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:50.513749 21102 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.506161 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.515249 21111 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.507230 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.516727 21110 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.512339 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.505004 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.518451 21033 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:50.519359 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:50.459021 24341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.202s	user 0.011s	sys 0.015s
I20260709 12:17:50.515977 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.521715 21151 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:50.530117 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:50.497938 24415 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.528317 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.531118 21104 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:50.531312 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.532512 21103 raft_consensus.cc:2393] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.534049 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.534631 21111 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:50.528151 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.492833 24196 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:50.527793 24311 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:50.526917 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:50.251377 24277 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.573415 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.563331 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.576400 21181 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:50.576588 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.577404 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.578060 21177 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:50.505734 24395 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.548391 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.548688 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.549854 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.501237 24326 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:50.571595 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.530184 21102 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:50.572458 24414 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.581023 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.582134 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35652 (request call id 410) took 1332 ms. Trace:
I20260709 12:17:50.551317 24415 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.645457 21035 rpcz_store.cc:276] 0709 12:17:49.230969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.232138 (+  1169us) service_pool.cc:224] Handling call
0709 12:17:50.562986 (+1330848us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b54000c58d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:50.563071 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228500736}
I20260709 12:17:50.637288 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:50.648842 21181 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.649076 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.649642 21035 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:50.642575 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:50.556231 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:50.530007 24341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.011s	sys 0.015s
I20260709 12:17:50.585191 21109 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.647029 21185 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:50.655529 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.655615 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.656620 21035 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:50.555027 24345 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.651193 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.653064 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:50.662973 21149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.050s	sys 0.042s
I20260709 12:17:50.653754 21103 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:50.663501 21149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.050s	sys 0.042s
I20260709 12:17:50.544667 23740 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:50.535969 24356 consensus_meta.cc:287] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
I20260709 12:17:50.656243 21104 raft_consensus.cc:2368] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:50.657527 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.648016 21186 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:50.647549 21111 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:50.431536 24351 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.679137 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.558297 24311 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:50.661278 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.557983 24289 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:50.662992 21184 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:50.682484 21180 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:50.666603 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.667234 21106 raft_consensus.cc:2368] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
I20260709 12:17:50.653704 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.643923 24344 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:50.671773 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 87736.7us
I20260709 12:17:50.671962 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2355) took 1435 ms. Trace:
I20260709 12:17:50.678181 21181 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:50.658159 24303 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:50.681533 21104 raft_consensus.cc:2368] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
I20260709 12:17:50.660392 21033 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:50.690003 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.699993 21031 rpcz_store.cc:276] 0709 12:17:49.236040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.257796 (+ 21756us) service_pool.cc:224] Handling call
0709 12:17:50.671808 (+1414012us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b5400081bd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:50.671907 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143421696}
I20260709 12:17:50.702596 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:50.702883 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.703001 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:50.703193 21033 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:50.699967 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.701015 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.584973 24196 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:50.653126 24414 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.058548 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:50.738899 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:51.056737 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:50.866086 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 356613us
I20260709 12:17:51.062280 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:50.670537 23740 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.779261 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:51.061425 21031 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:50.965500 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.959144 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.933490 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.752492 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.782382 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:51.065359 21111 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:51.061717 21029 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:51.077136 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.081461 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:50.749555 21035 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:51.082345 21741 raft_consensus.cc:2410] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:51.082499 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2362) took 1149 ms. Trace:
I20260709 12:17:50.834051 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:51.081522 21036 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.720791 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:51.085258 21739 raft_consensus.cc:2393] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:17:50.700150 24361 consensus_meta.cc:287] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.001s
I20260709 12:17:51.083053 21029 rpcz_store.cc:276] 0709 12:17:49.932956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.669693 (+736737us) service_pool.cc:224] Handling call
0709 12:17:51.082352 (+412659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:50.687887 24200 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:50.699244 24326 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:50.698482 24311 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.840231 24362 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.088212 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:51.088284 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.095268 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.095772 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:50.689015 24289 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:50.854663 24411 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.823s	user 0.002s	sys 0.008s
W20260709 12:17:50.988425 24399 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 1.253s	user 0.005s	sys 0.012s
I20260709 12:17:51.087683 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:50.906605 24325 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:51.091801 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:50.852916 24216 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:51.084033 21102 raft_consensus.cc:2410] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:17:51.088888 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:50.668263 24345 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.134029 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:50.681815 24356 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.078735 23740 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.095674 21743 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:51.138796 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:51.067744 24277 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:51.096792 24361 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:50.703826 24413 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:50.743566 24395 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:51.065524 24351 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:51.110127 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:51.140589 21028 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:51.111948 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:51.141269 21184 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.141569 24351 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:51.142367 24361 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:51.112896 21741 raft_consensus.cc:1813] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Handling vote request from an unknown peer 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:51.143427 21741 raft_consensus.cc:2410] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:17:51.143812 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:50.721040 24344 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:51.127858 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 428089us
I20260709 12:17:51.098057 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:51.153759 21177 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.125209 21186 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:51.155048 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:51.136142 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:51.109436 24421 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 12:17:50.704039 24334 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.110082 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.157867 21109 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:51.144629 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:51.158892 21075 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.4:35157 timed out after 1.548s (SENT) [suppressed 13 similar messages]
I20260709 12:17:51.121791 21033 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:51.151146 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.163179 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:51.155683 21186 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.112722 24289 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:51.156068 21747 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:51.141444 24395 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:51.193318 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:51.175638 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:51.167366 21149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.023s	sys 0.014s
I20260709 12:17:51.152030 21036 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:51.170859 21107 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:51.194808 21077 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:51.195268 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2373) took 1147 ms. Trace:
I20260709 12:17:51.195699 21036 rpcz_store.cc:276] 0709 12:17:50.048184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.700419 (+652235us) service_pool.cc:224] Handling call
0709 12:17:51.195209 (+494790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:51.196528 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:51.197064 21036 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:51.194677 21149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.024s	sys 0.014s
I20260709 12:17:51.201809 24420 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:51.202313 24420 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.202631 24420 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:51.207083 24277 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:51.207576 24277 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.207901 24277 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:51.180824 21747 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
W20260709 12:17:51.217551 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.223966 24277 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.110021 24326 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:51.227844 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2352) took 1992 ms. Trace:
I20260709 12:17:51.110235 24200 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:51.150583 24361 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:51.158807 24415 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:51.231205 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 72353.2us
I20260709 12:17:51.228753 21033 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:51.238005 21186 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:51.253610 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:51.254204 21186 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:51.143008 24351 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.230518 21032 rpcz_store.cc:276] 0709 12:17:49.235400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.304137 (+ 68737us) service_pool.cc:224] Handling call
0709 12:17:49.304468 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:49.711576 (+407108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:49.711610 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:49.728659 (+ 17049us) log.cc:844] Serialized 26 byte log entry
0709 12:17:49.926952 (+198293us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:49.926990 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.927057 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:50.854030 (+926973us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:51.194815 (+340785us) raft_consensus.cc:1685] finished
0709 12:17:51.194836 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.227770 (+ 32934us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7492,"raft.queue_time_us":102017,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":34563,"spinlock_wait_cycles":179440512,"thread_start_us":556926,"threads_started":2,"wal-append.queue_time_us":259047}
I20260709 12:17:51.259686 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:51.111575 24362 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:51.255312 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:51.258589 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2370) took 1225 ms. Trace:
I20260709 12:17:51.260244 21032 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:51.268339 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:51.261826 21033 rpcz_store.cc:276] 0709 12:17:50.033369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.193043 (+1159674us) service_pool.cc:224] Handling call
0709 12:17:51.258531 (+ 65488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:51.268795 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:51.269801 21102 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:51.270550 21186 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.272490 21000 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:51.138266 24216 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:51.276264 21181 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:17:51.141325 24413 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.280829 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.277961 21036 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:51.280197 21177 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:51.282459 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.286886 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.277678 21000 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:51.303519 21036 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:51.304342 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1530) took 1656 ms. Trace:
I20260709 12:17:51.304661 21036 rpcz_store.cc:276] 0709 12:17:49.647714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.302959 (+1655245us) service_pool.cc:224] Handling call
0709 12:17:51.303354 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.304055 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.304276 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:51.310086 21186 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:51.317556 21186 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:51.348021 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.348966 21740 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
I20260709 12:17:51.375300 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.376013 21747 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 4.
W20260709 12:17:51.382910 21028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2363) took 1449 ms (client timeout 1522 ms). Trace:
W20260709 12:17:51.383373 21028 rpcz_store.cc:269] 0709 12:17:49.933251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.072485 (+139234us) service_pool.cc:224] Handling call
0709 12:17:51.382682 (+1310197us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000c4ed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:51.382824 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454604160}
I20260709 12:17:51.385438 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.411669 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1533) took 1763 ms. Trace:
I20260709 12:17:51.412225 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.412101 21036 rpcz_store.cc:276] 0709 12:17:49.648425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.305424 (+1656999us) service_pool.cc:224] Handling call
0709 12:17:51.411163 (+105739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.411348 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.411370 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:51.411410 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:51.411446 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.411500 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.411615 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:51.415634 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1537) took 1766 ms. Trace:
I20260709 12:17:51.416025 21028 rpcz_store.cc:276] 0709 12:17:49.649337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.414867 (+1765530us) service_pool.cc:224] Handling call
0709 12:17:51.415181 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.415348 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.415372 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:51.415412 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:51.415439 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.415487 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.415582 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:51.261866 24361 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.261498 24420 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.425186 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.349395 24433 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.273181 24235 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 12:17:51.475051 21036 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:51.475811 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1538) took 1826 ms. Trace:
I20260709 12:17:51.476123 21036 rpcz_store.cc:276] 0709 12:17:49.649919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.418271 (+1768352us) service_pool.cc:224] Handling call
0709 12:17:51.468383 (+ 50112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.475546 (+  7163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.475753 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:51.479964 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 202330us
I20260709 12:17:51.480824 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.384236 24419 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:51.411151 24418 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:51.424116 24231 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:51.490360 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.492342 24432 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:51.495569 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.496445 21108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:51.498203 21104 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:51.501674 21184 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:51.504824 21108 raft_consensus.cc:606] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:51.504945 21031 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:51.597857 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2380) took 1110 ms. Trace:
I20260709 12:17:51.598234 21031 rpcz_store.cc:276] 0709 12:17:50.487375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.702757 (+215382us) service_pool.cc:224] Handling call
0709 12:17:51.597798 (+895041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:51.505982 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2340) took 2263 ms. Trace:
I20260709 12:17:51.511257 24344 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:51.497215 24429 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:51.512413 24423 log.cc:927] Time spent T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 12:17:51.514340 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2359) took 2277 ms. Trace:
I20260709 12:17:51.480271 24441 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:51.500200 24419 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:51.480901 24433 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.516523 24351 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:51.518108 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 165355us
W20260709 12:17:51.495296 24435 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 12:17:51.600761 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:51.599053 21027 rpcz_store.cc:276] 0709 12:17:49.232465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.233181 (+   716us) service_pool.cc:224] Handling call
0709 12:17:49.233426 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:49.270675 (+ 37249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:49.270704 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:49.270737 (+    33us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:49.270764 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.486832 (+2216068us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b54000c44d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:51.486894 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.495347 (+  8453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85279488}
W20260709 12:17:51.862489 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 44132.2us
I20260709 12:17:51.642827 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.914767 21032 rpcz_store.cc:276] 0709 12:17:49.236953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.278397 (+2041444us) service_pool.cc:224] Handling call
0709 12:17:51.279297 (+   900us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.279765 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.279814 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.280524 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 12:17:51.381695 (+101171us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:51.381729 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.381811 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:51.514120 (+132309us) raft_consensus.cc:1685] finished
0709 12:17:51.514153 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.514284 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":326816,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":96602,"thread_start_us":100804,"threads_started":1,"wal-append.queue_time_us":202208}
I20260709 12:17:51.844132 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2366) took 1910 ms. Trace:
I20260709 12:17:51.874531 20999 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:51.823205 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:51.821897 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:51.916200 21747 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:51.770963 21002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.021s	sys 0.043s
I20260709 12:17:51.913795 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:51.915143 21108 raft_consensus.cc:614] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:51.917893 21031 rpcz_store.cc:276] 0709 12:17:49.933964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.598884 (+1664920us) service_pool.cc:224] Handling call
0709 12:17:51.843629 (+244745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.843819 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.843846 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:51.843885 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:51.843916 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.843968 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.844072 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:51.689762 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 417137us
W20260709 12:17:51.922227 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 272963us
W20260709 12:17:51.792906 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.921464 21033 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.002s	sys 0.009s
W20260709 12:17:51.920231 21002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.027s	sys 0.056s
I20260709 12:17:51.934203 21076 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:51.928743 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54264.4us
W20260709 12:17:51.648334 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 47466.3us
W20260709 12:17:51.841926 24311 consensus_meta.cc:287] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.000s
W20260709 12:17:51.825954 24437 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 12:17:51.503535 24334 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:51.945024 21033 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.003s	sys 0.010s
I20260709 12:17:51.945848 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.945043 21743 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.008798 20999 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:51.945586 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:52.003547 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 69445.9us
I20260709 12:17:51.833389 24442 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:51.845209 24431 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:51.835737 24326 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:51.834324 24277 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:51.836863 24413 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:51.940873 24452 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:51.597244 24356 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.021313 21747 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:51.604724 24414 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:51.835404 24420 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:51.944873 21031 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.037753 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:51.506790 24231 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:51.950804 24351 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.058281 24351 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:51.500010 24418 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:51.967629 24415 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:52.049279 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1672) took 1071 ms. Trace:
I20260709 12:17:51.945868 24454 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:52.061362 21107 rpcz_store.cc:276] 0709 12:17:50.964962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.965149 (+   187us) service_pool.cc:224] Handling call
0709 12:17:52.036563 (+1071414us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b5400240c54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.036742 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192343424}
I20260709 12:17:52.010625 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:52.062011 24454 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:52.062449 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 51895.4us
I20260709 12:17:52.063392 21076 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:52.064170 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:52.064576 24454 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.027982 24334 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:51.802366 24450 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:17:52.050262 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 105499us
W20260709 12:17:52.010785 24369 consensus_meta.cc:287] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 2.002s	user 0.011s	sys 0.010s
W20260709 12:17:52.048866 24428 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.760s	user 0.001s	sys 0.000s
I20260709 12:17:52.010675 24362 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.005394 24311 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.039615 24216 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.092955 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:51.516942 24432 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.035113 24431 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:52.096145 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 147110us
I20260709 12:17:52.054947 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.119172 21104 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:52.061453 24415 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:17:52.071336 24289 consensus_meta.cc:287] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.878s	user 0.007s	sys 0.003s
I20260709 12:17:52.100450 21149 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.122362 21150 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:52.123023 24362 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:52.096071 24454 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:52.125005 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:52.037365 24442 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.147055 24442 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:52.147429 21181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 487) took 1563 ms (client timeout 2022 ms). Trace:
I20260709 12:17:52.148046 24459 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.148819 24350 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.148609 24459 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.149598 24463 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:52.139994 21002 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:52.101498 24420 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:51.943480 24441 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.144381 24454 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.149029 24446 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.101601 24277 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:52.152328 21178 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
W20260709 12:17:52.147852 21181 rpcz_store.cc:269] 0709 12:17:50.583650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.700736 (+117086us) service_pool.cc:224] Handling call
0709 12:17:52.147255 (+1446519us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400200dd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.147371 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495100672}
I20260709 12:17:52.119431 24326 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:51.921237 24429 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.120910 24361 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.108481 24369 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.231483 24326 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.233137 24326 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:52.234725 21107 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:52.139381 24356 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.235106 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.236392 24369 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.236116 24356 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.237002 24369 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:52.237485 24369 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.158771 24420 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:52.238524 24420 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:52.228744 21177 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:52.140316 24200 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.240305 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2249) took 1040 ms. Trace:
I20260709 12:17:52.218554 24362 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:52.241112 24362 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.220250 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2248) took 1020 ms. Trace:
I20260709 12:17:52.150385 24449 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:52.235302 24277 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:52.231722 24361 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:52.121079 24431 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.134642 24451 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:52.237984 24454 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.243788 24277 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:52.244494 24454 raft_consensus.cc:2764] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:17:52.245318 24454 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:52.245738 24454 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:52.246546 24454 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.125202 24439 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:52.235363 21029 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:52.242365 21184 rpcz_store.cc:276] 0709 12:17:51.199774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.988846 (+789072us) service_pool.cc:224] Handling call
0709 12:17:52.013381 (+ 24535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.013886 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:52.071232 (+ 57346us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.218315 (+147083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.218373 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:52.218423 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.220009 (+  1586us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.220184 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72630,"prepare.queue_time_us":56995,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"thread_start_us":90628,"threads_started":1}
I20260709 12:17:52.248984 24439 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.250348 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2252) took 1049 ms. Trace:
I20260709 12:17:52.135671 24289 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.253672 21031 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:52.253964 24369 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.254530 24465 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:52.243767 21177 rpcz_store.cc:276] 0709 12:17:51.199996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.066323 (+866327us) service_pool.cc:224] Handling call
0709 12:17:52.228547 (+162224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.240051 (+ 11504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.240255 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.066182 24452 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.273851 24415 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:52.279400 21741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.000s	sys 0.016s
I20260709 12:17:52.103094 24450 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.292202 21149 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.246376 24326 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.293524 21737 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:17:52.297640 21742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 690) took 3186 ms (client timeout 1548 ms). Trace:
W20260709 12:17:52.306989 21742 rpcz_store.cc:269] 0709 12:17:49.103427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.103551 (+   124us) service_pool.cc:224] Handling call
0709 12:17:52.289244 (+3185693us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54004a6854. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.289664 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555579776}
W20260709 12:17:52.298712 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 233776us
I20260709 12:17:52.269994 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2367) took 2335 ms. Trace:
W20260709 12:17:52.291653 24436 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.598s	user 0.000s	sys 0.001s
I20260709 12:17:52.300778 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:52.308743 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:52.287720 21184 rpcz_store.cc:276] 0709 12:17:51.200669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.249486 (+1048817us) service_pool.cc:224] Handling call
0709 12:17:52.249802 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.249967 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.249993 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.250032 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:52.250063 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.250114 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.250291 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.294721 21743 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:52.234426 24429 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:52.302553 21741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.000s	sys 0.017s
I20260709 12:17:52.273290 24432 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.278970 24351 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.311261 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:52.314277 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2255) took 1112 ms. Trace:
I20260709 12:17:52.325416 21741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 694) took 1046 ms. Trace:
I20260709 12:17:52.324934 21177 rpcz_store.cc:276] 0709 12:17:51.201436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.299451 (+1098015us) service_pool.cc:224] Handling call
0709 12:17:52.313746 (+ 14295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.313947 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.313973 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.314020 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:52.314059 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.314109 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.314213 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.309317 21031 rpcz_store.cc:276] 0709 12:17:49.934183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.944457 (+2010274us) service_pool.cc:224] Handling call
0709 12:17:51.944765 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.269619 (+324854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.269920 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.251502 24277 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.283183 24449 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:52.310999 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:52.311985 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:52.332341 24199 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:52.325961 21741 rpcz_store.cc:276] 0709 12:17:51.279228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.279341 (+   113us) service_pool.cc:224] Handling call
0709 12:17:51.279729 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.279924 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:51.693194 (+413270us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.325012 (+631818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.325073 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:52.325146 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.325215 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.325350 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":866518,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":949758,"threads_started":2}
I20260709 12:17:52.337738 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 412) took 1792 ms. Trace:
I20260709 12:17:52.354226 21034 rpcz_store.cc:276] 0709 12:17:50.545186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.336952 (+1791766us) service_pool.cc:224] Handling call
0709 12:17:52.337217 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.337400 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.337424 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.337465 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:52.337505 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.337557 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.337677 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.355084 21076 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:52.310524 24460 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:17:52.340566 24441 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.324540 24200 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:52.289985 24361 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.351198 21747 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:52.351824 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:52.305804 24459 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.335225 24352 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.367044 24470 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:52.367494 24470 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:52.366957 24449 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:52.338378 21183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1774) took 2546 ms (client timeout 3116 ms). Trace:
I20260709 12:17:52.368371 24452 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.304056 24231 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.352818 24418 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:52.352568 24433 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:52.372272 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2251) took 1171 ms. Trace:
I20260709 12:17:52.372740 21181 rpcz_store.cc:276] 0709 12:17:51.200456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.238611 (+1038155us) service_pool.cc:224] Handling call
0709 12:17:52.238959 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.239169 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:52.239716 (+   547us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.371896 (+132180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.371952 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:52.372021 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.372091 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.372209 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":158,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"thread_start_us":131862,"threads_started":1}
I20260709 12:17:52.301247 24439 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:52.374660 21183 rpcz_store.cc:269] 0709 12:17:49.791741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.056880 (+265139us) service_pool.cc:224] Handling call
0709 12:17:52.338190 (+2281310us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b54003fd754. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.338313 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121021184}
I20260709 12:17:52.365036 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:52.366370 21184 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:52.360303 24442 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:52.356505 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 64408.5us
I20260709 12:17:52.379283 21177 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:52.380249 21076 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:52.313370 24356 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.344023 24377 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:52.363413 24400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.286s	user 0.016s	sys 0.043s
W20260709 12:17:52.385911 21035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2379) took 1901 ms (client timeout 1858 ms). Trace:
I20260709 12:17:52.386137 21036 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:52.394874 21035 rpcz_store.cc:269] 0709 12:17:50.484151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.657290 (+173139us) service_pool.cc:224] Handling call
0709 12:17:52.385708 (+1728418us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b54003d40d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.385829 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182202240}
I20260709 12:17:52.384637 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:52.313309 24455 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:52.408205 21184 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:52.410740 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:52.411212 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 417) took 1575 ms. Trace:
I20260709 12:17:52.374109 24199 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:52.412837 21035 rpcz_store.cc:276] 0709 12:17:50.835398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.410353 (+1574955us) service_pool.cc:224] Handling call
0709 12:17:52.410676 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.410876 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.410902 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.410941 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:52.410980 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.411031 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.411149 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.412858 21183 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:52.384723 24429 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:52.415364 21149 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.416644 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2256) took 1197 ms. Trace:
W20260709 12:17:52.400833 24400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.324s	user 0.016s	sys 0.044s
I20260709 12:17:52.418695 24277 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.414824 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2236) took 1833 ms. Trace:
I20260709 12:17:52.297034 24446 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.393958 24200 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:52.434223 21186 rpcz_store.cc:276] 0709 12:17:50.581156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.321743 (+740587us) service_pool.cc:224] Handling call
0709 12:17:51.322077 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.376919 (+ 54842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.376950 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.411034 (+ 34084us) log.cc:844] Serialized 26 byte log entry
0709 12:17:51.491610 (+ 80576us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:51.491650 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.491724 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:52.414606 (+922882us) raft_consensus.cc:1685] finished
0709 12:17:52.414634 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.414763 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106260,"raft.queue_time_us":789063,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":21694,"thread_start_us":7599,"threads_started":1,"wal-append.queue_time_us":540609}
I20260709 12:17:52.461758 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1670) took 1497 ms. Trace:
I20260709 12:17:52.394034 24450 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.427016 21181 rpcz_store.cc:276] 0709 12:17:51.219110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.415830 (+1196720us) service_pool.cc:224] Handling call
0709 12:17:52.416105 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.416291 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.416316 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.416358 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:52.416399 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.416451 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.416550 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.433732 21149 leader_election.cc:400] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
I20260709 12:17:52.467941 21149 leader_election.cc:403] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:52.469048 21149 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.470391 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:52.441104 24429 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:52.442502 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 418) took 1586 ms. Trace:
I20260709 12:17:52.411446 24458 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:17:52.458153 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 450519us
I20260709 12:17:52.462571 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:52.462244 21103 rpcz_store.cc:276] 0709 12:17:50.937888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.956143 (+ 18255us) service_pool.cc:224] Handling call
0709 12:17:50.956561 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:50.957007 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:50.957036 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:50.957551 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:17:51.132378 (+174827us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:51.132423 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.132501 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:52.434533 (+1302032us) raft_consensus.cc:1685] finished
0709 12:17:52.434553 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.434692 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100249,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3542,"thread_start_us":174392,"threads_started":1,"wal-append.queue_time_us":466346}
I20260709 12:17:52.521306 24303 raft_consensus.cc:2764] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:17:52.521449 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 58970.4us
I20260709 12:17:52.521787 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.522686 21103 raft_consensus.cc:2393] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:52.523245 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:52.523424 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:52.524068 21103 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:52.383015 24420 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.525952 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:52.471145 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 331179us
I20260709 12:17:52.527845 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:52.529026 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:52.529840 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:52.471690 21177 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:52.438700 21183 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:52.481369 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 414) took 1812 ms. Trace:
I20260709 12:17:52.519994 20999 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.480294 21035 rpcz_store.cc:276] 0709 12:17:50.856200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.441706 (+1585506us) service_pool.cc:224] Handling call
0709 12:17:52.442001 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.442175 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.442201 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.442242 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:52.442284 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.442337 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.442446 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.434508 24442 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:52.536821 23740 consensus_meta.cc:287] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 1.379s	user 0.009s	sys 0.000s
I20260709 12:17:52.536626 24431 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.527704 24277 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:52.538132 24464 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:17:52.538352 24481 raft_consensus.cc:2764] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:17:52.538777 24450 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:52.540537 24434 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:17:52.541167 21179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1775) took 2749 ms (client timeout 1617 ms). Trace:
I20260709 12:17:52.542052 24419 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.538807 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.368338 24470 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.532886 21104 raft_consensus.cc:2393] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:52.546311 20999 leader_election.cc:400] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:52.568677 20999 leader_election.cc:403] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:52.546077 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.483141 24414 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:52.481280 24418 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:52.481107 24413 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
W20260709 12:17:52.564847 21179 rpcz_store.cc:269] 0709 12:17:49.792076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.807801 (+ 15725us) service_pool.cc:224] Handling call
0709 12:17:52.540961 (+2733160us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540015e354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.541088 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533873408}
I20260709 12:17:52.532346 21034 rpcz_store.cc:276] 0709 12:17:50.669439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.355185 (+1685746us) service_pool.cc:224] Handling call
0709 12:17:52.355488 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.355697 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:52.436469 (+ 80772us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.481026 (+ 44557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.481077 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:52.481134 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.481199 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.481314 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11787,"prepare.queue_time_us":105105,"raft.queue_time_us":2939,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":12394,"thread_start_us":93671,"threads_started":2}
I20260709 12:17:52.544813 24458 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:52.566617 21103 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:52.615787 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.615617 24458 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.616889 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.617758 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2234) took 2037 ms. Trace:
I20260709 12:17:52.617893 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.619055 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.620040 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.620333 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1540) took 2969 ms. Trace:
I20260709 12:17:52.621060 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.621635 21103 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:52.622390 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.622942 21103 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:52.623991 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.625008 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.625520 21103 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:52.548533 24377 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:52.554277 23740 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:52.621831 21102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1673) took 1656 ms (client timeout 2060 ms). Trace:
W20260709 12:17:52.626823 21102 rpcz_store.cc:269] 0709 12:17:50.965320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.138511 (+173191us) service_pool.cc:224] Handling call
0709 12:17:52.621677 (+1483166us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400253ad4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.621771 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299641728}
I20260709 12:17:52.627858 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.628171 23740 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:52.620368 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2371) took 2576 ms. Trace:
I20260709 12:17:52.629911 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:52.631217 24418 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:52.631608 24418 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.628886 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.629467 21027 rpcz_store.cc:276] 0709 12:17:50.043820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.335215 (+2291395us) service_pool.cc:224] Handling call
0709 12:17:52.335506 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.345008 (+  9502us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:52.410162 (+ 65154us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.456103 (+ 45941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.456161 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:52.456206 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.620115 (+163909us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b54000645d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:52.620172 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.620305 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48510,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":6099,"raft.queue_time_us":96,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":21353728,"thread_start_us":75106,"threads_started":2,"wal-append.queue_time_us":35214}
I20260709 12:17:52.618208 21182 rpcz_store.cc:276] 0709 12:17:50.580648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.285832 (+705184us) service_pool.cc:224] Handling call
0709 12:17:52.149361 (+863529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:52.149677 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.149709 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:52.150167 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:17:52.318958 (+168791us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:52.319323 (+   365us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.367038 (+ 47715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.367111 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:52.449425 (+ 82314us) raft_consensus.cc:1685] finished
0709 12:17:52.449444 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.617568 (+168124us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b5400200dd0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.617690 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76206,"prepare.queue_time_us":132,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":116309,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":32029,"spinlock_wait_cycles":1908184960,"thread_start_us":168445,"threads_started":1,"wal-append.queue_time_us":297325}
I20260709 12:17:52.632802 21102 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 4.
I20260709 12:17:52.633092 24361 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.600805 24414 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.633658 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.633916 24414 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.634116 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.634687 21107 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:17:52.634810 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.635506 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:52.636292 21102 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:52.628989 21180 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:52.638639 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 107770us
I20260709 12:17:52.638779 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:52.639390 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:52.555730 24277 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.564662 24434 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:52.570981 24199 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.554376 24446 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.610901 21740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 696) took 1328 ms. Trace:
I20260709 12:17:52.613014 24345 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:52.632017 24418 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.640004 21149 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:52.620725 21028 rpcz_store.cc:276] 0709 12:17:49.650671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.416886 (+1766215us) service_pool.cc:224] Handling call
0709 12:17:51.417181 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.845257 (+428076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.845289 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.919051 (+ 73762us) log.cc:844] Serialized 26 byte log entry
0709 12:17:52.289761 (+370710us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:52.303347 (+ 13586us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.312323 (+  8976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.312396 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:52.620133 (+307737us) raft_consensus.cc:1685] finished
0709 12:17:52.620151 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.620272 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36097,"prepare.queue_time_us":13386,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3625,"raft.queue_time_us":684192,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":32620,"thread_start_us":689632,"threads_started":2,"wal-append.queue_time_us":442933}
I20260709 12:17:52.563237 24289 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:52.647441 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 101246us
I20260709 12:17:52.659238 20999 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.660557 20999 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.661360 24356 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:52.662089 24356 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:52.648226 21002 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:52.663694 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:52.664875 21002 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:52.564096 24450 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.655407 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:52.666790 24450 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:52.657069 21033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.010s	sys 0.022s
I20260709 12:17:52.652199 21740 rpcz_store.cc:276] 0709 12:17:51.282118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.282237 (+   119us) service_pool.cc:224] Handling call
0709 12:17:52.610640 (+1328403us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b54005d1454. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.610783 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151361280}
W20260709 12:17:52.667826 21033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.010s	sys 0.022s
I20260709 12:17:52.668318 24352 raft_consensus.cc:2764] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:52.668985 24352 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:52.669332 24352 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.669696 24352 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:52.671046 24439 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:52.672696 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.675105 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.675441 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.675778 21027 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:52.676141 21028 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:52.677126 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:52.675359 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2358) took 3438 ms. Trace:
I20260709 12:17:52.678594 20999 leader_election.cc:400] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
I20260709 12:17:52.677619 24352 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.680508 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.680809 24352 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.677736 21034 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:17:52.691705 21034 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:52.693935 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.695047 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.696493 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.697152 21035 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:52.697965 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:52.698915 21035 raft_consensus.cc:2368] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
I20260709 12:17:52.678076 21033 rpcz_store.cc:276] 0709 12:17:49.236730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.273407 (+2036677us) service_pool.cc:224] Handling call
0709 12:17:51.273700 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.273883 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:52.009804 (+735921us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.675009 (+665205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.675058 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:52.675123 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.675191 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.675304 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":823252,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":3591,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":1393697,"threads_started":2}
I20260709 12:17:52.699726 24352 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:52.700762 20999 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:52.694303 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:52.699802 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.702126 21028 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:52.702279 21035 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:52.703033 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.703374 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.703677 21028 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 2.
I20260709 12:17:52.704195 21035 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:52.704593 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:52.705232 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.705734 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.708451 24450 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.701290 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:52.711294 21033 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:52.712499 24352 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:52.712944 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:52.713789 24352 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:52.714319 24352 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:52.715266 24352 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:52.718986 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 79035.8us
I20260709 12:17:52.720288 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.721645 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.650789 24451 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:52.645612 24481 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:52.650197 24377 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:52.648794 24413 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:52.724933 21035 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:52.723347 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.652253 24361 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:52.750492 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.722514 24400 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:52.741786 24289 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:52.725701 24446 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.710744 24450 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:52.569757 24200 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.740403 24481 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:52.750980 24413 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:52.782637 24329 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:52.629594 24429 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:52.751823 24361 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.749922 24475 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:52.792096 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:52.748378 23740 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 12:17:52.815481 21106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1652) took 2310 ms (client timeout 2155 ms). Trace:
I20260709 12:17:52.816378 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2229) took 2250 ms. Trace:
I20260709 12:17:52.857440 21178 rpcz_store.cc:276] 0709 12:17:50.566030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.109886 (+543856us) service_pool.cc:224] Handling call
0709 12:17:52.816198 (+1706312us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540001a4d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.816309 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2325804928}
I20260709 12:17:52.791580 24289 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.793376 24189 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:17:52.855024 21028 raft_consensus.cc:2376] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9. Re-sending same reply.
W20260709 12:17:52.856756 21106 rpcz_store.cc:269] 0709 12:17:50.505408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.505526 (+   118us) service_pool.cc:224] Handling call
0709 12:17:52.815229 (+2309703us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001c61d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.815389 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295549312}
I20260709 12:17:52.819169 24413 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.854380 24361 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:52.813552 24481 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.895422 24375 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:52.752399 24434 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.899612 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.880378 24289 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:52.797148 24446 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:52.933854 24345 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:17:52.960361 24491 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:17:52.978022 21029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2372) took 2930 ms (client timeout 2678 ms). Trace:
W20260709 12:17:52.978556 21029 rpcz_store.cc:269] 0709 12:17:50.047908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.095400 (+1047492us) service_pool.cc:224] Handling call
0709 12:17:52.977798 (+1882398us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000627d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:52.977930 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2531047296}
I20260709 12:17:52.984253 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:52.985076 21028 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:52.990511 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:52.995940 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:52.998606 21029 raft_consensus.cc:2376] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9. Re-sending same reply.
I20260709 12:17:53.000625 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2369) took 2995 ms. Trace:
I20260709 12:17:53.000247 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.003006 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.004225 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.004747 21028 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:53.005895 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:53.006446 21028 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.007063 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1543) took 3158 ms. Trace:
I20260709 12:17:53.002609 21029 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:53.007462 21036 rpcz_store.cc:276] 0709 12:17:49.848546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.476880 (+1628334us) service_pool.cc:224] Handling call
0709 12:17:52.385834 (+908954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.395012 (+  9178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.006869 (+611857us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54003d40d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:53.007000 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033663744}
I20260709 12:17:53.008581 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.009127 21036 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:53.009028 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.010068 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.011999 24400 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:53.012467 24400 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.016417 21737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 436) took 1944 ms. Trace:
I20260709 12:17:53.016716 24196 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:53.001048 21031 rpcz_store.cc:276] 0709 12:17:50.005576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.348193 (+2342617us) service_pool.cc:224] Handling call
0709 12:17:52.348491 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.408795 (+ 60304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.408829 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.408872 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:52.408918 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.000398 (+591480us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b540035cd54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:53.000442 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.000565 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138141056}
I20260709 12:17:52.879160 24475 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:53.016856 21737 rpcz_store.cc:276] 0709 12:17:51.072465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.072601 (+   136us) service_pool.cc:224] Handling call
0709 12:17:52.289769 (+1217168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.307164 (+ 17395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.016210 (+709046us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54004a6850. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:53.016348 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2763669760}
W20260709 12:17:53.022416 21709 connection.cc:256] RPC call timeout handler was delayed by -1.8129247859999396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 12:17:52.940852 24431 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:53.032346 21709 connection.cc:256] RPC call timeout handler was delayed by -1.4276761549999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 12:17:53.034716 24216 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:52.994099 24490 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:17:52.993863 24486 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.272s	user 0.000s	sys 0.002s
I20260709 12:17:53.098419 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.099332 21036 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:53.100363 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.101076 21036 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
W20260709 12:17:52.993587 24493 log.cc:927] Time spent T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:17:53.108513 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:53.109787 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:52.993995 24497 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:17:53.050943 21709 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:53.040108 21028 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
W20260709 12:17:53.125982 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 75138.4us
I20260709 12:17:53.126492 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.126784 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:53.127228 21028 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:53.129016 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:52.995546 24326 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:53.132220 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.133473 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.110545 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:53.134725 21185 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.111585 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.112594 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:53.113571 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.136842 21184 raft_consensus.cc:2368] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:53.137310 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.137573 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.137915 21183 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:53.114444 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:53.115705 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.138737 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.139104 21181 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:53.116432 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.139302 21183 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:53.140107 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.140107 21177 raft_consensus.cc:2368] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
I20260709 12:17:53.140686 21183 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:53.141227 21184 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:17:53.020630 24345 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:52.992532 24442 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:17:53.049048 24484 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
W20260709 12:17:53.383507 21107 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.089s	sys 0.123s
I20260709 12:17:53.141434 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:53.488906 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 362172us
I20260709 12:17:53.489951 21709 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:53.490780 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:53.125103 24372 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:53.493148 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.494158 21179 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:53.134075 21036 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:53.182129 24367 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:53.196990 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:53.198177 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:53.142107 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.276511 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:53.495270 21002 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.019s	sys 0.050s
I20260709 12:17:53.210991 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:53.183240 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 70994.4us
I20260709 12:17:53.139762 21186 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:17:53.499010 21177 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 2.
I20260709 12:17:53.499974 21181 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:53.306824 21185 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:53.491433 21028 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.501646 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:53.496825 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.502341 21184 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:53.364861 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 424511us
W20260709 12:17:53.498423 21002 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.020s	sys 0.050s
W20260709 12:17:53.503104 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 566782us
I20260709 12:17:53.503432 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:53.496197 21107 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.090s	sys 0.171s
I20260709 12:17:53.498193 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:53.512571 21151 leader_election.cc:400] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
I20260709 12:17:53.512955 21151 leader_election.cc:403] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:53.514745 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.516501 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:53.517271 21036 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:53.517407 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:53.518923 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:53.521023 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:53.521721 21177 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:53.341346 24496 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:17:53.526688 21184 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
W20260709 12:17:53.239583 24494 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
I20260709 12:17:53.530656 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:53.531504 21036 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:53.197768 24277 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:53.240234 24492 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 12:17:53.507607 24357 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:53.198964 24370 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:53.538872 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:53.540484 21178 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:53.541327 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.543195 21184 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:53.260562 24475 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:53.537210 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:53.510413 24446 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:53.082059 24216 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:53.545112 21150 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:53.537611 24357 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.552090 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:53.554261 21002 leader_election.cc:400] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:53.554543 21002 leader_election.cc:403] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:17:53.545024 23740 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:53.561280 23740 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:53.561698 23740 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:53.548249 24414 consensus_meta.cc:287] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.897s	user 0.010s	sys 0.000s
I20260709 12:17:53.516311 24345 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:53.514698 24400 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:53.570802 21036 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:53.573457 21186 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
W20260709 12:17:53.579493 21712 connection.cc:256] RPC call timeout handler was delayed by -1.2686689810000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
I20260709 12:17:53.557116 24444 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:53.567950 24289 consensus_meta.cc:287] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.002s
I20260709 12:17:53.593484 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.555413 24475 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
I20260709 12:17:53.590103 21185 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:53.571213 24446 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:53.592458 21182 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:53.586989 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:53.556718 24357 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.578351 24362 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:53.608800 21109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1665) took 2910 ms (client timeout 2223 ms). Trace:
W20260709 12:17:53.609254 21109 rpcz_store.cc:269] 0709 12:17:50.698100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.738536 (+ 40436us) service_pool.cc:224] Handling call
0709 12:17:53.608591 (+2870055us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b5400253fd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:53.608725 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211781504}
I20260709 12:17:53.594751 24444 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:53.593771 24442 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:53.577833 24414 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:53.605099 24475 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:53.608035 24446 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.599017 24289 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:53.633580 24442 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:53.644799 24442 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:53.619757 24444 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:53.663998 24481 consensus_meta.cc:287] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.000s
I20260709 12:17:53.664480 24481 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:53.643719 24446 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:53.700415 24446 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:53.704586 24475 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:53.704584 24413 consensus_meta.cc:287] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.001s
I20260709 12:17:53.705812 24413 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:53.708006 24413 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:53.692728 24357 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:53.693625 24216 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:53.694645 24289 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:53.696444 24420 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:53.697808 24345 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:53.709086 24444 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:53.709873 24434 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:53.710765 24357 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:53.671732 24414 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:53.711503 24361 consensus_meta.cc:287] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.775s	user 0.003s	sys 0.006s
W20260709 12:17:53.684919 24418 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.943s	user 0.011s	sys 0.000s
I20260709 12:17:53.711745 24444 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:53.712255 24418 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:53.713876 24418 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:53.666558 24329 consensus_meta.cc:287] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.810s	user 0.006s	sys 0.000s
I20260709 12:17:53.714519 24430 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.714738 24361 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:53.715073 24430 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:53.716814 24361 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:53.675904 24400 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:53.666564 24481 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:53.717617 24470 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:53.570021 21028 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:53.761559 21027 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:53.761559 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 207250us
I20260709 12:17:53.763531 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:53.765154 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:53.761593 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2390) took 1045 ms. Trace:
I20260709 12:17:53.767282 21028 rpcz_store.cc:276] 0709 12:17:52.715924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.167052 (+451128us) service_pool.cc:224] Handling call
0709 12:17:53.761296 (+594244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:53.766800 21002 leader_election.cc:400] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
I20260709 12:17:53.771060 21002 leader_election.cc:403] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:17:53.772416 21002 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:53.775756 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:53.776901 21034 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
W20260709 12:17:53.800999 21102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.014s	sys 0.026s
I20260709 12:17:53.801494 21105 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:53.829671 21177 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:53.867906 21102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.014s	sys 0.026s
I20260709 12:17:53.875759 24481 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:53.876410 24481 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:53.876849 24481 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:53.879150 24361 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:53.894095 24372 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:53.894615 24372 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:53.895004 24372 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:53.899238 24455 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:53.899855 24455 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:53.900303 24455 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:53.901490 23740 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:53.879142 24484 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
W20260709 12:17:53.888726 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 113178us
I20260709 12:17:53.899277 24400 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:53.920094 24400 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:53.926913 24400 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:53.933571 21002 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:53.940505 23740 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:53.941656 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1777) took 1464 ms. Trace:
I20260709 12:17:53.942109 21102 rpcz_store.cc:276] 0709 12:17:52.476684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.637050 (+160366us) service_pool.cc:224] Handling call
0709 12:17:52.637307 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.637529 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:52.739609 (+102080us) log.cc:844] Serialized 14 byte log entry
0709 12:17:53.923453 (+1183844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:53.926801 (+  3348us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:53.930162 (+  3361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.934125 (+  3963us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.941513 (+  7388us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":261576,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":9037,"raft.run_cpu_time_us":511,"raft.run_wall_time_us":12845,"thread_start_us":1232831,"threads_started":2,"wal-append.queue_time_us":919094}
I20260709 12:17:53.950438 24484 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:53.951041 24484 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:53.951524 24484 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:53.965987 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:53.966871 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1560) took 1270 ms. Trace:
I20260709 12:17:53.967374 21035 rpcz_store.cc:276] 0709 12:17:52.695803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.704922 (+  9119us) service_pool.cc:224] Handling call
0709 12:17:53.966430 (+1261508us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54000c35d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:53.966618 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43659136}
W20260709 12:17:53.972434 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.973683 21075 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:53.973806 24455 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:53.975584 21104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1679) took 2248 ms (client timeout 1630 ms). Trace:
W20260709 12:17:53.976028 21104 rpcz_store.cc:269] 0709 12:17:51.726826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.126573 (+399747us) service_pool.cc:224] Handling call
0709 12:17:53.975125 (+1848552us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400180954. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:53.975342 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665920896}
I20260709 12:17:53.976326 24455 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:53.979080 21744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 700) took 2063 ms. Trace:
I20260709 12:17:53.979529 21744 rpcz_store.cc:276] 0709 12:17:51.915773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.916377 (+   604us) service_pool.cc:224] Handling call
0709 12:17:51.916746 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.057308 (+140562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.057341 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.057384 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:52.057416 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.978478 (+1921062us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54006b08d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:53.978568 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.978809 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322705280}
I20260709 12:17:53.983269 24361 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:53.983178 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:53.983954 24361 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:53.984460 24361 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:53.984565 21029 raft_consensus.cc:2376] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8. Re-sending same reply.
I20260709 12:17:53.979251 24199 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:53.984954 21075 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:53.983399 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:53.990061 24395 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:53.990936 24395 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:53.991469 24395 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:53.991873 24395 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.993492 24430 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:53.989349 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2399) took 1270 ms. Trace:
I20260709 12:17:53.995538 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:53.990903 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:53.998438 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:53.998888 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:54.003872 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:54.007421 24311 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:54.009353 24455 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:53.995251 21029 rpcz_store.cc:276] 0709 12:17:52.718009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.961653 (+1243644us) service_pool.cc:224] Handling call
0709 12:17:53.988163 (+ 26510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:54.013854 24199 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:54.014302 24199 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:17:54.012769 21105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1674) took 3045 ms (client timeout 1625 ms). Trace:
I20260709 12:17:54.023125 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:54.025501 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1554) took 1332 ms. Trace:
I20260709 12:17:54.025784 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:54.018231 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:54.026042 21027 rpcz_store.cc:276] 0709 12:17:52.693531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.693649 (+   118us) service_pool.cc:224] Handling call
0709 12:17:54.024362 (+1330713us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000c53d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:54.025422 (+  1060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451023616}
W20260709 12:17:54.019529 21105 rpcz_store.cc:269] 0709 12:17:50.965597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.110319 (+144722us) service_pool.cc:224] Handling call
0709 12:17:54.010700 (+2900381us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b540016eed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:54.010974 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6109468032}
W20260709 12:17:54.032368 21180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2231) took 3465 ms (client timeout 2448 ms). Trace:
W20260709 12:17:54.032899 21180 rpcz_store.cc:269] 0709 12:17:50.566489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.087948 (+521459us) service_pool.cc:224] Handling call
0709 12:17:54.031852 (+2943904us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400386b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:54.032056 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3524491648}
I20260709 12:17:54.034556 24329 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.035353 24329 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.036342 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:17:54.036558 21077 connection.cc:256] RPC call timeout handler was delayed by -1.7934146820000478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
I20260709 12:17:54.037237 21737 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:54.037712 24329 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:54.038295 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:54.039177 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.039391 21738 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:17:54.039881 21000 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:54.027529 20930 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 5, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 5 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.029068 21035 raft_consensus.cc:1240] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:54.041074 21076 leader_election.cc:336] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.500s (SENT)
W20260709 12:17:54.041857 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.032398 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:54.029835 21034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1552) took 1336 ms (client timeout 1656 ms). Trace:
I20260709 12:17:54.030773 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2364) took 4097 ms. Trace:
I20260709 12:17:54.040027 21031 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
W20260709 12:17:54.027894 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 352226us
I20260709 12:17:54.043087 21027 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:54.043206 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.049301 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2393) took 1327 ms. Trace:
W20260709 12:17:54.048746 21077 connection.cc:256] RPC call timeout handler was delayed by -1.729661970000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2664s for a response
W20260709 12:17:54.035866 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 516899us
I20260709 12:17:54.049655 21031 rpcz_store.cc:276] 0709 12:17:52.716591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.038670 (+1322079us) service_pool.cc:224] Handling call
0709 12:17:54.044184 (+  5514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:54.014679 24199 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:54.062060 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.044088 21030 rpcz_store.cc:276] 0709 12:17:49.933510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.597546 (+1664036us) service_pool.cc:224] Handling call
0709 12:17:51.597870 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.160314 (+562444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.160342 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.160383 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:52.160413 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.030311 (+1869898us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b540004b854. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:54.030375 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.030575 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292875008}
I20260709 12:17:54.064456 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.060446 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.066164 21031 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:54.043751 21034 rpcz_store.cc:269] 0709 12:17:52.692964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.723090 (+ 30126us) service_pool.cc:224] Handling call
0709 12:17:54.029632 (+1306542us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540042e0d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:54.029774 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361914752}
I20260709 12:17:54.069365 24372 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.021063 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.062619 24400 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.071656 21033 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:54.072088 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1568) took 1374 ms. Trace:
I20260709 12:17:54.072402 21033 rpcz_store.cc:276] 0709 12:17:52.697791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.711850 (+ 14059us) service_pool.cc:224] Handling call
0709 12:17:54.020661 (+1308811us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800003698. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:17:54.072025 (+ 51364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24758016}
I20260709 12:17:54.073025 24400 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.075242 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:54.076390 24311 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:54.077457 24348 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.078269 24507 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.073792 24400 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:54.079063 24507 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.079581 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:54.081404 24400 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:54.081521 24507 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:54.082062 21738 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:17:54.078293 24348 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.082753 24400 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:54.083956 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:54.084542 21077 connection.cc:256] RPC call timeout handler was delayed by -1.6432619700001396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27599999999999997s for a response
I20260709 12:17:54.084620 24348 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:17:54.084890 21077 connection.cc:256] RPC call timeout handler was delayed by -1.5963146819999565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260709 12:17:54.077193 24311 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:54.085248 21077 connection.cc:256] RPC call timeout handler was delayed by -1.5567146820001199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 12:17:54.085572 21077 connection.cc:256] RPC call timeout handler was delayed by -1.5117146820000471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 12:17:54.090317 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:54.098085 21077 connection.cc:256] RPC call timeout handler was delayed by -1.4622146819999671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 12:17:54.091295 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.099509 24372 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.092078 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.093644 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.101053 21110 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.102231 24329 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:54.102483 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.094548 21111 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:54.103613 24200 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:54.090758 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.104128 24200 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:54.104655 21104 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.105217 24200 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:54.098466 21077 connection.cc:256] RPC call timeout handler was delayed by -1.3557006959999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:17:54.109273 21077 connection.cc:256] RPC call timeout handler was delayed by -1.2624146820000988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24480000000000002s for a response
W20260709 12:17:54.109609 21077 connection.cc:256] RPC call timeout handler was delayed by -1.0554146819999914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2678s for a response
I20260709 12:17:54.110074 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:54.118057 24455 raft_consensus.cc:697] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:54.116817 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1778) took 1545 ms. Trace:
I20260709 12:17:54.119606 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:54.124423 24455 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.096066 21151 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:54.087239 24311 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:54.093163 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.106719 24329 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:54.127921 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:54.129526 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:54.130251 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:54.130828 21106 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:54.110620 20930 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.129796 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.128645 24329 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.138389 20930 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 3 to 6, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New cstate: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:54.128623 24430 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:17:54.140007 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 100308us
I20260709 12:17:54.120405 21107 rpcz_store.cc:276] 0709 12:17:52.476955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.637182 (+160227us) service_pool.cc:224] Handling call
0709 12:17:52.637458 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.637647 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:53.504867 (+867220us) log.cc:844] Serialized 14 byte log entry
0709 12:17:54.022212 (+517345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:54.022327 (+   115us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:54.022441 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.022558 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.022730 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22991,"prepare.queue_time_us":350799,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3104,"raft.queue_time_us":33034,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":158,"spinlock_wait_cycles":24960,"thread_start_us":1317913,"threads_started":2,"wal-append.queue_time_us":441402}
I20260709 12:17:54.120261 24481 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.149384 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.149169 20930 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 9, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 9 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.153324 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:54.153653 20930 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 5 to 8, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 8 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.154806 24395 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.156996 24395 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.143384 24311 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:54.159561 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 134846us
I20260709 12:17:54.160240 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.160672 21075 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:54.165524 24361 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.167054 24430 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.169418 24430 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:54.169937 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.170599 21103 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.162619 21075 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:54.180908 21109 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:54.180975 24434 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:54.181113 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 157980us
I20260709 12:17:54.186117 24361 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.185253 20930 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 5 to 6, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.189630 21110 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:54.189797 21106 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:54.191936 24420 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.193147 24371 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:17:54.193195 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:54.195130 24367 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.195739 24367 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.198503 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:54.194765 24072 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:54.200476 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.201275 21103 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:54.195650 24420 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:54.205811 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.185303 24357 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:54.206945 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2396) took 1485 ms. Trace:
I20260709 12:17:54.208185 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:54.217348 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 121415us
I20260709 12:17:54.187880 24395 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.203497 24072 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:54.215197 21109 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.222215 21032 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:54.191814 24353 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:17:54.204986 24420 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:54.213418 24357 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:54.213572 21028 rpcz_store.cc:276] 0709 12:17:52.717312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.768924 (+1051612us) service_pool.cc:224] Handling call
0709 12:17:53.769725 (+   801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:53.770269 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:53.936497 (+166228us) log.cc:844] Serialized 14 byte log entry
0709 12:17:54.202145 (+265648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:54.202204 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:54.202294 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.202379 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.202504 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9195,"prepare.queue_time_us":180600,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":36435,"raft.run_cpu_time_us":3270,"raft.run_wall_time_us":54006,"spinlock_wait_cycles":28883840,"thread_start_us":343499,"threads_started":3,"wal-append.queue_time_us":160285}
I20260709 12:17:54.233553 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.194416 24371 consensus_queue.cc:1059] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:17:54.235437 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2397) took 1517 ms. Trace:
I20260709 12:17:54.209194 24372 consensus_queue.cc:1059] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:17:54.236349 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:54.234952 21107 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:17:54.217566 24513 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:54.237546 21032 rpcz_store.cc:276] 0709 12:17:52.717531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.958338 (+1240807us) service_pool.cc:224] Handling call
0709 12:17:53.958763 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.226704 (+267941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.231489 (+  4785us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540004b354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:54.235361 (+  3872us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528044288}
I20260709 12:17:54.205080 24199 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.246873 21151 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:54.235883 20930 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 5 to 7, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 7 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.234017 24420 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:54.253960 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 46327us
I20260709 12:17:54.255733 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.256096 24367 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.256662 21102 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:54.257055 24199 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:54.240900 24357 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.258626 21177 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:54.263192 21183 raft_consensus.cc:1240] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:54.267441 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 43913.8us
I20260709 12:17:54.267693 24395 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:54.267716 24522 raft_consensus.cc:3055] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:54.250803 24430 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.251142 24353 raft_consensus.cc:3055] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:54.286477 24353 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:54.277596 21110 raft_consensus.cc:2368] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:54.277395 24311 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:54.285702 24348 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.283643 21184 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:54.283110 24522 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:54.285957 24430 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:54.278185 24514 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:17:54.276821 21109 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:54.294165 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.297027 21103 raft_consensus.cc:2368] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
I20260709 12:17:54.298483 24311 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:54.299046 24311 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:54.292851 20930 catalog_manager.cc:5697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 5 to 8, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 8 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.295513 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:54.307559 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 81514.5us
I20260709 12:17:54.290771 24395 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:54.294765 24430 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.321990 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:54.324118 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 98398.4us
I20260709 12:17:54.300084 24311 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.333407 21077 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.330132 21180 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
W20260709 12:17:54.335635 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 98583.8us
I20260709 12:17:54.338016 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.343452 24395 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.328991 24481 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.357115 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.317942 24522 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.365491 21103 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
W20260709 12:17:54.357360 20931 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49666 (request call id 198) took 22728 ms (client timeout 15000 ms). Trace:
I20260709 12:17:54.326344 24329 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.374145 21151 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:54.376210 21150 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:54.378031 21031 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:54.381425 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.382289 21109 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:54.322168 24072 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.379797 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2394) took 1573 ms. Trace:
I20260709 12:17:54.337327 24353 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.382688 24242 raft_consensus.cc:3055] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:54.401479 24311 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.405575 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:54.428925 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 112291us
I20260709 12:17:54.431063 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.431020 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.432428 21110 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:54.421756 24522 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.398806 21036 rpcz_store.cc:276] 0709 12:17:52.716870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.585977 (+869107us) service_pool.cc:224] Handling call
0709 12:17:53.586225 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:53.586429 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:53.937803 (+351374us) log.cc:844] Serialized 14 byte log entry
0709 12:17:54.235623 (+297820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:54.243229 (+  7606us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:54.284884 (+ 41655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.288286 (+  3402us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.290000 (+  1714us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1910,"prepare.queue_time_us":359990,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":90,"raft.queue_time_us":21384,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":38029,"thread_start_us":335705,"threads_started":3,"wal-append.queue_time_us":107706}
I20260709 12:17:54.415303 24242 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:17:54.434798 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 78063us
I20260709 12:17:54.428026 20930 catalog_manager.cc:5697] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 9, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 9 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:17:54.440071 24470 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.440572 24455 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.441139 24455 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.441892 24442 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.442206 21711 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:54.441385 24520 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:54.427361 24348 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:54.440503 24470 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.449949 24470 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.442688 24507 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.450052 24508 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:54.454906 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 111832us
I20260709 12:17:54.456204 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.458312 21151 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:54.453542 24216 consensus_queue.cc:1059] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:17:54.444650 24520 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:54.462378 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 90814.4us
I20260709 12:17:54.471632 21104 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
W20260709 12:17:54.472949 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 55903.2us
I20260709 12:17:54.476358 21150 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:54.454248 24442 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:54.493232 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.495479 21077 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.496029 24372 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.496655 24372 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.497699 24200 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:54.498183 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.498631 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.498878 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:54.498383 24199 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:54.447144 24219 consensus_queue.cc:1059] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:17:54.455142 24508 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:54.500831 21027 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:54.460304 20930 catalog_manager.cc:5697] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.495134 24242 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:54.366823 20931 rpcz_store.cc:269] 0709 12:17:31.508755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.509032 (+   277us) service_pool.cc:224] Handling call
0709 12:17:32.231082 (+722050us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b5400002490. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c8700b2 00007fcba57e9759 00007fcba5781a76 00007fcba5752d58 00007fcba585104e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc
0709 12:17:54.232112 (+22001030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:47.930151 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:47.984372 (+ 54221us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:47.984410 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:17:47.984426 (+    16us) tablet.cc:662] Decoding operations
0709 12:17:47.985502 (+  1076us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:47.985559 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:47.985587 (+    28us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:17:47.986503 (+   916us) tablet.cc:701] Row locks acquired
0709 12:17:47.986522 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:17:47.986682 (+   160us) write_op.cc:270] Start()
0709 12:17:47.986798 (+   116us) write_op.cc:276] Timestamp: P: 1783599467986631 usec, L: 0
0709 12:17:47.986816 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:17:48.032723 (+ 45907us) log.cc:844] Serialized 4760 byte log entry
0709 12:17:48.150659 (+117936us) op_driver.cc:464] REPLICATION: finished
0709 12:17:48.365032 (+214373us) write_op.cc:301] APPLY: starting
0709 12:17:48.381960 (+ 16928us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:48.570520 (+188560us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:48.614552 (+ 44032us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:48.728137 (+113585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:48.728411 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:17:48.728459 (+    48us) write_op.cc:312] APPLY: finished
0709 12:17:48.755675 (+ 27216us) log.cc:844] Serialized 89 byte log entry
0709 12:17:48.799634 (+ 43959us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.799785 (+   151us) write_op.cc:454] Released schema lock
0709 12:17:48.799832 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:48.824771 (+ 24939us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.840976 (+ 16205us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":51700,"reported_tablets":47,"spinlock_wait_cycles":3923840,"child_traces":[["op",{"apply.queue_time_us":164528,"apply.run_cpu_time_us":4766,"apply.run_wall_time_us":454842,"num_ops":12,"prepare.queue_time_us":172059,"prepare.run_cpu_time_us":14677,"prepare.run_wall_time_us":158458,"raft.queue_time_us":84401,"raft.run_cpu_time_us":16167,"raft.run_wall_time_us":45756,"replication_time_us":163645,"thread_start_us":214364,"threads_started":4,"wal-append.queue_time_us":30980,"wal-append.run_cpu_time_us":5745,"wal-append.run_wall_time_us":1819820}]]}
W20260709 12:17:54.483222 24517 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 12:17:54.587203 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 90477.6us
I20260709 12:17:54.587708 24508 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:54.518586 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.588784 21033 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:54.589946 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.589752 20930 catalog_manager.cc:5697] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.592056 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:54.592754 21027 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:54.499969 21028 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:54.521394 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 69724.8us
I20260709 12:17:54.480808 24455 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.499253 21036 raft_consensus.cc:2376] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9. Re-sending same reply.
I20260709 12:17:54.522889 24072 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.505003 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.603833 21031 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:54.591295 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:54.505034 24484 consensus_meta.cc:287] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.002s
W20260709 12:17:54.596766 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 137305us
I20260709 12:17:54.516436 24348 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:54.605113 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.606413 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:54.608851 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.604120 21030 raft_consensus.cc:2376] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10. Re-sending same reply.
I20260709 12:17:54.612273 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:54.609822 24242 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:54.477638 24507 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.488451 24329 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:54.498212 24200 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:54.595856 24353 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.618996 24429 raft_consensus.cc:2764] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:17:54.607165 24484 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.619572 24206 raft_consensus.cc:3055] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:54.617110 24528 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:54.645793 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:54.624012 24524 log.cc:927] Time spent T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:17:54.632472 24507 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:54.633049 24529 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 12:17:54.635427 24526 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:17:54.639339 24395 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:54.638368 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 132655us
I20260709 12:17:54.642336 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.645484 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:54.642926 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.644686 24206 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:54.648515 21035 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:54.640627 24361 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:54.662742 24361 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.649379 21032 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.648052 24528 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.635600 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:54.668690 24528 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.669013 21036 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:54.671084 24395 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.673146 24395 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.673336 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:54.653856 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 177565us
I20260709 12:17:54.656289 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.656870 21034 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:54.511386 24520 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:54.636437 24442 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.679037 24534 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.669363 21077 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:54.680395 24442 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:54.680831 24470 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.681188 21077 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.683702 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:54.680914 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.658864 21029 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:54.646564 24367 consensus_queue.cc:1059] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:17:54.661533 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:54.662156 24529 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:54.665582 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.692463 24529 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:54.692512 21035 raft_consensus.cc:2376] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9. Re-sending same reply.
I20260709 12:17:54.693550 24529 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.694648 24529 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.666153 21028 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:54.661475 24523 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:17:54.696991 24430 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.698732 21106 raft_consensus.cc:2368] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:54.699142 24206 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.700472 24206 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:54.678679 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.688377 21104 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:54.689024 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:54.689242 24534 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:54.702662 24534 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:54.703111 24534 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.689848 24470 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:54.690132 21103 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:17:54.689072 24507 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:54.706979 24507 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.709022 24507 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:54.690629 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.709861 21108 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:17:54.690754 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 44407.5us
I20260709 12:17:54.690833 24348 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:54.690428 21033 raft_consensus.cc:2376] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10. Re-sending same reply.
I20260709 12:17:54.691207 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.691776 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.691921 21034 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:17:54.689334 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.664918 24372 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.719930 24348 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:54.722874 24348 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.724910 21107 raft_consensus.cc:2368] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:54.726989 24530 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:54.731282 21029 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:54.718987 24361 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.746502 24484 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:54.747725 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.748056 24420 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.718235 24199 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:54.752337 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:54.753535 24430 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.756636 21027 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:54.760706 21032 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:54.754137 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.766992 24200 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.767920 24534 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:54.768990 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:54.769500 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.770061 24534 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:54.770596 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:54.772310 24367 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:54.774569 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.775220 21107 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
W20260709 12:17:54.782482 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.785164 24470 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:54.787390 24216 raft_consensus.cc:3055] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:54.787833 24216 raft_consensus.cc:740] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:54.788784 24216 consensus_queue.cc:260] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.790232 24216 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:54.791167 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:54.792217 24329 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:54.792793 24329 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:54.793780 24329 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.795239 24199 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:54.796238 24199 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.801276 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:17:54.804400 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 188056us
I20260709 12:17:54.809490 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.810137 21107 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
W20260709 12:17:54.811254 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 98545us
I20260709 12:17:54.811966 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:54.817214 21031 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:54.813079 21149 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.805423 24534 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:54.827741 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:54.829005 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 197138us
I20260709 12:17:54.820705 24348 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:54.827206 21149 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:54.831391 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.832494 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:54.822659 24470 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:54.839413 24420 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:54.839192 24527 consensus_queue.cc:1059] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:17:54.841682 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.842283 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:54.843974 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 62024.2us
I20260709 12:17:54.824193 24530 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:54.821657 24206 consensus_queue.cc:1059] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:17:54.852532 24507 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:54.852635 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.852331 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.853590 21741 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:54.852900 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:54.868806 21076 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:54.843112 24470 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.874629 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.849642 24200 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:17:54.874429 24348 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:54.877617 24200 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:54.877837 24348 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.878612 24206 raft_consensus.cc:3055] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:54.879012 24206 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:54.879913 24206 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.888907 21108 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:54.870390 24530 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:54.875069 24470 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.841701 24508 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.881832 24200 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:17:54.902503 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 70113.2us
I20260709 12:17:54.904340 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:54.850180 24528 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.908337 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:54.884262 24199 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:54.910027 21738 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:17:54.911125 24357 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.607s	user 0.000s	sys 0.011s
I20260709 12:17:54.911944 24530 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.929436 24357 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.930033 24484 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:17:54.912726 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.913082 21077 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:54.918983 24206 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:54.908798 24508 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.924932 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:54.932101 21180 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.924031 24527 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:54.927122 24442 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:54.926981 24200 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:54.929051 21184 raft_consensus.cc:2368] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:54.939778 21106 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:54.941720 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.942919 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:54.943502 21111 raft_consensus.cc:1813] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Handling vote request from an unknown peer 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:54.945761 21111 raft_consensus.cc:2393] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:54.936971 24199 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:54.938282 24442 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:54.949821 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:54.953084 24442 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:54.954495 24442 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:54.955152 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 69352.9us
I20260709 12:17:54.956055 24357 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:54.940595 24420 raft_consensus.cc:2764] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:17:54.922731 24470 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.006568 21151 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.008368 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.012528 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:54.952128 24199 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.948621 24527 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:55.015566 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 193204us
I20260709 12:17:55.016467 21108 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:55.019714 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:55.017473 21107 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:54.952330 24534 raft_consensus.cc:697] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:55.024065 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:55.025959 24543 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:17:55.029745 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:55.030977 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 61710.3us
I20260709 12:17:55.031711 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:55.032372 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.032505 21184 raft_consensus.cc:2393] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 3: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:55.033915 21031 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:55.034507 24539 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:17:55.035163 21027 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:55.037081 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 90093.5us
I20260709 12:17:55.037438 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:55.037979 21186 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:55.038137 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:55.038441 24311 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:55.023370 21183 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.023341 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:55.019418 24507 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:55.018114 24200 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.066203 24527 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.075331 21180 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:55.083695 21183 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
W20260709 12:17:55.087862 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.089517 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:55.090479 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:55.091809 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:55.092602 21737 raft_consensus.cc:2393] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:17:55.093676 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:55.094333 21740 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:55.096030 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:55.096596 21180 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.096884 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:55.097481 21182 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.099902 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:55.100414 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:55.100579 21179 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:55.101454 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:55.102005 21179 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:55.103510 21180 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:55.104354 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:55.104895 21180 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:55.102777 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:55.107386 21179 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:55.109674 21182 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
W20260709 12:17:55.111049 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 88102.2us
I20260709 12:17:55.099946 21178 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:55.068214 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:55.117640 21032 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:55.125761 21186 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:55.113382 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:55.128115 21184 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:55.129261 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:55.129649 21177 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:55.130403 21002 leader_election.cc:400] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:55.130723 21002 leader_election.cc:403] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:55.130771 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:55.133074 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 264310us
I20260709 12:17:55.138967 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.139593 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:55.064193 24528 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.140125 21108 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.143218 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.138978 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.146031 21744 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 11. Ops: []
I20260709 12:17:55.115415 24507 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:55.070298 24534 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.175604 21032 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:55.175607 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:55.177440 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:55.178206 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 163376us
I20260709 12:17:55.180498 21183 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:55.181120 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 60194.5us
I20260709 12:17:55.191061 24311 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:55.191563 24311 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:55.193831 24311 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.152397 24484 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:55.200767 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 53017.3us
W20260709 12:17:55.193862 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 155793us
I20260709 12:17:55.173799 24507 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.204735 21185 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:55.199327 24206 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:17:55.215173 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.199682 24361 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:55.219949 21181 raft_consensus.cc:1813] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Handling vote request from an unknown peer 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:55.220696 21181 raft_consensus.cc:2410] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:17:55.221201 21183 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:55.222483 24206 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:55.222864 24206 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:17:55.225003 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.220237 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:55.232539 21151 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:55.228157 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 58228.9us
I20260709 12:17:55.237094 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:55.243474 21002 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:55.208359 24484 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:55.283759 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.281399 24481 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:55.263787 24361 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:17:55.298861 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 72076.1us
I20260709 12:17:55.299085 24548 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.127s
W20260709 12:17:55.303556 24550 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:55.297603 24481 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.219516 24372 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:55.305042 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 61667.9us
W20260709 12:17:55.305581 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.310266 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:55.263852 24311 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.300700 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.288371 24470 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:55.243034 24556 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:17:55.297188 24518 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
I20260709 12:17:55.315884 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:55.326180 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 62004.8us
I20260709 12:17:55.305330 24348 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.313269 24481 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.306216 24545 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:55.293423 24206 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.334128 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:55.334755 21181 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:55.323153 24549 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:17:55.333523 24559 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:55.338881 24311 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:55.330855 24508 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:55.325412 24372 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:55.361789 21711 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:55.417012 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55304.1us
I20260709 12:17:55.417203 21740 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:55.419387 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 109219us
I20260709 12:17:55.422168 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:55.423233 21002 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:55.359465 24372 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.351366 24518 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:55.424870 21002 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:55.347886 24557 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:55.348070 24538 consensus_queue.cc:1059] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:17:55.348232 24348 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.421888 24508 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:55.424540 24072 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:55.444211 21108 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:55.445262 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:55.445927 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:55.424458 24361 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:55.429205 24372 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:55.439380 24470 consensus_queue.cc:1059] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:17:55.453379 21744 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:17:55.358125 24559 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:55.455307 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 154685us
I20260709 12:17:55.437968 24560 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:55.448487 24199 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.450170 24563 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:55.454934 24072 raft_consensus.cc:697] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:55.461279 24560 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.477855 21184 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:17:55.483270 21110 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.483633 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.486433 24518 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:55.468327 24563 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:55.468076 24470 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:17:55.471894 24565 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:55.492244 24348 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:55.492556 24561 raft_consensus.cc:3055] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:55.483152 24560 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:55.492009 24554 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:17:55.503054 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 85277.7us
I20260709 12:17:55.494896 24546 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:55.495347 24484 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.493978 24563 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.519140 21181 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:17:55.516541 24546 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:55.524082 21076 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:55.535447 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:55.536777 24546 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:55.538148 21076 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:55.539135 24569 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:55.539733 24569 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:55.540172 24569 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.542057 24566 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:55.539091 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 70749us
I20260709 12:17:55.542750 24566 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.549635 24566 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.549985 24199 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.533905 24072 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.551187 24538 consensus_queue.cc:1059] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:55.551792 24529 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:55.552328 24529 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:55.510264 24561 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:55.559160 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 134345us
I20260709 12:17:55.559955 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:55.561962 21002 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.558540 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:55.499893 24508 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.558660 24199 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:17:55.492296 24361 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.585507 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:55.591370 24200 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:55.591544 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:55.553205 24529 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.556905 24530 consensus_queue.cc:1059] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:17:55.604628 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:55.606056 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:55.611160 24559 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.611241 24571 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.612167 24571 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.614383 24571 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:55.615404 24530 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:55.615803 24530 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:55.616595 24530 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.595153 24216 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:55.617944 24530 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.617660 24216 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.640390 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:55.641124 21076 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:55.643466 24575 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:17:55.643482 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:55.642228 24559 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:55.645087 24572 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:55.648604 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:55.649868 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:55.650506 21741 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:55.606385 24200 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:55.673028 21737 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:55.664904 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:55.655620 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 49693.9us
I20260709 12:17:55.676944 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:55.671717 21741 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:55.677798 21744 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
W20260709 12:17:55.685132 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 85094.4us
I20260709 12:17:55.684811 21000 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:55.685726 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:55.655992 24558 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:55.587278 24518 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.664021 24571 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:55.706027 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.676826 24565 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:17:55.707701 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.687371 24538 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.687235 24200 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:55.693643 24558 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.715821 24216 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.718379 24206 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.659073 24566 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.721386 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:55.742268 21181 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:17:55.654819 24507 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.698938 24576 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:55.724959 24563 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.729599 21737 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:55.693208 24561 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.746865 24561 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:55.748828 24507 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:55.750556 21184 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.734069 24569 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.736662 20999 leader_election.cc:400] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6.
W20260709 12:17:55.720315 24574 log.cc:927] Time spent T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:17:55.705518 24575 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:55.724421 24565 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.723623 24570 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:55.705365 24199 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:55.743835 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 181940us
W20260709 12:17:55.751152 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 53072us
I20260709 12:17:55.741027 24558 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.710614 24571 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.733315 24538 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.758563 20999 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:55.757474 24575 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.768016 24575 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.768483 24580 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:55.768575 24538 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:55.768967 24580 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:55.769366 24580 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.770045 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:55.769972 24200 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.771538 21151 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:55.773093 24442 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:55.768148 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:55.757871 21075 connection.cc:256] RPC call timeout handler was delayed by -2.1508931810001286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:17:55.761022 21002 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.765332 24570 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:55.765818 24199 raft_consensus.cc:697] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:55.766729 24563 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.776472 21738 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:55.774296 24442 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.777997 24442 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.778223 24570 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.764415 24576 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:17:55.779500 24434 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:55.779942 24434 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:55.780745 24434 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.781107 24199 consensus_queue.cc:237] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.781939 24434 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.771449 24571 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.792991 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:55.793684 21183 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:55.798445 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.799060 21185 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:17:55.803726 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:55.804215 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:55.806372 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.783437 24507 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:55.807250 21109 raft_consensus.cc:2393] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:55.804473 21177 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:55.811331 24563 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:55.811578 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 43523.6us
I20260709 12:17:55.797027 24571 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:17:55.812268 24571 consensus_queue.cc:1243] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:55.812733 24571 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:55.813035 24571 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:55.813804 24571 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.794674 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:55.815266 21178 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.815526 21111 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:55.815668 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.816550 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:55.816884 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:55.817443 21105 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.820107 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:55.814105 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:55.821506 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.814625 21102 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.824717 20999 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.829044 21103 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:55.827984 24372 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.831379 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:55.831951 21111 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:55.832268 24372 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.830487 24529 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.833140 24529 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.834389 21178 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:55.835366 24529 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.835561 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:55.837427 21181 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:55.805691 24576 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:55.797225 24578 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:55.844146 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:55.848188 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.814607 24567 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.848101 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.792611 24560 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.820995 24566 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.851248 21075 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.852026 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.867570 21103 raft_consensus.cc:2393] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 5: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:55.852831 21105 raft_consensus.cc:2410] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:17:55.850315 24582 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:55.855794 24481 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.856858 24546 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.843024 24576 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:55.860988 24567 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.843564 24372 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:55.814581 24558 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.882973 21109 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.828439 24563 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.854470 24571 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:55.877622 24582 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:55.902932 24582 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.904100 24563 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.885502 24538 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:55.882879 24576 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.907608 24329 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:55.908102 24329 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:55.908998 24329 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.910063 24329 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.890059 21075 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:55.892748 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.912461 21740 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:55.913062 21107 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:55.915690 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:55.916992 21075 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.917845 21075 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.918576 24429 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:55.888626 24481 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.919277 24429 raft_consensus.cc:2764] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:55.919931 24429 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:55.920552 24429 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:55.921926 21075 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:55.922778 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:55.895545 24569 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.898026 24546 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:55.901966 24442 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.931515 21075 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:55.932214 21111 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:17:55.933334 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:55.932164 24538 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:55.947423 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:55.947660 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:55.949815 24538 raft_consensus.cc:697] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:55.948431 24545 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:55.951872 24545 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:55.952622 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:55.949532 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:55.952826 24545 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.941761 24372 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.955458 24372 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:55.956837 21107 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:17:55.957495 24372 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.959022 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.959645 21109 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:55.950917 24538 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.966739 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.925302 24560 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:55.967347 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.925453 24429 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:56.014622 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:55.983774 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:55.944164 24566 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:56.044535 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 55280.1us
I20260709 12:17:56.156291 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:56.025486 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:56.697770 21029 raft_consensus.cc:2393] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:56.375705 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:56.160651 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:56.308007 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:56.050829 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.698294 21030 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:56.681164 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:56.698290 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:56.113873 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:56.625326 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:56.700204 21027 raft_consensus.cc:2410] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:56.125113 21032 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:56.690119 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:56.687788 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:56.245047 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:56.701666 21106 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:56.147981 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:56.516243 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:56.698967 21105 raft_consensus.cc:2376] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8. Re-sending same reply.
I20260709 12:17:56.044888 21111 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:56.703557 21031 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
W20260709 12:17:56.695202 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.699589 21028 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
W20260709 12:17:56.253587 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.164450 21036 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:17:56.707537 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:56.244202 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:56.708128 21028 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:56.709425 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:56.710112 21178 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:56.622128 21709 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.989s (SENT) [suppressed 69 similar messages]
I20260709 12:17:56.711061 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:56.711654 21033 raft_consensus.cc:2410] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:17:56.712239 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.712831 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.713212 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.714216 21034 raft_consensus.cc:2393] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 3: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:56.710592 21149 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:56.719413 21180 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:17:56.720443 20999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.015s	sys 0.013s
W20260709 12:17:56.721413 21740 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.008s	sys 0.019s
W20260709 12:17:56.721771 21740 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.019s
I20260709 12:17:56.713660 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:56.714864 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:56.721303 21150 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:56.722820 21034 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
W20260709 12:17:56.720844 20999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.015s	sys 0.013s
W20260709 12:17:56.399169 24578 consensus_meta.cc:287] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.002s
I20260709 12:17:56.728659 21712 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:56.389451 24589 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
W20260709 12:17:56.489364 24575 consensus_meta.cc:287] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.721s	user 0.005s	sys 0.005s
W20260709 12:17:56.324417 24590 log.cc:927] Time spent T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
W20260709 12:17:56.405086 24582 consensus_meta.cc:287] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.002s
I20260709 12:17:56.462954 24558 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:56.049114 24556 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.507928 24442 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:56.736819 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:56.751209 21183 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:56.737941 21747 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:56.710539 24311 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.049052 24508 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.099251 24507 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:56.739362 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:56.743111 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:56.763293 21031 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:17:56.131489 24518 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.744261 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:56.764421 21181 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:56.737357 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:56.735572 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:56.744592 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:56.745946 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:56.733443 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:56.072671 24546 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.675s
I20260709 12:17:56.766650 21034 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:17:56.766535 21151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.008s	sys 0.008s
W20260709 12:17:56.767867 21151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.008s	sys 0.008s
I20260709 12:17:56.767462 21180 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:56.753793 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.746534 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:56.745849 24595 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.471s	user 0.003s	sys 0.000s
I20260709 12:17:56.710804 24557 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.380785 24565 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:56.553295 24567 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:56.781857 21186 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:56.738372 24578 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:56.711629 24216 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.736128 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:56.730100 24206 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.066725 21107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:56.794179 21107 raft_consensus.cc:606] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:56.794585 21107 raft_consensus.cc:614] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:56.747494 24575 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:56.814244 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 989512us
I20260709 12:17:56.778806 24442 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:56.072865 24580 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:56.772653 21178 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:56.744859 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:56.775090 21033 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:56.224603 24576 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:55.983031 24534 consensus_queue.cc:1059] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.767s
W20260709 12:17:56.779050 21077 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.003s	sys 0.025s
I20260709 12:17:56.749593 21035 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:56.785020 21180 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:17:56.829490 21077 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.004s	sys 0.025s
I20260709 12:17:56.750262 24199 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:56.829815 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 757570us
I20260709 12:17:56.765302 21036 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.784626 24546 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:56.787117 24558 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:56.761554 24556 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:56.822372 21179 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:56.825348 21186 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:56.800335 24072 raft_consensus.cc:2764] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:56.828038 21183 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:56.829751 21184 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:56.832332 21077 leader_election.cc:336] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.000s (SENT)
I20260709 12:17:56.832973 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:56.845389 21180 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:56.846216 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:56.847318 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:56.848506 21180 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 11. Ops: []
I20260709 12:17:56.833272 24575 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:56.849222 24442 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:56.850109 21077 leader_election.cc:336] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.010s (SENT)
I20260709 12:17:56.840732 24558 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.851207 24558 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:56.851435 24442 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:56.778352 24518 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:56.839537 21181 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:17:56.841791 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:56.852705 24576 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:56.853283 24534 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.775612 24582 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:56.853767 24534 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:56.787312 24508 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:56.822636 24567 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:17:56.855777 24582 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:56.823143 24578 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:17:56.856482 24508 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:56.796907 24311 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:56.858350 24556 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:56.796804 24216 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:56.860777 24216 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:56.811213 24507 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:56.863865 24534 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:56.865314 24507 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:56.866365 21030 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:56.797278 24206 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:56.862641 21034 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
W20260709 12:17:56.840682 21737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.010s	sys 0.014s
I20260709 12:17:56.867354 24580 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:56.867969 21737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.011s	sys 0.014s
I20260709 12:17:56.868574 24206 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:56.871588 21744 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:17:56.840324 24199 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:56.882195 24199 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:56.882750 24199 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.872695 24546 raft_consensus.cc:3055] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:56.883234 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:56.873358 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 55495.3us
I20260709 12:17:56.884044 21185 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:56.884501 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:56.874047 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:56.885372 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:56.875715 24569 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.883605 24546 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:56.851917 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.885946 21181 raft_consensus.cc:2376] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9. Re-sending same reply.
I20260709 12:17:56.886528 21179 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:56.891494 21177 raft_consensus.cc:2410] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:56.853526 24518 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:56.785434 24557 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:56.787392 24565 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:56.898965 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:56.905809 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:56.858389 24311 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:56.892278 24507 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.900828 24578 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:56.883198 24199 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:56.920545 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:56.922049 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 299947us
I20260709 12:17:56.932909 21178 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:17:56.899469 24569 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:56.954680 21741 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.011s	sys 0.015s
W20260709 12:17:56.955982 21741 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.016s
I20260709 12:17:56.922937 24518 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:56.964818 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:56.969137 21028 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:17:56.965863 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:56.971814 21184 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:17:56.981330 21077 leader_election.cc:336] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.500s (SENT)
I20260709 12:17:56.981820 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:17:56.982956 21077 leader_election.cc:336] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.517s (SENT)
I20260709 12:17:56.983325 21077 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:56.984534 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:56.984933 24429 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.985216 21737 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:56.984611 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:56.985960 21740 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:56.987084 24429 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.992507 21737 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:56.994374 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:56.994659 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:56.995153 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:56.996400 21000 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:56.997174 24361 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:56.997530 24361 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.998076 24361 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:56.997519 21000 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:57.000037 24580 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:57.000510 24580 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:57.001335 24580 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:57.005319 21077 leader_election.cc:336] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.672s (SENT)
I20260709 12:17:57.005743 24361 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:57.008569 24361 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:57.009747 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:57.010694 21737 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:57.018270 21737 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:57.019591 21000 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:57.020570 24361 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:57.021082 24361 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:57.025219 24561 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.025791 24561 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.027897 24561 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:57.021957 24361 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:57.037617 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:57.041877 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 320634us
W20260709 12:17:57.043658 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 77888.2us
I20260709 12:17:56.921741 24507 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:57.044445 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:17:57.045787 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.048929 21709 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:57.054371 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:57.054996 21034 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:57.056999 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:57.057652 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:57.057826 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 358655us
I20260709 12:17:57.059206 21747 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:57.059747 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 331228us
I20260709 12:17:57.058292 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:57.062328 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:57.060966 21002 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:57.045639 24429 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.067668 21740 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:57.048530 24567 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:57.066699 21002 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:57.081415 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:57.081969 21033 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:57.082510 21186 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
W20260709 12:17:57.084398 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.084636 21184 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:57.056536 24518 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.085512 21186 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:17:57.086902 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.087657 21109 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:57.089222 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.059602 24576 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:57.091265 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.091550 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:57.041400 24566 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:57.094089 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.105875 21036 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:57.105321 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.104176 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.136919 21035 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:57.094712 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.140506 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:57.101428 21109 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:57.086915 24484 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:57.093521 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.103694 21032 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:57.104748 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.103470 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:57.105875 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.102798 21027 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:17:57.094746 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:57.106451 21181 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:57.076510 24591 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:57.080313 24206 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:17:57.065994 24529 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:57.108636 24597 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.414s	user 0.007s	sys 0.000s
I20260709 12:17:56.970309 24546 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.106490 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.095707 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:57.140641 21105 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:57.092720 21034 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:57.142189 21102 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:57.137313 21107 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:57.069540 24575 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:17:57.068809 24615 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:17:57.086737 24578 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 12:17:57.083177 24613 consensus_queue.cc:1059] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.180s
I20260709 12:17:57.082926 24429 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.088521 24367 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 12:17:57.341040 24615 consensus_queue.cc:1243] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer a1b891e53adc40a6a1ae813238321e93 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:17:57.143124 21108 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:57.342759 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:57.342953 21031 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:57.253746 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:57.343811 21186 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:57.167560 21150 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:57.251185 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:57.340961 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.092006 24576 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:57.203258 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:57.498792 21031 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:17:57.137929 24507 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:57.142793 24484 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:57.499701 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 404967us
I20260709 12:17:57.484598 21110 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:57.494683 21185 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:17:57.500859 21185 pending_rounds.cc:85] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 4
I20260709 12:17:57.091109 24518 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.447875 21105 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:17:57.502568 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.510067 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.345359 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 177891us
W20260709 12:17:57.513579 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.066159 24602 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:57.249341 21178 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:57.203727 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:17:57.503422 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 419778us
W20260709 12:17:57.154947 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.248657 24620 log.cc:927] Time spent T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:17:57.518455 21709 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:57.142196 24538 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.357893 21741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 489) took 1194 ms. Trace:
I20260709 12:17:57.346095 21179 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:57.400424 21103 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:57.497854 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.503837 21102 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:57.225054 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.528021 21106 raft_consensus.cc:2368] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:57.405664 21108 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:57.522421 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:57.529187 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:57.267836 24596 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.574s	user 0.005s	sys 0.000s
I20260709 12:17:57.175066 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.092530 24567 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:57.341688 24329 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:57.521371 21738 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:17:57.518692 24558 consensus_meta.cc:287] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 12:17:57.254179 24608 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:57.537436 20999 leader_election.cc:336] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.583s (SENT)
I20260709 12:17:57.542378 21737 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:17:57.542567 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:57.544091 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:57.517850 24602 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.501112 21185 pending_rounds.cc:107] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:17:57.490111 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:57.518406 24560 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.553488 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:57.373265 24546 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:57.399772 24613 raft_consensus.cc:3055] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:57.471283 24508 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.508759 24484 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:57.534801 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:57.535574 21029 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:57.400279 24311 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:57.248040 24617 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:57.345273 24199 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:57.339437 24565 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:57.158401 21184 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:57.094908 24571 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.431s
I20260709 12:17:57.539249 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:57.539497 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.632654 21110 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:57.248214 24607 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:17:57.640973 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1835) took 1853 ms. Trace:
I20260709 12:17:57.641378 21182 rpcz_store.cc:276] 0709 12:17:55.787088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.787205 (+   117us) service_pool.cc:224] Handling call
0709 12:17:55.795951 (+  8746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:55.796321 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.796351 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:55.823614 (+ 27263us) log.cc:844] Serialized 26 byte log entry
0709 12:17:56.124231 (+300617us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:56.124272 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.124339 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.267230 (+1142891us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:57.640670 (+373440us) raft_consensus.cc:1685] finished
0709 12:17:57.640689 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.640889 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6280,"raft.queue_time_us":2074,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":12013,"spinlock_wait_cycles":4807424,"thread_start_us":147596,"threads_started":1,"wal-append.queue_time_us":857502}
I20260709 12:17:57.642831 21179 raft_consensus.cc:2410] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:57.508420 24580 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.540464 21033 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:57.511525 24576 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:57.498041 24569 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:57.471487 24578 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:57.522377 21178 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:57.547415 21027 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:57.548249 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:57.548642 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:57.548763 21031 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:57.370114 24557 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:57.550343 21107 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:57.550606 21185 raft_consensus.cc:2889] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:57.520483 24591 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:57.552841 21032 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:57.251750 24216 consensus_queue.cc:1059] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.313s
I20260709 12:17:57.584779 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.587826 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:57.590600 21186 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:57.247859 24612 consensus_queue.cc:1059] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.350s
I20260709 12:17:57.545182 24329 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:57.519902 24507 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:17:57.561858 24602 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:57.637563 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.638329 24072 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:57.638934 24600 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.826s	user 0.009s	sys 0.004s
I20260709 12:17:57.537178 24538 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:57.588682 24618 consensus_queue.cc:1059] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.178s
I20260709 12:17:57.726682 21030 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:17:57.733681 21030 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:57.727034 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.549399 24558 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.539311 24566 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:57.726673 21183 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:57.587553 24613 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:57.644014 24206 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:17:57.736148 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 138468us
I20260709 12:17:57.735702 21034 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 3.
I20260709 12:17:57.588011 24560 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.552368 24608 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.731086 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:57.761649 21031 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:57.632467 24624 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:57.741123 21110 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:17:57.766347 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.755141 21034 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:57.639001 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.768548 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:57.695314 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 172952us
I20260709 12:17:57.525323 21741 rpcz_store.cc:276] 0709 12:17:56.163795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.176169 (+ 12374us) service_pool.cc:224] Handling call
0709 12:17:56.272664 (+ 96495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:56.272928 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:56.972001 (+699073us) log.cc:844] Serialized 14 byte log entry
0709 12:17:57.357472 (+385471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:57.357538 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:57.357595 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.357668 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.357813 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35312,"prepare.queue_time_us":102106,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":33,"raft.queue_time_us":13319,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":89456,"thread_start_us":989924,"threads_started":2,"wal-append.queue_time_us":553196}
W20260709 12:17:57.755950 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 169778us
W20260709 12:17:57.743451 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 225042us
I20260709 12:17:57.760815 21743 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:57.769055 21106 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:57.694432 24582 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.763274 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:57.775278 21102 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:57.776364 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:57.777113 21107 raft_consensus.cc:2368] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:57.598160 24556 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 12:17:57.755223 24565 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.778407 21002 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:57.771224 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.629705 24534 consensus_queue.cc:1059] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 12:17:57.707275 24621 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.161s
I20260709 12:17:57.632124 24617 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:57.881839 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 111850us
I20260709 12:17:57.757889 24614 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:17:57.752055 24580 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:57.893916 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:57.861928 24560 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:57.794744 24582 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:57.788393 24624 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:57.937443 21108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36a88ddff51a4bcea630447226c59041"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:57.794464 24429 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:57.896421 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 358984us
W20260709 12:17:57.944379 20999 leader_election.cc:336] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.643s (SENT)
W20260709 12:17:57.945149 20999 leader_election.cc:336] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.726s (SENT)
I20260709 12:17:57.945502 20999 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:57.896713 24617 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:57.750768 24072 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:57.900475 24348 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.902236 24608 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:57.904191 24538 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:57.904784 24591 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.913280 21111 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:17:57.912747 21185 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:17:57.826834 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 531170us
I20260709 12:17:57.926879 21106 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:17:57.865916 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.799639 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:57.931267 21102 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
W20260709 12:17:57.900650 24622 log.cc:927] Time spent T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.313s	user 0.000s	sys 0.000s
I20260709 12:17:57.938068 21108 raft_consensus.cc:606] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:57.960196 21108 raft_consensus.cc:614] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:57.842626 24606 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:17:57.756809 24578 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.808869 24559 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:57.942044 21183 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:57.936270 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:57.982657 20999 leader_election.cc:336] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.762s (SENT)
I20260709 12:17:57.772606 24557 consensus_queue.cc:1059] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.163s
I20260709 12:17:57.949016 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.949141 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:57.777424 24618 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.168s
W20260709 12:17:57.985836 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 186541us
I20260709 12:17:57.937953 24534 consensus_queue.cc:1243] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:57.963798 21102 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:57.865437 24329 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:57.958465 24571 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:57.980585 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:57.971544 24518 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:57.769779 24567 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:57.996464 21036 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:57.951653 24429 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:17:57.996709 21105 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:58.004420 21185 raft_consensus.cc:2368] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9.
I20260709 12:17:58.007541 21036 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
W20260709 12:17:58.001780 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 229388us
I20260709 12:17:58.003646 21107 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:17:57.983572 24628 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:58.016400 21149 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:57.955576 24617 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:17:57.954051 24632 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:17:58.045104 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:58.028554 21183 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:58.027405 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:58.035494 21185 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:58.047351 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.047950 21185 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
W20260709 12:17:58.049934 24638 log.cc:927] Time spent T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:17:58.050673 24605 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 1.078s	user 0.018s	sys 0.019s
I20260709 12:17:58.051679 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:58.052423 21184 raft_consensus.cc:2368] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
I20260709 12:17:57.990918 24633 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:58.004422 24557 consensus_queue.cc:1243] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:58.039176 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:57.962457 24348 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:58.051898 21180 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:58.064647 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:58.065321 21182 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:58.036825 24561 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:58.004287 24311 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:58.087406 21712 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:17:58.087939 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 60613.3us
I20260709 12:17:58.088598 21076 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:58.013872 24559 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:58.041445 24608 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.106422 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.107403 21184 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:58.058506 20999 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.068958 24518 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.073719 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:58.074380 24630 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:58.108672 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 62439.9us
I20260709 12:17:58.064043 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:58.111099 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 182223us
I20260709 12:17:58.111951 21075 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:58.113407 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:58.115374 21002 leader_election.cc:400] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
I20260709 12:17:58.115665 21002 leader_election.cc:403] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:17:58.085031 24329 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:58.091109 24633 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:58.093286 24612 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:58.125521 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.084007 24206 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:17:58.048717 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.123309 24618 consensus_queue.cc:1243] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:58.124428 21177 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:58.126191 21184 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:58.093662 24558 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:58.119778 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:58.153079 21182 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:58.091487 24529 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:17:58.143858 21185 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:58.120560 24575 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:58.046073 24628 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:58.122051 24361 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10.
I20260709 12:17:58.107630 24621 consensus_queue.cc:1059] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:17:58.171682 21182 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:58.179708 24643 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:17:58.132261 24429 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:58.127142 24612 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:58.219043 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.116080 24608 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.120676 24556 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 12:17:58.224625 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.224766 24556 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:58.225153 24556 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:58.224908 24658 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:58.226423 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.227094 24608 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:58.123195 24518 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:58.228708 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 109020us
W20260709 12:17:58.228410 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 107695us
I20260709 12:17:58.168566 24575 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.264343 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:58.267465 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.227660 24608 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:58.222527 24612 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.274899 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.276023 21108 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:58.276300 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:58.276612 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.276437 21108 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:58.277228 21178 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:58.277796 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:58.173470 24529 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:58.223389 24580 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:58.179737 24649 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:58.291262 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.268944 24575 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:58.319628 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.323083 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:58.343744 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 301574us
I20260709 12:17:58.295384 24621 raft_consensus.cc:3055] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:58.346627 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.294775 24578 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:58.325359 24580 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:58.267855 24311 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:58.350378 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.321622 24649 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.330943 24072 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:58.329890 21108 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.368134 24653 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:58.272265 24559 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.350962 24621 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:58.334964 24429 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:58.393219 20999 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:58.430683 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 139455us
I20260709 12:17:58.377658 24578 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:58.438184 24640 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:58.383863 24649 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:58.335587 24556 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.358903 24647 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:58.490644 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:17:58.492513 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 109016us
I20260709 12:17:58.506487 21104 raft_consensus.cc:1813] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Handling vote request from an unknown peer 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:17:58.394322 24560 consensus_queue.cc:1059] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:17:58.453925 24348 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:58.516481 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:58.518651 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:58.517611 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:17:58.503928 24648 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:58.506181 24647 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:58.506011 24629 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.257s
I20260709 12:17:58.523250 24648 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:58.530244 24556 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:58.545616 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:58.546540 24651 log.cc:927] Time spent T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:17:58.546890 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:58.547410 24508 raft_consensus.cc:3055] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:58.544363 24529 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:58.548157 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1762) took 1044 ms. Trace:
W20260709 12:17:58.556770 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.531731 24630 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:58.524190 24578 consensus_queue.cc:1059] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:17:58.053545 24624 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.559140 24628 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:58.559912 24635 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:58.560271 24669 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:58.575539 24578 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:58.575966 24578 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.576277 24578 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:58.580942 24361 raft_consensus.cc:3055] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:58.581360 24361 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:58.582113 24361 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.584713 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:58.585934 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:58.587560 24659 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:17:58.588105 21178 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:58.589470 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:58.589677 21104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1728) took 2457 ms (client timeout 2109 ms). Trace:
I20260709 12:17:58.590034 21183 raft_consensus.cc:2376] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8. Re-sending same reply.
W20260709 12:17:58.590058 21104 rpcz_store.cc:269] 0709 12:17:56.131879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.148628 (+ 16749us) service_pool.cc:224] Handling call
0709 12:17:58.589488 (+2440860us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400229054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:58.589610 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4158181248}
I20260709 12:17:58.574558 24669 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:58.591406 24652 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:17:58.547828 24508 raft_consensus.cc:740] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:58.549082 21709 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.536990 24518 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:58.571137 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:58.600492 21181 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:58.573915 24484 consensus_meta.cc:287] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.929s	user 0.007s	sys 0.000s
I20260709 12:17:58.587455 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.615370 21028 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
W20260709 12:17:58.605937 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 56952.5us
I20260709 12:17:58.591295 24669 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:58.555840 21109 rpcz_store.cc:276] 0709 12:17:57.504027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.985604 (+481577us) service_pool.cc:224] Handling call
0709 12:17:57.985895 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.041270 (+ 55375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.041297 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.068397 (+ 27100us) log.cc:844] Serialized 26 byte log entry
0709 12:17:58.269229 (+200832us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:58.269268 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.269337 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:58.547959 (+278622us) raft_consensus.cc:1685] finished
0709 12:17:58.547977 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.548099 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27738,"raft.queue_time_us":57451,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":40532,"thread_start_us":255437,"threads_started":2,"wal-append.queue_time_us":286698}
I20260709 12:17:58.603574 21747 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:58.591181 24569 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:58.542315 24429 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.615180 24072 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:58.617444 24580 consensus_queue.cc:1059] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 12:17:58.595544 24546 consensus_meta.cc:287] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.980s	user 0.003s	sys 0.005s
I20260709 12:17:58.563004 24630 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.627326 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:58.642539 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:58.643118 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:58.643726 21183 raft_consensus.cc:2376] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5. Re-sending same reply.
I20260709 12:17:58.643150 21109 raft_consensus.cc:2376] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11. Re-sending same reply.
I20260709 12:17:58.646085 21109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:58.646641 21109 raft_consensus.cc:606] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:58.623955 24569 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:58.647223 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:58.654645 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.637969 24361 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:58.641927 24630 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:58.618984 24484 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.591850 24647 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.508126 24621 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.357832 24633 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.638266 24615 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:17:58.429037 24653 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:58.697295 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.698094 21178 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:58.699553 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1745) took 1227 ms. Trace:
I20260709 12:17:58.699925 21111 rpcz_store.cc:276] 0709 12:17:57.472228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.757561 (+285333us) service_pool.cc:224] Handling call
0709 12:17:58.699381 (+941820us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b54000a7b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:58.699496 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80142720}
I20260709 12:17:58.700588 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1825) took 1107 ms. Trace:
I20260709 12:17:58.701015 21102 rpcz_store.cc:276] 0709 12:17:57.592845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.989698 (+396853us) service_pool.cc:224] Handling call
0709 12:17:58.699530 (+709832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.699731 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.699768 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:58.699814 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:58.699855 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.699911 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.700421 (+   510us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54000a7b50. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:58.700525 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631665536}
I20260709 12:17:58.678062 21104 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:58.680164 21109 raft_consensus.cc:1240] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:58.690927 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2431) took 1605 ms. Trace:
I20260709 12:17:58.723941 21028 rpcz_store.cc:276] 0709 12:17:57.079938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.080065 (+   127us) service_pool.cc:224] Handling call
0709 12:17:57.080361 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.615819 (+1535458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.684803 (+ 68984us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540035cd54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:58.684958 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3525000064}
I20260709 12:17:58.687227 24662 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.728793 21109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:17:58.729415 21109 raft_consensus.cc:606] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:58.730412 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.731034 21178 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
W20260709 12:17:58.706557 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 313388us
I20260709 12:17:58.732321 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.733907 20999 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.729737 21109 raft_consensus.cc:614] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:58.736021 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 218454us
I20260709 12:17:58.721364 24647 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:58.737607 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.776029 21178 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:58.653450 24648 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.689219 21182 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:17:58.729754 24569 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:58.751497 24676 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:17:58.634765 24508 consensus_queue.cc:260] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:58.751493 24602 consensus_meta.cc:287] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.996s	user 0.010s	sys 0.001s
I20260709 12:17:58.752775 24653 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:58.753736 24677 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:17:58.754449 24658 consensus_meta.cc:287] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:17:58.811830 24658 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:58.812470 24658 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:58.812865 24648 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:58.815519 24678 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.816077 24678 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:58.818338 24678 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:58.799381 24576 consensus_meta.cc:287] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 1.044s	user 0.010s	sys 0.007s
I20260709 12:17:58.746686 24072 consensus_queue.cc:1059] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:17:58.819222 24576 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.819943 24072 raft_consensus.cc:3055] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:58.820314 24072 raft_consensus.cc:740] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:58.756546 24668 raft_consensus.cc:3055] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:17:58.759207 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.759452 24329 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.001s
W20260709 12:17:58.764302 24655 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.513s	user 0.001s	sys 0.002s
I20260709 12:17:58.728479 24621 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:58.773402 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:17:58.774770 21151 connection.cc:256] RPC call timeout handler was delayed by -1.5136534000000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 12:17:58.779664 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:58.795954 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.800192 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:58.804762 21740 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:17:58.870126 21151 connection.cc:256] RPC call timeout handler was delayed by -1.4569533999999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 12:17:58.807858 21184 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:58.806327 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:58.811373 21104 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:58.811064 24649 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:58.821451 21035 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:58.823279 21178 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:17:58.870467 21151 connection.cc:256] RPC call timeout handler was delayed by -1.453353399999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 12:17:58.872996 21151 connection.cc:256] RPC call timeout handler was delayed by -1.3939534000001004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 12:17:58.873292 21151 connection.cc:256] RPC call timeout handler was delayed by -1.3876534000000902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 12:17:58.865123 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 91879.8us
W20260709 12:17:58.873716 21151 connection.cc:256] RPC call timeout handler was delayed by -1.3291533999999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260709 12:17:58.874066 21151 connection.cc:256] RPC call timeout handler was delayed by -1.3093533999999636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 12:17:58.810499 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 76650.8us
W20260709 12:17:58.834765 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.869453 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.869300 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:58.871469 21110 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:17:58.873359 21184 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:58.876511 24582 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:58.877405 24683 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 12:17:58.866259 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.878188 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.878508 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.879371 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2442) took 1781 ms. Trace:
W20260709 12:17:58.874425 21151 connection.cc:256] RPC call timeout handler was delayed by -1.2445534000000862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 12:17:58.880033 21151 connection.cc:256] RPC call timeout handler was delayed by -1.1068534000000909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 12:17:58.880442 21151 connection.cc:256] RPC call timeout handler was delayed by -1.0591534000000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 12:17:58.880712 21151 connection.cc:256] RPC call timeout handler was delayed by -1.035753399999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260709 12:17:58.879733 21035 rpcz_store.cc:276] 0709 12:17:57.097561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.537412 (+439851us) service_pool.cc:224] Handling call
0709 12:17:57.552503 (+ 15091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.877237 (+1324734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.879161 (+  1924us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001c0554. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:58.879318 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2917863808}
W20260709 12:17:58.881053 21151 connection.cc:256] RPC call timeout handler was delayed by -1.0195533999999498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 12:17:58.881273 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.881409 21151 connection.cc:256] RPC call timeout handler was delayed by -1.0168533999999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 12:17:58.881969 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.882155 21151 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.897158 21028 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:58.806861 24216 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.735987 24670 consensus_queue.cc:1059] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 12:17:58.907994 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:58.908597 21028 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:58.807327 24558 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.864578 24576 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:58.903432 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:58.913131 21035 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:58.903394 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:58.783581 24575 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:58.895133 24612 consensus_meta.cc:287] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.003s
I20260709 12:17:58.920881 21107 raft_consensus.cc:2393] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 6: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:58.921000 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:58.866685 24668 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:58.923638 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:58.924399 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.931531 21183 raft_consensus.cc:3055] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:58.931988 21183 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:58.735486 24662 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.929193 20999 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.896308 24569 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:58.903080 24561 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:58.945048 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:58.948973 21035 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:17:58.946189 21183 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.821193 24072 consensus_queue.cc:260] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:58.927140 24546 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:58.935225 21028 raft_consensus.cc:2410] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:58.936031 21180 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:58.937338 21027 raft_consensus.cc:2393] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 6: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:17:58.940570 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.962210 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.962378 20999 leader_election.cc:400] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:58.962682 20999 leader_election.cc:403] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:58.962397 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:58.962865 21183 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:58.945601 24606 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:58.913353 24216 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:58.965999 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:58.950565 24658 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:58.975034 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:58.976361 21183 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:58.829699 24602 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:58.973176 21744 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:17:58.973510 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:58.982581 21027 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:58.984406 24575 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:58.986208 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:58.986856 21034 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:17:58.986976 24634 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:58.989224 24687 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:17:58.989997 24682 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:17:58.980005 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.992216 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.937492 24612 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:58.981765 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.996227 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:58.998406 24484 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:58.999079 24575 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:58.999817 24575 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:59.001273 24575 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:59.001631 24575 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.005627 24649 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:17:59.006064 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.006810 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.012126 24670 consensus_queue.cc:1059] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:59.013949 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:59.017329 24216 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:59.018608 24695 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:58.972218 24582 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
W20260709 12:17:59.019712 24534 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:17:59.021116 21036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2449) took 1912 ms (client timeout 1928 ms). Trace:
W20260709 12:17:59.021510 21036 rpcz_store.cc:269] 0709 12:17:57.109155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.203234 (+ 94079us) service_pool.cc:224] Handling call
0709 12:17:59.020966 (+1817732us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54001c0a54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:59.021060 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090596736}
I20260709 12:17:59.024190 24662 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:59.027359 24679 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:17:59.031097 24591 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:17:59.031635 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:59.033041 21185 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:58.927841 24613 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.035568 24678 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:59.035751 24613 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.036103 24678 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.038276 24678 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.039755 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:59.041219 21000 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:59.042647 24634 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:59.042934 24655 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:17:59.043563 24206 raft_consensus.cc:3055] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:59.043804 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1752) took 1545 ms. Trace:
I20260709 12:17:59.044174 21106 rpcz_store.cc:276] 0709 12:17:57.498494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.953957 (+455463us) service_pool.cc:224] Handling call
0709 12:17:57.954271 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:57.962556 (+  8285us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:17:58.066508 (+103952us) log.cc:844] Serialized 14 byte log entry
0709 12:17:58.249506 (+182998us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.267591 (+ 18085us) log.cc:844] Serialized 26 byte log entry
0709 12:17:58.267778 (+   187us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:17:58.268008 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 12:17:58.357905 (+ 89897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.357979 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:58.762140 (+404161us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b1800044500. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8752a6 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db
0709 12:17:58.763703 (+  1563us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:17:59.043592 (+279889us) raft_consensus.cc:1685] finished
0709 12:17:59.043611 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.043747 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133260,"prepare.queue_time_us":161797,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":5916,"raft.queue_time_us":205707,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":48194,"spinlock_wait_cycles":130475520,"thread_start_us":208477,"threads_started":3,"wal-append.queue_time_us":68494}
W20260709 12:17:59.048394 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.051626 21709 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:59.063246 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 71129.3us
I20260709 12:17:59.064111 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:59.064880 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.066579 21106 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:58.976182 24072 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:58.998657 20999 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:58.933758 24558 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.071046 21029 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:59.073660 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.074261 21036 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:17:59.076485 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:59.076660 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:59.079507 24348 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.084110 24557 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.084628 24557 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:59.085644 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.049355 24206 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:59.088603 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:58.975695 24578 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.059909 24612 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.093657 21178 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:59.098112 21185 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
W20260709 12:17:59.098582 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 99984.9us
I20260709 12:17:59.065332 24311 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:59.069835 24670 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.113869 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:59.114743 21036 raft_consensus.cc:2410] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:59.102025 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:59.116132 21185 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.022588 24669 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.103319 20999 leader_election.cc:400] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9.
I20260709 12:17:59.069674 24546 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:59.117393 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:59.118805 21712 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.079658 24216 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:59.065166 24606 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:17:59.086726 24557 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:59.128364 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:17:59.126379 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 62341.7us
I20260709 12:17:59.127454 21028 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:59.130683 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.131914 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.099545 24507 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.059738 24630 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.133678 21151 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.142917 21151 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.099309 24608 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:59.135121 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:59.145265 21035 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:59.145429 20999 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:59.135694 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 86762.5us
W20260709 12:17:59.146991 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.084287 24348 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:59.147511 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.149408 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.156347 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.127417 24216 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:59.156280 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:59.137333 24671 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:59.160115 21077 leader_election.cc:336] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.448s (SENT)
I20260709 12:17:59.161142 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:59.163371 21711 leader_election.cc:336] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.529s (SENT)
I20260709 12:17:59.163798 21151 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.163846 21711 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:59.140120 24642 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:59.138391 24690 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:59.150460 24557 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:59.155215 24591 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:59.159016 24648 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.166761 24621 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.159792 24216 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:59.159895 24546 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:59.165277 24671 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:59.212271 24671 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:59.169883 24690 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.212984 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:59.213423 24690 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.205440 24484 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:59.206629 24669 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.207710 24578 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.227384 24686 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:17:59.162041 24576 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:59.215376 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.171609 24311 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:59.234977 24311 raft_consensus.cc:697] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:59.235948 24630 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:17:59.203157 24696 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:17:59.226007 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.226500 21027 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:59.226970 24673 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:59.289937 21185 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:59.205461 24591 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:17:59.231218 21034 raft_consensus.cc:2410] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:59.230012 21036 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:17:59.291471 24591 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.292912 21036 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:17:59.232524 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.230574 24634 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:59.290669 24348 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:59.295370 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:59.151911 24507 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:59.296092 24698 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:17:59.274962 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.297333 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1817) took 1824 ms. Trace:
I20260709 12:17:59.297672 21103 rpcz_store.cc:276] 0709 12:17:57.472879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.946318 (+473439us) service_pool.cc:224] Handling call
0709 12:17:57.947921 (+  1603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:57.948240 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.948268 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:57.955577 (+  7309us) log.cc:844] Serialized 26 byte log entry
0709 12:17:59.008552 (+1052975us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b1800263ce0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b 00007fcb9f533d23 00007fcb9f5340d1 00007fcb9f94fa0f
0709 12:17:59.133156 (+124604us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:59.133194 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.133271 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:59.297054 (+163783us) raft_consensus.cc:1685] finished
0709 12:17:59.297073 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.297275 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12151,"raft.queue_time_us":14234,"raft.run_cpu_time_us":6537,"raft.run_wall_time_us":25853,"spinlock_wait_cycles":13071104,"thread_start_us":124429,"threads_started":1,"wal-append.queue_time_us":1257636}
I20260709 12:17:59.225443 24648 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.300763 24648 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.280403 24575 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.291379 24602 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.302738 24575 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:59.303543 24634 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:59.303960 24634 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.304636 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:17:59.282864 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.235862 24311 consensus_queue.cc:237] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.308256 21027 raft_consensus.cc:2376] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9. Re-sending same reply.
I20260709 12:17:59.311103 24507 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:59.184474 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.313092 24558 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:59.313632 24507 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:59.233490 21033 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:59.224704 24621 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.294888 24614 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.315923 24631 raft_consensus.cc:3055] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:59.202927 24556 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:59.316334 24631 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:59.316586 24621 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.316792 24556 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:59.317673 24556 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:59.318444 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.203519 24206 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:59.319063 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.323051 24690 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.325330 24690 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.328394 24631 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.329444 24631 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:59.330772 21108 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.295260 24673 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.331995 24673 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:59.266480 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 111259us
I20260709 12:17:59.341473 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:59.344269 21185 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:59.341796 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:59.347451 21180 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:59.350147 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 165754us
I20260709 12:17:59.353154 21110 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:59.355485 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.362062 21108 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:59.363157 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.364224 21181 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:59.365471 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:59.367115 24671 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:59.369184 24538 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:17:59.374954 24621 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:59.375581 24606 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:59.375803 24216 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.413780 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2299) took 1131 ms. Trace:
I20260709 12:17:59.414230 21182 rpcz_store.cc:276] 0709 12:17:58.269857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.278929 (+  9072us) service_pool.cc:224] Handling call
0709 12:17:59.401168 (+1122239us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54001d0454. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:17:59.401279 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735078272}
I20260709 12:17:59.377753 21034 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:59.379340 21180 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:17:59.359091 24678 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:59.377315 24072 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 12:17:59.456004 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.362821 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1763) took 1112 ms. Trace:
I20260709 12:17:59.374267 24634 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.361670 21185 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:59.336553 24670 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:59.468993 24670 consensus_queue.cc:1059] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:59.469180 24690 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:59.402707 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:17:59.470453 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 67825.4us
I20260709 12:17:59.471160 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.472644 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:17:59.415349 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.473428 21738 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:17:59.473866 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.411618 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.475109 21035 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:17:59.362066 24507 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:17:59.381273 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.443886 24348 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.448185 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.448953 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.448202 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:17:59.444015 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 80497.6us
I20260709 12:17:59.451185 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.451282 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.483178 21036 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:17:59.452211 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2446) took 2344 ms. Trace:
I20260709 12:17:59.483922 21029 rpcz_store.cc:276] 0709 12:17:57.108055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.628080 (+520025us) service_pool.cc:224] Handling call
0709 12:17:57.628439 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.071463 (+1443024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.451981 (+380518us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000c4ed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:17:59.452146 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3317239552}
I20260709 12:17:59.412880 24614 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:59.461092 21033 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:59.461176 21739 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:59.458017 21108 rpcz_store.cc:276] 0709 12:17:58.250943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.263753 (+ 12810us) service_pool.cc:224] Handling call
0709 12:17:58.264046 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.330604 (+1066558us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b58007148d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f8f00aa 00007fcb9f972447 00007fcb9f98afe7 00007fcb9f98c7de 00007fcb9f996b49 00007fcb9f997416 00007fcb9f993d8f 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4
0709 12:17:59.362524 (+ 31920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.362767 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493685632}
I20260709 12:17:59.467417 24634 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.473371 21740 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:59.485766 21027 raft_consensus.cc:2410] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:59.483253 21031 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:17:59.494077 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.494575 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.494755 21108 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:17:59.496038 21110 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:59.497911 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.498787 21110 raft_consensus.cc:2410] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:59.495299 21029 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:17:59.504498 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.483469 24546 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:59.482367 24534 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:59.508690 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.509459 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.509832 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.527850 21030 raft_consensus.cc:1240] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:59.520295 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.521381 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.527983 21103 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:17:59.527330 21035 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:17:59.500705 24602 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.534512 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.537595 21711 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.500380 24575 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.540086 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:59.500473 24630 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:59.543646 21149 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.521510 24640 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:17:59.535044 24647 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:17:59.522706 24569 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.553802 21149 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:17:59.546108 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:17:59.555895 21027 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.487170 24348 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.527081 24534 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.551105 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:59.484776 24361 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:17:59.553159 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.546747 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:17:59.536530 24617 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:17:59.549031 24602 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.560454 24671 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:59.560269 24507 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.566210 21036 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:59.554852 24546 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:59.549863 24629 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:59.552356 24616 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:59.541949 24615 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.567358 24534 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:59.532564 24311 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:59.586241 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:17:59.601933 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 129332us
I20260709 12:17:59.639060 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.582628 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.541776 24657 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:17:59.552175 24621 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:17:59.550348 24575 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.639837 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:17:59.565330 24556 consensus_queue.cc:1059] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:17:59.636821 21027 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 4.
I20260709 12:17:59.640877 24671 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:59.555289 24630 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:17:59.633708 24704 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:59.582653 24072 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:59.640447 21182 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.563344 24569 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.631686 24629 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:59.587041 24546 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:17:59.638899 24615 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.658525 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:17:59.654376 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 105257us
W20260709 12:17:59.638607 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 133382us
I20260709 12:17:59.651317 24612 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:59.665791 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.667232 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.670892 21103 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:17:59.671522 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.672122 21108 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:59.674463 21182 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:17:59.653695 24072 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:17:59.657533 24546 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:59.678328 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.679498 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.686551 21111 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:59.687000 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.656800 24311 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.655397 24629 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:59.683867 21110 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:59.693329 21110 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:59.588833 24668 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.684564 21109 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:59.653466 24717 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:59.662043 24558 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:59.688720 21102 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:59.689014 21711 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:17:59.696990 21102 pending_rounds.cc:85] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 4
I20260709 12:17:59.691543 21103 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:17:59.691771 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.697708 21104 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:59.697297 21102 pending_rounds.cc:107] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:59.698678 21102 raft_consensus.cc:2889] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:59.699587 21103 pending_rounds.cc:85] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 4
I20260709 12:17:59.699883 21103 pending_rounds.cc:107] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:17:59.700183 21103 raft_consensus.cc:2889] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:59.654810 24429 consensus_queue.cc:1059] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:17:59.655725 24640 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:17:59.669775 24612 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:59.706983 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 68007.1us
I20260709 12:17:59.714144 21151 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:17:59.707990 21111 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:17:59.709322 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.711318 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.712113 21108 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:59.715646 21108 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:59.683616 24072 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:59.710667 21110 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.722591 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.723707 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.723954 21104 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:17:59.725279 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:17:59.702126 24717 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.736243 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.702373 24558 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:59.705816 24690 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:59.739923 21110 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:59.767971 21108 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.716315 24612 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:59.772156 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 96714.4us
W20260709 12:17:59.770535 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45344.4us
W20260709 12:17:59.778759 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 78891.1us
I20260709 12:17:59.703722 24311 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.739173 24717 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:59.790961 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.754217 24558 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.710765 24673 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.799185 21107 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:17:59.779002 24708 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:17:59.827404 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:17:59.834007 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55699.3us
I20260709 12:17:59.779188 24690 raft_consensus.cc:697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:17:59.838748 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:59.854626 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:59.855432 21179 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:17:59.857259 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:59.858510 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.860894 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:59.861253 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:59.861208 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:17:59.862221 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:59.827251 24348 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:59.864575 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:17:59.831941 24602 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:17:59.872088 21182 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 5.
I20260709 12:17:59.779299 24718 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:17:59.853250 24429 raft_consensus.cc:3055] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:59.885681 21180 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:59.832029 24556 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:17:59.859946 24728 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:59.894960 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 58317.2us
I20260709 12:17:59.886713 24621 consensus_queue.cc:1059] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:17:59.852221 24657 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 12:17:59.898685 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 101443us
I20260709 12:17:59.867147 24729 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:17:59.894277 24429 raft_consensus.cc:740] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:59.894651 24615 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:59.897609 24728 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.909689 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.911285 21107 raft_consensus.cc:2410] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:17:59.893033 24662 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:59.903019 24630 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:59.913136 21076 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:17:59.917016 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 124851us
W20260709 12:17:59.923859 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.924337 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:59.911826 24429 consensus_queue.cc:260] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:59.926726 24723 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:17:59.927141 24429 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.928431 24615 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:59.928943 24615 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:17:59.929759 24615 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:17:59.931358 24725 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:17:59.932799 24734 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.912627 24728 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.914561 24556 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.933876 24556 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:17:59.935956 24556 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:59.936926 24673 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:59.937641 24733 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:59.938007 24733 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:17:59.938755 24733 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.939379 24311 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:59.902199 24690 consensus_queue.cc:237] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:17:59.943687 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:59.944864 21179 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:17:59.948143 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.916507 24715 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:17:59.955909 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:17:59.956176 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:17:59.909324 24726 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:17:59.966784 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.927034 24657 consensus_queue.cc:1243] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:17:59.928471 24713 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:17:59.968065 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:17:59.973045 21110 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
W20260709 12:17:59.973730 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.905423 24729 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.005766 24729 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:00.006649 24640 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:00.008256 24629 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.008777 24557 raft_consensus.cc:3055] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:00.009236 24557 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:00.010049 24557 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.013156 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:00.015479 24557 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.993430 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.020593 21108 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:59.994062 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 68105.9us
I20260709 12:17:59.970343 24612 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.022660 24730 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:59.933391 24734 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.032577 24734 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:17:59.996958 24546 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.032475 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:00.034183 21178 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
W20260709 12:17:59.995484 24721 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:18:00.035073 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.035284 24546 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:17:59.981432 24733 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:00.036934 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:00.037145 24629 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:00.030817 21102 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:00.039422 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:00.042570 24640 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:59.995457 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:59.999848 24631 consensus_meta.cc:287] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.002s
I20260709 12:18:00.020503 24545 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.025876 24730 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:59.995152 24732 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:18:00.026808 24726 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:59.994501 21743 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:00.044983 21077 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:00.045171 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.047183 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:00.052575 21111 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:00.056743 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:00.068379 21102 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:00.068886 21027 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:00.069368 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:00.060075 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 146998us
W20260709 12:18:00.061715 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.062162 21108 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:00.063491 24727 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:00.067911 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:00.075641 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.078094 21032 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:00.079321 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:00.057714 24662 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:00.078078 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:00.065536 24634 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.084857 21077 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:00.097172 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:00.103019 21077 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:00.109189 21027 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:00.072290 24640 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:00.114611 20930 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 115) took 12168 ms (client timeout 15000 ms). Trace:
I20260709 12:18:00.057967 24602 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:18:00.095772 24632 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:00.064872 24608 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:18:00.095114 24662 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:00.073770 24630 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:18:00.073616 24680 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:18:00.116698 24617 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.101740 24648 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:00.149480 24743 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:18:00.151203 21023 tablet_service.cc:1558] Processing DeleteTablet for tablet f16c07bcae284f65a7c0ee0375e00769 with delete_type TABLET_DATA_TOMBSTONED (TS 3ed9deaeb4014e9d87aeebbc6384f81f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59982
I20260709 12:18:00.115833 24657 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:18:00.155721 24653 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:18:00.156379 24719 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:18:00.165997 24662 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:00.120457 24565 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:00.127694 24507 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:00.159070 24720 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:18:00.156745 24645 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:00.160079 24621 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:00.112375 24634 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.113603 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:00.115067 20930 rpcz_store.cc:269] 0709 12:17:47.915554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.915733 (+   179us) service_pool.cc:224] Handling call
0709 12:18:00.083930 (+12168197us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:54.952012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:55.194177 (+242165us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:55.194228 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:17:55.194250 (+    22us) tablet.cc:662] Decoding operations
0709 12:17:55.299334 (+105084us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:55.317696 (+ 18362us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:55.320992 (+  3296us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:17:55.492884 (+171892us) tablet.cc:701] Row locks acquired
0709 12:17:55.492932 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:17:55.493109 (+   177us) write_op.cc:270] Start()
0709 12:17:55.493272 (+   163us) write_op.cc:276] Timestamp: P: 1783599475493042 usec, L: 0
0709 12:17:55.493971 (+   699us) op_driver.cc:348] REPLICATION: starting
0709 12:17:55.494694 (+   723us) log.cc:844] Serialized 4334 byte log entry
0709 12:17:55.920623 (+425929us) op_driver.cc:464] REPLICATION: finished
0709 12:17:56.913843 (+993220us) write_op.cc:301] APPLY: starting
0709 12:17:56.915291 (+  1448us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:56.954774 (+ 39483us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:57.048208 (+ 93434us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:57.249874 (+201666us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:57.484175 (+234301us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:17:57.500130 (+ 15955us) write_op.cc:312] APPLY: finished
0709 12:17:57.547930 (+ 47800us) log.cc:844] Serialized 83 byte log entry
0709 12:17:57.836237 (+288307us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:57.870037 (+ 33800us) write_op.cc:454] Released schema lock
0709 12:17:57.930735 (+ 60698us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:57.983268 (+ 52533us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:57.988744 (+  5476us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":216,"mutex_wait_us":1107889,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":919743,"apply.run_cpu_time_us":15613,"apply.run_wall_time_us":1061220,"num_ops":11,"prepare.queue_time_us":114921,"prepare.run_cpu_time_us":46178,"prepare.run_wall_time_us":647103,"raft.queue_time_us":108563,"raft.run_cpu_time_us":27433,"raft.run_wall_time_us":424939,"replication_time_us":391934,"thread_start_us":707189,"threads_started":5,"wal-append.queue_time_us":490865,"wal-append.run_cpu_time_us":17221,"wal-append.run_wall_time_us":2154030}]]}
W20260709 12:18:00.188913 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 121069us
I20260709 12:18:00.172310 24730 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:00.178457 24534 consensus_meta.cc:287] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.001s
I20260709 12:18:00.175316 24648 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.135895 24640 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:18:00.200845 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 87310.9us
I20260709 12:18:00.201700 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:00.198642 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:00.205139 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.219638 24645 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:00.222064 24656 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:00.222622 24656 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:00.223596 24656 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.225620 24746 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:00.197669 24565 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:00.182430 24072 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.184887 24717 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.187930 24728 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.206568 24648 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:00.195231 24507 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.227173 24615 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:00.235831 21149 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:00.212149 24741 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:18:00.245981 21149 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:00.206913 24534 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:00.250375 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 136416us
I20260709 12:18:00.255216 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.255903 21185 raft_consensus.cc:2376] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9. Re-sending same reply.
I20260709 12:18:00.257254 21185 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:00.258822 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:00.252813 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:00.262032 21179 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:00.263777 21181 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:00.226339 24746 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:18:00.267489 21182 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:00.271859 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.240151 24615 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:00.246201 24538 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:00.329185 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:00.276679 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:00.239671 24751 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:00.273974 21109 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:00.295809 21185 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:18:00.330983 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.337695 21109 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:00.338117 21183 raft_consensus.cc:2368] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:00.335700 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.239902 24630 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 12:18:00.328979 24744 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:18:00.266863 24735 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:00.271338 24632 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:00.352123 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 75550.9us
I20260709 12:18:00.250108 24546 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:18:00.271234 24613 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:00.433661 21177 raft_consensus.cc:2410] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:00.262594 24645 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.435832 21182 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:00.427073 21109 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.442282 21109 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:00.340899 24538 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.349032 24612 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.461126 21740 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:00.454283 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2458) took 1231 ms. Trace:
I20260709 12:18:00.534775 21737 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:00.533427 21034 rpcz_store.cc:276] 0709 12:17:59.223052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.291477 (+ 68425us) service_pool.cc:224] Handling call
0709 12:17:59.377539 (+ 86062us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:59.415047 (+ 37508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.454076 (+1039029us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b540042e0d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:00.454220 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197072640}
I20260709 12:18:00.544775 21109 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:00.545197 21109 pending_rounds.cc:85] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 5
I20260709 12:18:00.545423 21109 pending_rounds.cc:107] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:18:00.545647 21109 raft_consensus.cc:2889] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:00.548375 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:00.452705 24749 log.cc:927] Time spent T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 12:18:00.483769 24429 consensus_meta.cc:287] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
W20260709 12:18:00.446977 24558 consensus_meta.cc:287] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 12:18:00.521289 24634 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.549844 21744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33006 (request call id 477) took 1755 ms. Trace:
I20260709 12:18:00.625106 21744 rpcz_store.cc:276] 0709 12:17:58.778914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.779029 (+   115us) service_pool.cc:224] Handling call
0709 12:18:00.534213 (+1755184us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400791154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:00.534338 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236660992}
I20260709 12:18:00.550387 24072 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.460011 24206 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:00.641114 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.558064 24727 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:00.560403 24648 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.560909 24507 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:00.446214 24645 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.565339 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.648293 21185 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:00.648523 24645 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.648725 24648 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.649324 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:00.649914 21185 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:00.650038 21108 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:00.567607 24728 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:00.352837 24653 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
I20260709 12:18:00.429543 24735 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.517156 24742 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:00.460438 24668 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:00.538654 24758 tablet_replica.cc:333] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:18:00.353017 24565 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.674654 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.675884 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:00.676442 21179 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:18:00.588455 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:00.594167 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:00.591454 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:00.683959 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:00.684741 21029 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:00.685493 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:00.593466 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:00.686723 21028 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:00.596132 21110 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:00.592509 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:00.455492 24731 raft_consensus.cc:3055] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:00.687178 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.603269 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.687621 21027 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
W20260709 12:18:00.605468 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.605738 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:00.605921 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:00.607695 21036 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:00.606467 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:00.445386 24632 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.463943 24615 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.577980 24730 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.692724 24730 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:00.694566 24753 consensus_queue.cc:1175] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 10 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: [9.6-9.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:00.613312 24662 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.619318 24508 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:00.621321 24558 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:00.622954 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 193388us
I20260709 12:18:00.488833 24575 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.434159 24613 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.549336 24656 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.701138 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:00.650698 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:00.701109 21002 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.655195 21034 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:18:00.702558 21034 pending_rounds.cc:85] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 6
I20260709 12:18:00.702865 21034 pending_rounds.cc:107] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:18:00.703112 21034 raft_consensus.cc:2889] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:00.625967 24606 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:00.670082 24735 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:00.651269 24602 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:00.687573 24731 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:00.713665 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.688061 21109 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:00.697237 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:00.645784 24727 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.564196 24534 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:00.703976 21029 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:00.704285 21031 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:18:00.705178 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 498594us
I20260709 12:18:00.706123 21035 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:18:00.705201 24613 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:00.666945 24733 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:18:00.688319 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.718924 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:00.720086 21036 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:00.670603 24742 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.776257 21741 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:00.776372 24582 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:00.777995 24742 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:00.724308 24602 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.713539 24606 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.779441 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:00.780340 24602 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.768278 21179 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:00.780867 24602 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.782305 21746 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:00.783207 24606 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:00.709853 24728 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:00.771122 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:00.708374 24656 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.730480 24569 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:00.724118 24645 consensus_queue.cc:1059] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:18:00.777904 24582 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:00.769379 24538 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.720042 24648 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:00.792555 21744 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:00.783192 24628 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.723563 24591 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:00.800490 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:00.801599 21740 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:00.795390 24728 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.803341 24538 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:18:00.800540 24647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.020s	sys 0.043s
I20260709 12:18:00.801833 24628 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.822748 24538 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:00.833212 24647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.021s	sys 0.044s
I20260709 12:18:00.858111 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 531) took 1280 ms. Trace:
I20260709 12:18:00.858541 21178 rpcz_store.cc:276] 0709 12:17:59.577521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.577722 (+   201us) service_pool.cc:224] Handling call
0709 12:17:59.578032 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:00.034746 (+456714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.857892 (+823146us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400200dd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:00.858052 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048655232}
I20260709 12:18:00.861516 24657 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.862025 24657 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.853070 24558 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:00.864754 24656 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.864967 24216 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.866302 24728 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:00.867955 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:00.852059 24662 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.873203 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.873966 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.873317 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:00.881003 24717 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:00.881489 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:00.882962 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:00.885027 24765 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:00.887220 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:00.887619 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.886624 21111 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:00.887894 21033 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:00.888835 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:00.888219 21102 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:00.889909 21184 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:00.890547 21149 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:00.888226 21105 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:00.894376 21712 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.898630 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.887812 24724 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.902315 21712 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:00.906383 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 187565us
I20260709 12:18:00.925362 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.898331 21149 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:00.899094 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 146239us
I20260709 12:18:00.927369 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.928481 21184 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:00.930999 21105 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:00.933348 21149 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:00.934101 21111 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:18:00.932395 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.899477 24726 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.901134 24729 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:00.900882 24216 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:00.940862 21102 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:00.934552 21111 pending_rounds.cc:85] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 3
I20260709 12:18:00.941516 21111 pending_rounds.cc:107] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:18:00.941797 21111 raft_consensus.cc:2889] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:00.939333 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:00.943403 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.945518 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.946862 21002 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.949030 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:00.953397 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.954031 21103 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:00.932296 24756 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:00.931541 24678 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:00.905473 24717 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:18:00.905337 24545 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:18:00.936064 24557 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:00.976814 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.937428 24558 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:00.976915 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:00.940172 24729 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:00.927908 24616 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:18:00.934051 24072 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:18:00.950192 24671 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.932466 24656 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:18:00.988049 21103 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:00.936321 24728 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:18:00.957489 24216 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:00.933699 24724 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.995360 21103 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:18:00.990201 24716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.216s	user 0.011s	sys 0.013s
I20260709 12:18:00.896194 24538 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:00.981680 24557 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:00.940742 24726 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:01.165704 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 216735us
W20260709 12:18:01.163997 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.990136 24729 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:01.120316 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.139822 21109 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:01.192873 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:01.199213 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.987068 24678 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:01.073060 24565 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:01.220127 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:01.193720 24662 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:01.207973 24561 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:01.208209 24770 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:18:01.061641 24771 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:01.005278 24612 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:01.123363 24769 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:18:00.995889 24671 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.207818 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1870) took 1868 ms. Trace:
W20260709 12:18:01.210618 24722 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:18:01.202430 24741 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.992506 24733 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:00.993942 24772 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:01.062825 24716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.291s	user 0.011s	sys 0.014s
I20260709 12:18:01.069208 24756 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:01.191020 24557 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:01.182862 24657 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:00.991588 24752 consensus_queue.cc:1059] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.216s
I20260709 12:18:01.266090 24752 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:01.266453 24752 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:01.193427 24216 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.267254 24752 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.248030 24561 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.268419 24752 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:01.260493 24735 consensus_meta.cc:287] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.003s
I20260709 12:18:01.269778 24735 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:00.996203 24558 raft_consensus.cc:697] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:01.271675 24615 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:01.271462 24558 consensus_queue.cc:237] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.272722 21185 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:01.108700 24680 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:01.273917 24680 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.274274 24680 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:01.238605 21077 leader_election.cc:400] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:01.275588 21077 leader_election.cc:403] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:01.139708 24538 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.241336 21186 rpcz_store.cc:276] 0709 12:17:59.339826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.340784 (+   958us) service_pool.cc:224] Handling call
0709 12:17:59.364769 (+ 23985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:00.573921 (+1209152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.573954 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:00.587580 (+ 13626us) log.cc:844] Serialized 26 byte log entry
0709 12:18:00.818951 (+231371us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:00.818995 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.202631 (+383636us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540021fa54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:01.202685 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:01.202733 (+    48us) raft_consensus.cc:1685] finished
0709 12:18:01.202746 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.207727 (+  4981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2780099968,"thread_start_us":230984,"threads_started":1,"wal-append.queue_time_us":265043}
I20260709 12:18:01.191977 24773 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:01.219449 24656 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.250572 24612 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:01.259461 24727 consensus_meta.cc:287] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 12:18:01.259925 24726 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:01.269729 24557 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.295744 24764 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:01.296615 24764 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:01.296980 24764 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:01.297801 24764 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.240965 24662 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.300165 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:01.301784 24726 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:01.301977 24662 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:01.271895 24735 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:01.260584 24783 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:01.303206 21182 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:01.255261 24733 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.305806 24733 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:01.256464 24756 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:01.263625 24613 consensus_meta.cc:287] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.500s	user 0.006s	sys 0.004s
I20260709 12:18:01.238770 24774 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.306932 24774 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.307736 24616 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:01.265221 24772 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:01.284932 24640 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:01.303076 24764 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:01.306387 24756 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:01.308543 24616 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:01.295231 24727 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.309186 24616 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:01.310039 24616 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.310874 24727 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:01.311515 21185 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:01.312978 24774 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:01.310993 24616 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:01.319893 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 197897us
I20260709 12:18:01.269791 24561 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:01.285166 24647 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:01.326915 24508 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:01.318485 24727 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.293812 24657 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:18:01.255440 24741 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.306543 24613 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.337039 24647 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:01.314393 24656 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.291682 24565 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:18:01.381443 24722 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.355628 24724 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:01.431056 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 212441us
I20260709 12:18:01.327087 24678 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.379123 24508 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.439417 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:01.440719 21177 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:01.383138 24727 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.443511 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:01.428756 24640 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:01.391575 24773 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:18:01.448302 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:01.449765 21177 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:01.450958 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:01.433499 24774 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.453249 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:01.453462 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:01.453280 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:01.454082 21181 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:01.454262 21179 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:01.455333 21151 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:01.433676 24561 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.459069 21027 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:01.433876 24733 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:01.450822 21178 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:01.437884 24735 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:01.437749 24716 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.461004 21035 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:01.454315 21177 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:01.461519 21029 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:01.461421 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:01.560422 21181 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:01.462492 21031 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:01.438602 24072 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:18:01.512665 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.433317 24722 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.495428 21030 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:01.491163 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:01.582088 21178 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:01.444482 24634 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:01.510102 24756 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.442795 24783 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.453877 24640 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.504189 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:01.493080 21077 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:01.502887 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:01.460498 24768 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.503898 24671 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:01.539891 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 228442us
I20260709 12:18:01.503487 24728 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:01.564006 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:01.544972 24782 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:18:01.411303 24612 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.465358 24774 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.493291 24733 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.492616 24561 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.505002 24735 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.459896 24647 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:01.912294 21741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 726) took 3106 ms (client timeout 2547 ms). Trace:
W20260709 12:18:01.747931 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.744599 21001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.002s	sys 0.035s
W20260709 12:18:02.046866 21036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.002s	sys 0.031s
W20260709 12:18:02.036731 21151 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.551s (SENT) [suppressed 21 similar messages]
I20260709 12:18:02.102128 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:02.102644 21036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.006s	sys 0.031s
I20260709 12:18:02.102807 21104 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
W20260709 12:18:02.102983 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 66286.7us
I20260709 12:18:02.103236 24753 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:01.538187 24545 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:02.104094 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:02.045360 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.737345 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 423756us
I20260709 12:18:02.116786 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:02.030359 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:01.999158 24785 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.569s	user 0.001s	sys 0.000s
I20260709 12:18:02.118106 21030 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:01.766868 21178 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:01.645026 21181 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:02.120172 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.120896 21104 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
W20260709 12:18:01.589179 24779 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:18:01.589525 21177 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:02.098553 21107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.008s	sys 0.012s
W20260709 12:18:02.128423 21107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.008s	sys 0.012s
W20260709 12:18:01.833539 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.606446 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 384779us
W20260709 12:18:02.098352 21180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.003s	sys 0.016s
W20260709 12:18:02.100806 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 607754us
W20260709 12:18:02.130877 21180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.004s	sys 0.016s
W20260709 12:18:02.109171 21001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.005s	sys 0.035s
I20260709 12:18:02.109493 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.132490 21029 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:02.035061 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.099834 21034 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:02.109426 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:02.056808 24754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.004s	sys 0.004s
W20260709 12:18:01.915762 24789 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 12:18:02.146340 21179 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:01.926769 24756 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:01.954787 24680 consensus_meta.cc:287] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.000s
W20260709 12:18:02.001334 24790 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:18:01.930794 21150 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:02.112003 24791 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.568s	user 0.000s	sys 0.001s
I20260709 12:18:02.047806 24758 raft_consensus.cc:2243] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.134538 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:02.209520 24758 raft_consensus.cc:2272] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:02.212038 24615 consensus_meta.cc:287] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.940s	user 0.008s	sys 0.002s
I20260709 12:18:02.214041 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1801) took 1263 ms. Trace:
I20260709 12:18:02.214466 21106 rpcz_store.cc:276] 0709 12:18:00.950462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.989691 (+ 39229us) service_pool.cc:224] Handling call
0709 12:18:01.070071 (+ 80380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.070453 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.070484 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.108647 (+ 38163us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.404024 (+295377us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:01.404087 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.404169 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.213813 (+809644us) raft_consensus.cc:1685] finished
0709 12:18:02.213837 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.213976 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2083,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":18471,"thread_start_us":219794,"threads_started":1,"wal-append.queue_time_us":285764}
I20260709 12:18:02.218699 24668 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.219154 24662 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:02.219601 24662 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:02.220400 24662 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.221398 24662 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:02.049906 24656 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.147742 21035 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:02.212862 24758 ts_tablet_manager.cc:1916] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:18:01.926949 24784 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
I20260709 12:18:01.969631 24558 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:02.223115 24558 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:01.588541 24716 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.110982 24719 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:02.225021 24719 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.225394 24719 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:02.007066 24742 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:02.050649 24727 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:01.896925 24613 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:01.925487 24508 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:01.928056 24722 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:02.033406 24741 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:02.122193 24752 consensus_meta.cc:287] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.853s	user 0.011s	sys 0.001s
W20260709 12:18:02.144001 24754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.005s	sys 0.005s
I20260709 12:18:02.125279 24647 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:02.247459 24729 consensus_meta.cc:287] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 1.010s	user 0.009s	sys 0.001s
I20260709 12:18:02.247915 24729 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.255443 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1791) took 1322 ms. Trace:
I20260709 12:18:02.255921 21105 rpcz_store.cc:276] 0709 12:18:00.932843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.934251 (+  1408us) service_pool.cc:224] Handling call
0709 12:18:00.934618 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:00.935531 (+   913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.935558 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:00.936004 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.215997 (+279993us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:01.216039 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.216105 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.255162 (+1039057us) raft_consensus.cc:1685] finished
0709 12:18:02.255188 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.255367 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24390,"raft.queue_time_us":505,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":13439,"thread_start_us":234790,"threads_started":1,"wal-append.queue_time_us":407108}
I20260709 12:18:02.258044 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.118745 24783 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:02.256130 24764 consensus_meta.cc:287] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.926s	user 0.006s	sys 0.004s
I20260709 12:18:02.258670 21105 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:02.261020 24783 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:02.176348 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:01.638105 24634 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:02.180209 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.103297 24746 consensus_queue.cc:1059] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:18:02.263980 24746 raft_consensus.cc:3055] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:02.182826 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 78814.1us
I20260709 12:18:02.122949 24612 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:02.183391 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1793) took 1245 ms. Trace:
I20260709 12:18:02.239352 24628 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.264384 24746 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:02.267730 24746 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.126072 24648 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 12:18:02.118875 24743 consensus_queue.cc:1175] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" responder_term: 10 status { last_received { term: 9 index: 6 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:02.184314 21029 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:18:02.232776 24608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.017s	sys 0.009s
I20260709 12:18:02.134334 24753 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:02.008982 24731 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.084175 24777 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:18:02.100109 21741 rpcz_store.cc:269] 0709 12:17:58.773016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.773124 (+   108us) service_pool.cc:224] Handling call
0709 12:18:01.879518 (+3106394us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b54006a77d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:01.879650 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4385209216}
W20260709 12:18:02.196664 21710 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.024s	sys 0.040s
W20260709 12:18:02.311730 21710 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.024s	sys 0.040s
I20260709 12:18:02.233501 24742 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:02.208252 24773 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:02.138211 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.220791 24671 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:02.219285 24668 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:01.927184 24730 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:02.229538 21102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.013s	sys 0.018s
I20260709 12:18:02.231741 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:02.234694 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 303975us
I20260709 12:18:02.236024 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:01.925276 21737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 511) took 2458 ms. Trace:
I20260709 12:18:02.240767 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1795) took 1297 ms. Trace:
W20260709 12:18:02.248282 24616 consensus_meta.cc:287] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.916s	user 0.009s	sys 0.001s
I20260709 12:18:02.264158 24634 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.339730 21035 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:02.266582 21108 rpcz_store.cc:276] 0709 12:18:00.938221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.938378 (+   157us) service_pool.cc:224] Handling call
0709 12:18:00.938668 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:00.939016 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.939043 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:00.939487 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.237890 (+298403us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:01.237937 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.238011 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.183178 (+945167us) raft_consensus.cc:1685] finished
0709 12:18:02.183198 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.183326 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1554,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5189,"thread_start_us":239115,"threads_started":1,"wal-append.queue_time_us":410891}
I20260709 12:18:02.341137 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:02.123358 24216 consensus_queue.cc:1175] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 11 status { last_received { term: 10 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:02.183560 24795 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.266388 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:02.322409 24630 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:02.280040 24072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.028s
I20260709 12:18:02.184973 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1855) took 1300 ms. Trace:
W20260709 12:18:02.303746 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 104555us
W20260709 12:18:02.256242 24538 consensus_meta.cc:287] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.961s	user 0.005s	sys 0.005s
I20260709 12:18:02.111433 24768 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.315402 24653 consensus_queue.cc:1059] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:18:02.256074 24774 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.317507 21075 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:02.266399 24728 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:02.307153 24608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.017s	sys 0.009s
W20260709 12:18:02.326470 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.308228 24789 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:18:02.321967 21031 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:02.331717 21111 rpcz_store.cc:276] 0709 12:18:00.943748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.944064 (+   316us) service_pool.cc:224] Handling call
0709 12:18:00.944390 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:00.957396 (+ 13006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.957429 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:00.957911 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.181017 (+223106us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:01.181140 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.181284 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.240559 (+1059275us) raft_consensus.cc:1685] finished
0709 12:18:02.240577 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.240699 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10274,"raft.queue_time_us":38019,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4298,"thread_start_us":221863,"threads_started":1,"wal-append.queue_time_us":293956}
I20260709 12:18:02.344847 24616 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:02.352650 24722 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:02.366959 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.337116 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:02.337545 21102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.014s	sys 0.019s
I20260709 12:18:02.370213 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:02.338073 21033 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:02.229323 24680 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:02.370755 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 254041us
I20260709 12:18:02.313630 24746 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:02.342483 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 212478us
I20260709 12:18:02.315191 24756 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.321161 24729 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:02.306641 24647 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:02.345331 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.197461 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:02.405879 21030 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:02.346936 21110 rpcz_store.cc:276] 0709 12:18:00.884836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.888655 (+  3819us) service_pool.cc:224] Handling call
0709 12:18:00.903600 (+ 14945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:00.903943 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.903972 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:00.904436 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.143153 (+238717us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:01.143198 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.143279 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.184763 (+1041484us) raft_consensus.cc:1685] finished
0709 12:18:02.184784 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.184913 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23084,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5541,"thread_start_us":238373,"threads_started":1,"wal-append.queue_time_us":370739}
W20260709 12:18:02.345813 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 79484.9us
I20260709 12:18:02.383375 24648 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:02.343258 24617 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:02.315131 24753 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.341143 24751 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:02.346750 24072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.009s	sys 0.028s
I20260709 12:18:02.363715 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:02.423372 21111 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:02.331187 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.326831 24777 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:02.364915 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 47493.6us
I20260709 12:18:02.371963 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:02.336077 21737 rpcz_store.cc:276] 0709 12:17:59.466368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.466515 (+   147us) service_pool.cc:224] Handling call
0709 12:18:00.534583 (+1068068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:00.547832 (+ 13249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.924982 (+1377150us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400791150. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:01.925159 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2455597440}
I20260709 12:18:02.375756 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:02.376888 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:02.383219 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:02.429034 21741 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:02.367146 24774 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.353682 24630 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.421954 24735 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:02.393390 21027 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:02.369763 24722 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:02.443717 24722 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:02.444559 24630 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:02.445216 24774 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.372949 24764 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:02.394619 24822 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.446389 24764 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.446576 24822 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:02.447351 24800 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:18:02.448160 24809 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:18:02.448843 24822 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.371461 24741 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:02.449842 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2343) took 1012 ms. Trace:
I20260709 12:18:02.421660 24640 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.449923 24741 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:02.450821 24807 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:18:02.416663 24756 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.373174 24752 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.452033 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1861) took 1252 ms. Trace:
I20260709 12:18:02.452461 24741 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:02.452625 24756 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:02.373433 24730 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:02.452925 24777 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:02.401042 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 470) took 2450 ms. Trace:
I20260709 12:18:02.453305 24730 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.378799 24728 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:02.406549 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:02.407814 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:02.454821 21108 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:02.455233 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 47502.2us
I20260709 12:18:02.328624 24803 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:02.457756 24803 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.418288 24648 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:02.353030 24795 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.420111 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:02.380345 24606 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:18:02.425040 24668 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:02.425231 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.486210 21110 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:02.379242 24538 consensus_queue.cc:1059] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:18:02.432217 21742 raft_consensus.cc:2393] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:02.432533 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:02.488865 21031 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:02.436070 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:02.489646 21035 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:02.439831 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:02.439829 21033 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:18:02.490973 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:02.491564 21033 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:02.491899 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.441653 24719 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.453040 24752 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:02.453948 24801 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:02.373307 24615 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:02.452391 21102 rpcz_store.cc:276] 0709 12:18:01.201207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.412613 (+211406us) service_pool.cc:224] Handling call
0709 12:18:01.412991 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.428800 (+ 15809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.428830 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.429227 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 12:18:02.370548 (+941321us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:02.370586 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.370659 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.451836 (+ 81177us) raft_consensus.cc:1685] finished
0709 12:18:02.451853 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.451974 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15399,"raft.queue_time_us":16066,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6241,"thread_start_us":922020,"threads_started":1,"wal-append.queue_time_us":904888}
I20260709 12:18:02.471048 24764 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:02.471908 24640 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:02.469909 24741 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:02.462671 21107 rpcz_store.cc:276] 0709 12:17:59.922499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.922626 (+   127us) service_pool.cc:224] Handling call
0709 12:17:59.923043 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:59.967576 (+ 44533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:59.967608 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:59.968077 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.501444 (+1533367us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b180002bba0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b 00007fcb9f533d23 00007fcb9f5340d1 00007fcb9f94fa0f
0709 12:18:02.128886 (+627442us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:02.178757 (+ 49871us) log.cc:844] Serialized 14 byte log entry
0709 12:18:02.343074 (+164317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.344638 (+  1564us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.357581 (+ 12943us) raft_consensus.cc:1685] finished
0709 12:18:02.372306 (+ 14725us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.372506 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24241,"prepare.queue_time_us":43310,"prepare.run_cpu_time_us":7649,"prepare.run_wall_time_us":10783,"raft.queue_time_us":70711,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":12785,"spinlock_wait_cycles":65837312,"thread_start_us":780389,"threads_started":2,"wal-append.queue_time_us":2224452}
I20260709 12:18:02.485739 24072 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:02.471473 21030 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
W20260709 12:18:02.472261 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 97059.3us
I20260709 12:18:02.405570 24647 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:02.369273 24742 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.429338 24751 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:02.500829 21033 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:02.459265 24648 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:02.505203 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.468322 21108 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:02.535367 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.536068 21108 raft_consensus.cc:2393] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:02.536358 21181 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:18:02.505723 21034 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:02.536876 21184 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:18:02.537844 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:02.518978 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 119216us
I20260709 12:18:02.507709 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.539855 21110 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:18:02.469029 21111 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:02.470142 21744 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:18:02.541096 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.450261 21186 rpcz_store.cc:276] 0709 12:18:01.437086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.437241 (+   155us) service_pool.cc:224] Handling call
0709 12:18:01.445589 (+  8348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.445962 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.445992 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.446529 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.775249 (+328720us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:02.114518 (+339269us) log.cc:844] Serialized 14 byte log entry
0709 12:18:02.125022 (+ 10504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.125146 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.449631 (+324485us) raft_consensus.cc:1685] finished
0709 12:18:02.449655 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.449783 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27039,"prepare.queue_time_us":579238,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2793,"raft.queue_time_us":12254,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":33140,"thread_start_us":547700,"threads_started":2,"wal-append.queue_time_us":833114}
I20260709 12:18:02.532505 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2469) took 1077 ms. Trace:
I20260709 12:18:02.545148 21179 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:02.546171 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:02.546506 21031 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:18:02.490712 24728 raft_consensus.cc:3055] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:02.530529 21103 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:02.533475 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.558408 21030 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:02.543322 21032 rpcz_store.cc:276] 0709 12:18:01.454963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.455080 (+   117us) service_pool.cc:224] Handling call
0709 12:18:01.539815 (+ 84735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.545942 (+  6127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.545979 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:02.048469 (+502490us) log.cc:844] Serialized 26 byte log entry
0709 12:18:02.316422 (+267953us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:02.316459 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.316524 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.532308 (+215784us) raft_consensus.cc:1685] finished
0709 12:18:02.532327 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.532449 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34595,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":32618,"thread_start_us":267133,"threads_started":1,"wal-append.queue_time_us":323330}
I20260709 12:18:02.536779 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.561079 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.562140 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:02.562744 21179 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:18:02.562947 21108 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:02.563634 21111 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:18:02.556102 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.513628 24640 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.565150 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.565408 21178 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:02.577399 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.577162 21029 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:02.577214 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:02.515413 24826 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:02.580427 21180 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:18:02.567860 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:02.582054 21183 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:02.582592 21184 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:02.583554 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:02.584162 21186 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:02.545267 24818 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.575804 24538 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.512630 24615 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.563634 24774 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.593672 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.561564 24742 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:02.609917 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:02.610579 21179 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:18:02.595193 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:02.595664 24825 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:18:02.597002 24647 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:02.599351 24819 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:18:02.599642 21183 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:02.600440 24803 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:02.601693 24730 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.591574 24831 consensus_queue.cc:1059] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:18:02.557924 24728 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:02.603091 21034 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:02.624511 24728 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.625217 24615 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.578995 24640 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:02.532618 24741 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.632428 24741 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.610482 24768 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.606377 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:02.611570 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:02.634577 21184 raft_consensus.cc:2393] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:02.546274 24072 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.586680 24820 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:02.617158 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:02.607903 24538 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.610000 24830 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.621881 21186 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:02.623060 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.629628 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:02.605348 24751 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.645205 24648 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:02.646126 24753 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.610946 24818 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.587271 24826 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.916697 21110 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
W20260709 12:18:02.651140 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.689740 24632 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:02.623752 24812 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.295s
W20260709 12:18:02.863296 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 750195us
I20260709 12:18:02.779932 21035 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:02.651762 24752 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:02.917740 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.691751 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:02.650497 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:02.806691 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.864440 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2478) took 1406 ms. Trace:
I20260709 12:18:02.927662 21028 rpcz_store.cc:276] 0709 12:18:01.458319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.458430 (+   111us) service_pool.cc:224] Handling call
0709 12:18:01.458685 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:02.268813 (+810128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.268844 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:02.268890 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:02.268925 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.864169 (+595244us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54000811d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:02.864220 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.864376 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862634880}
I20260709 12:18:02.896322 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2344) took 1458 ms. Trace:
I20260709 12:18:02.931393 21182 rpcz_store.cc:276] 0709 12:18:01.437406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.437707 (+   301us) service_pool.cc:224] Handling call
0709 12:18:01.450614 (+ 12907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:02.125850 (+675236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.125878 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:02.125918 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:02.125955 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.896026 (+770071us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54000bead4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:02.896087 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.896245 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552405888}
W20260709 12:18:02.863765 21109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1856) took 1978 ms (client timeout 1996 ms). Trace:
I20260709 12:18:02.923362 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:02.946250 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.945817 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:02.917972 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.917516 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:02.837543 24662 consensus_meta.cc:287] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.000s
I20260709 12:18:02.648279 24764 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:03.093804 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.059212 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.130690 21712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.029s	sys 0.043s
I20260709 12:18:02.953668 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:03.534539 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1647) took 1154 ms. Trace:
W20260709 12:18:03.307468 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.002701 21000 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:02.826905 24569 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:02.885591 24758 ts_tablet_manager.cc:1929] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:18:02.652208 24831 raft_consensus.cc:3055] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:18:03.534677 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.674629 24793 log.cc:927] Time spent T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:18:03.534078 21712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.043s	sys 0.069s
W20260709 12:18:03.521363 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.954187 21029 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:02.651394 24832 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:03.129124 24508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.012s
W20260709 12:18:03.566435 21034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2482) took 2103 ms (client timeout 2434 ms). Trace:
W20260709 12:18:03.641117 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.687909 21034 rpcz_store.cc:269] 0709 12:18:01.463087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.133487 (+670400us) service_pool.cc:224] Handling call
0709 12:18:03.566227 (+1432740us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540027ea54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:03.566360 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560833408}
I20260709 12:18:03.559989 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1806) took 1457 ms. Trace:
I20260709 12:18:03.688899 21106 rpcz_store.cc:276] 0709 12:18:02.102503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.216158 (+113655us) service_pool.cc:224] Handling call
0709 12:18:02.216524 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:02.472698 (+256174us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:02.581638 (+108940us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.031810 (+450172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:03.031871 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:03.031925 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.559693 (+527768us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54003692d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:03.559749 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.559920 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112475,"prepare.queue_time_us":154579,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":117262,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4112,"spinlock_wait_cycles":588600576,"thread_start_us":413316,"threads_started":2,"wal-append.queue_time_us":336853}
W20260709 12:18:03.642006 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 639354us
I20260709 12:18:03.691453 21000 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:03.003595 21030 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:18:03.642627 21109 rpcz_store.cc:269] 0709 12:18:00.885126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.891166 (+  6040us) service_pool.cc:224] Handling call
0709 12:18:02.863505 (+1972339us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400253ad4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:02.863678 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549497728}
I20260709 12:18:03.647099 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:03.589545 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:03.692559 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1638) took 1323 ms. Trace:
I20260709 12:18:03.692975 21030 rpcz_store.cc:276] 0709 12:18:02.369391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.915992 (+546601us) service_pool.cc:224] Handling call
0709 12:18:03.001611 (+ 85619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:03.692228 (+690617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.692502 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:03.534996 21031 rpcz_store.cc:276] 0709 12:18:02.399157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.697250 (+298093us) service_pool.cc:224] Handling call
0709 12:18:03.534482 (+837232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:03.568357 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1808) took 1465 ms. Trace:
I20260709 12:18:03.694339 21103 rpcz_store.cc:276] 0709 12:18:02.103047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.238439 (+135392us) service_pool.cc:224] Handling call
0709 12:18:02.238793 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:02.563690 (+324897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.568065 (+1004375us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400181354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:03.568286 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670183808}
W20260709 12:18:03.652587 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 728454us
I20260709 12:18:03.162901 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:03.696135 21110 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
W20260709 12:18:03.651360 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.698057 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.163071 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:03.282301 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1805) took 1180 ms. Trace:
I20260709 12:18:03.699385 21104 rpcz_store.cc:276] 0709 12:18:02.102239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.121475 (+ 19236us) service_pool.cc:224] Handling call
0709 12:18:02.121808 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:02.140242 (+ 18434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.140276 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:02.140766 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:18:02.367036 (+226270us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:02.367070 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.250532 (+883462us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5400137ed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:03.250586 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:03.250643 (+    57us) raft_consensus.cc:1685] finished
0709 12:18:03.250657 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.282198 (+ 31541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41750784,"thread_start_us":110351,"threads_started":1,"wal-append.queue_time_us":271818,"wal-append.run_cpu_time_us":1845,"wal-append.run_wall_time_us":1110156}
W20260709 12:18:03.472088 21181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.000s	sys 0.012s
I20260709 12:18:02.674345 24647 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:02.651122 24834 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.959080 24680 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.935501 24671 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:03.680239 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 1.10211e+06us
I20260709 12:18:03.544850 21740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 498) took 1152 ms. Trace:
I20260709 12:18:03.133410 24733 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:03.746752 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:03.747104 24733 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.648846 24072 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:03.408414 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.679848 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1642) took 1309 ms. Trace:
I20260709 12:18:03.707693 24834 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:03.748072 21029 rpcz_store.cc:276] 0709 12:18:02.370190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.917944 (+547754us) service_pool.cc:224] Handling call
0709 12:18:02.953836 (+ 35892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:03.679513 (+725677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.679781 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:02.937163 24728 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.256165 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:03.749526 24834 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:02.954128 24768 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.796s
I20260709 12:18:03.686272 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:03.555774 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2480) took 2095 ms. Trace:
W20260709 12:18:03.686935 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.750771 21743 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:03.750825 21027 rpcz_store.cc:276] 0709 12:18:01.461894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.462203 (+   309us) service_pool.cc:224] Handling call
0709 12:18:01.462448 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:02.443416 (+980968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.555438 (+1112022us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54003d3bd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:03.555702 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140284288}
W20260709 12:18:03.688640 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.686496 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:03.212680 24653 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.005028 21108 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:18:03.759452 21108 pending_rounds.cc:85] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 6
I20260709 12:18:03.759771 21108 pending_rounds.cc:107] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:18:03.760068 21108 raft_consensus.cc:2889] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:03.701113 21181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.000s	sys 0.013s
W20260709 12:18:03.129114 24678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.621s	user 0.020s	sys 0.020s
I20260709 12:18:03.059829 24741 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.797848 24722 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.081029 24615 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:03.074076 24557 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:03.556409 24823 raft_consensus.cc:3055] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:02.943938 24727 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.080809 24730 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:03.669564 24575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.898s	user 0.015s	sys 0.029s
I20260709 12:18:03.059770 24617 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:03.001057 24648 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:03.003147 24756 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.869179 24640 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.540242 24216 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:03.803063 24216 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:03.805189 24216 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:03.805845 21102 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:03.370441 24826 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:03.809423 24668 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:03.809943 24668 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.656366 24731 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.707773 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:03.675408 24565 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:03.656052 24569 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:03.628523 24751 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:03.708112 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:03.820523 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 112833us
I20260709 12:18:03.655164 24831 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:02.920496 24612 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:03.740944 24206 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.137259 24558 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:02.945428 24820 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:03.740242 21740 rpcz_store.cc:276] 0709 12:18:02.392187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.392389 (+   202us) service_pool.cc:224] Handling call
0709 12:18:02.417322 (+ 24933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:02.459594 (+ 42272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.459624 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:02.459666 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:02.459696 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.544589 (+1084893us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b54006d83d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:03.544636 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.544785 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96741632}
I20260709 12:18:03.743206 21183 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:03.743919 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:03.705812 24752 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.745270 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:03.708472 24753 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:03.705981 24718 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:03.746243 24613 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.868858 24613 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.869581 24668 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:03.870150 24668 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:02.937369 24830 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:03.823563 24616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.430s	user 0.011s	sys 0.016s
I20260709 12:18:03.584494 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:03.616700 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:03.870458 24569 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.655184 24582 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:03.857388 24837 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:03.082685 24538 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:03.030407 24632 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:03.132591 24628 raft_consensus.cc:3055] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:03.686691 24758 log.cc:1199] T f16c07bcae284f65a7c0ee0375e00769 P 3ed9deaeb4014e9d87aeebbc6384f81f: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/wals/f16c07bcae284f65a7c0ee0375e00769
I20260709 12:18:03.766022 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:02.953722 24754 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.766s
I20260709 12:18:03.768500 21744 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
W20260709 12:18:03.688060 24508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.015s	sys 0.021s
I20260709 12:18:03.772308 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1903) took 1122 ms. Trace:
I20260709 12:18:03.937988 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:03.744607 24680 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:03.767057 24678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.259s	user 0.028s	sys 0.044s
I20260709 12:18:03.791458 21709 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:03.941690 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 298326us
W20260709 12:18:03.942140 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 150760us
I20260709 12:18:03.798835 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:03.791929 24795 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:03.797348 24575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.024s	user 0.016s	sys 0.030s
I20260709 12:18:03.801702 24756 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.594592 20932 catalog_manager.cc:5697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 7, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 7 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:03.955030 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:03.793179 24823 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:03.703701 24832 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:03.758483 24671 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.875800 24753 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.855922 21186 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 5.
I20260709 12:18:03.861030 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 480) took 1222 ms. Trace:
I20260709 12:18:03.967317 21108 rpcz_store.cc:276] 0709 12:18:02.639057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.639222 (+   165us) service_pool.cc:224] Handling call
0709 12:18:02.639523 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:03.760570 (+1121047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.860786 (+100216us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400229054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:03.860967 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839660928}
I20260709 12:18:03.776048 24733 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:03.865904 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1863) took 1590 ms. Trace:
I20260709 12:18:03.968457 21102 rpcz_store.cc:276] 0709 12:18:02.275925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.546348 (+270423us) service_pool.cc:224] Handling call
0709 12:18:02.546655 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:03.806240 (+1259585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.865635 (+ 59395us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540031c754. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:03.865839 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2895243136}
I20260709 12:18:03.819967 24565 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.778462 24741 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.797194 24730 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.795033 24615 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:02.934942 24780 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.769s
I20260709 12:18:03.270468 24772 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.797699 24727 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:03.876482 24602 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.094s	user 0.091s	sys 0.120s
I20260709 12:18:03.658560 21149 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:03.813107 24617 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:03.870965 24613 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:03.875258 24616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.011s	sys 0.016s
I20260709 12:18:03.858732 24206 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:03.854278 24648 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.933128 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:04.003364 21027 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:18:03.888962 24582 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:04.000221 24602 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.218s	user 0.091s	sys 0.120s
I20260709 12:18:04.004243 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:03.934484 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:03.935281 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:03.936314 21034 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:03.936452 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:03.937039 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:03.938764 21031 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:03.855156 24612 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:03.945015 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:04.016248 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 71294.8us
I20260709 12:18:03.943190 21746 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:03.878744 24834 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:03.933951 24632 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:03.938943 21181 rpcz_store.cc:276] 0709 12:18:02.649689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.653521 (+  3832us) service_pool.cc:224] Handling call
0709 12:18:02.653827 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:02.654030 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:02.654331 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.771965 (+1117634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:03.772023 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:03.772075 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.772141 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.772254 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":97789,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7579,"thread_start_us":1106509,"threads_started":1,"wal-append.queue_time_us":1068878}
I20260709 12:18:03.889376 24569 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:03.956020 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:03.938479 24842 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:18:03.872473 24752 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.958087 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:03.893842 24538 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.892763 24837 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:03.892150 24628 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:03.772758 24653 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.879316 24718 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:03.965782 21744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32986 (request call id 522) took 1050 ms. Trace:
W20260709 12:18:03.959654 24806 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 12:18:01.355793 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:53704 (local address 127.19.108.4:35157)
0709 12:18:02.455190 (+1099397us) server_negotiation.cc:207] Beginning negotiation
0709 12:18:02.455237 (+    47us) server_negotiation.cc:400] Waiting for connection header
0709 12:18:02.455295 (+    58us) server_negotiation.cc:408] Connection header received
0709 12:18:02.455475 (+   180us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 12:18:02.455504 (+    29us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 12:18:02.455827 (+   323us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 12:18:02.456046 (+   219us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0709 12:18:02.919283 (+463237us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0709 12:18:03.251381 (+332098us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0709 12:18:03.610700 (+359319us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53704: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":1001090,"thread_start_us":908178,"threads_started":1}
W20260709 12:18:03.962531 24759 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 12:18:00.166465 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.19.108.4:35157 (local address 127.0.0.1:53704)
0709 12:18:00.561934 (+395469us) negotiation.cc:107] Waiting for socket to connect
0709 12:18:00.562003 (+    69us) client_negotiation.cc:175] Beginning negotiation
0709 12:18:00.562525 (+   522us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 12:18:02.458992 (+1896467us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0709 12:18:02.459045 (+    53us) client_negotiation.cc:404] Received NEGOTIATE response from server
0709 12:18:02.459159 (+   114us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0709 12:18:02.688146 (+228987us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 12:18:02.690026 (+  1880us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 12:18:03.611371 (+921345us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.19.108.4:35157: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":324390,"thread_start_us":57653,"threads_started":1}
I20260709 12:18:03.995463 24565 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:04.002128 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 343613us
I20260709 12:18:04.055025 21149 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:03.957731 24795 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:03.952831 24680 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.014395 24648 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.002061 24772 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.040048 24678 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.928385 24831 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.002657 24616 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:04.035404 21743 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:04.015586 24613 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:04.020726 24668 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.024724 24764 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.046976 21744 rpcz_store.cc:276] 0709 12:18:02.915134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.915261 (+   127us) service_pool.cc:224] Handling call
0709 12:18:03.965588 (+1050327us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001effd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:03.965707 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254232320}
I20260709 12:18:04.028946 24848 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:04.037416 24846 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:04.047981 24845 log.cc:927] Time spent T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:18:04.024578 24851 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:18:04.061125 24617 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.033548 24754 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:18:04.052071 24722 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.029729 24834 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.059453 24758 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59982 (request call id 87) took 3994 ms. Trace:
I20260709 12:18:04.061127 24727 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.029613 24823 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.150130 24730 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.149953 24823 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.151532 24648 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.153033 24582 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.153604 24752 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.154078 24719 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.071349 24678 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.156203 24678 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:04.156968 24834 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.157145 24753 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.083885 24852 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:04.157811 24756 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.080809 24831 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.091221 24628 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.160012 24671 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:04.160104 24628 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:04.160640 24852 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.090276 24764 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:18:04.087360 24846 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.163909 24846 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.162778 24852 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.164500 24718 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.061532 24795 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.078472 24613 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.084239 24668 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.157763 24733 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.083909 24848 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:04.167446 24848 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:04.167240 24795 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.142913 24830 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.168936 24668 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.142100 24837 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.147820 24632 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.148099 24680 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.169854 24640 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.124245 24617 consensus_queue.cc:1059] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:18:04.152948 24772 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.167135 24716 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:03.995491 20932 catalog_manager.cc:5697] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:04.006418 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 70040.9us
I20260709 12:18:04.000550 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:04.007895 21033 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:04.013288 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:04.009065 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 303774us
I20260709 12:18:04.057026 21149 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:04.028447 21151 connection.cc:256] RPC call timeout handler was delayed by -1.1173929550000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 12:18:04.064303 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.066279 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.065675 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.063046 21712 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:04.073061 24558 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:04.044762 24538 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.081526 24561 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:04.148643 24612 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.173223 24640 raft_consensus.cc:3055] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:04.218830 21000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.003s	sys 0.002s
I20260709 12:18:04.299410 24640 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:04.147873 24615 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:04.301007 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 609693us
W20260709 12:18:04.218600 20999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.005s
W20260709 12:18:04.302186 20999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.002s	sys 0.005s
I20260709 12:18:04.301503 24640 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.303678 24640 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:04.158548 24616 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.171710 24613 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:04.221275 21029 raft_consensus.cc:2376] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10. Re-sending same reply.
I20260709 12:18:04.222429 21032 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
W20260709 12:18:04.235114 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.224993 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:18:04.307914 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 83266us
I20260709 12:18:04.299768 24612 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:04.219652 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.311236 24612 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.311637 24612 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:04.243233 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 286396us
I20260709 12:18:04.313117 21076 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:04.313742 24615 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:04.256170 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 199095us
I20260709 12:18:04.315456 24632 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:04.314481 24615 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:04.260006 21151 connection.cc:256] RPC call timeout handler was delayed by -1.1047929549999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 12:18:04.320065 21151 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:04.215818 20932 catalog_manager.cc:5697] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 8, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 8 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:04.320991 24615 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.270146 21185 raft_consensus.cc:2410] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:04.270833 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:04.323633 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.279896 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 216778us
I20260709 12:18:04.270566 21184 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:04.269555 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.280661 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.281069 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:04.327756 21746 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:04.283664 24558 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:04.329295 24558 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.282298 24072 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:18:04.292143 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.284765 24216 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:04.332002 21739 raft_consensus.cc:2410] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:04.332968 21186 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.333262 24072 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:04.338459 21149 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:04.339355 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.222668 21036 raft_consensus.cc:2410] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:18:04.327771 21738 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:18:04.250499 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.222426 21035 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:18:04.345379 24668 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:04.269439 21181 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:04.348588 24668 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:04.285902 24561 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:04.297947 24565 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:04.256688 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 190932us
I20260709 12:18:04.281447 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.240818 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:04.321703 20932 catalog_manager.cc:5697] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 5, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 5 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:04.157927 24822 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.149312 24832 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.281566 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.284231 24206 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.321727 24615 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:04.175642 24820 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:04.382798 21000 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:04.385315 24846 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.398015 21744 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:04.386408 24751 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.399230 24851 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:04.388132 24615 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.400324 24615 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:04.372282 24795 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:04.387053 24754 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.403347 24795 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:04.404695 24795 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.404960 24848 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.388757 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:04.366982 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.389731 24822 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.403637 24727 consensus_queue.cc:1059] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:18:04.404359 24754 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.288436 24557 consensus_queue.cc:1059] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:18:04.371090 24565 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.371223 24772 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:04.142410 24758 rpcz_store.cc:276] 0709 12:18:00.083044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.131839 (+ 48795us) service_pool.cc:224] Handling call
0709 12:18:00.451046 (+319207us) ts_tablet_manager.cc:1151] Deleting tablet f16c07bcae284f65a7c0ee0375e00769
0709 12:18:00.496220 (+ 45174us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:18:02.718534 (+2222314us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:02.885430 (+166896us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:04.056745 (+1171315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1367157,"tablet-delete.queue_time_us":255143,"thread_start_us":52394,"threads_started":1}
I20260709 12:18:04.380256 24716 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:04.381669 24856 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:04.399641 24751 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.286324 24538 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.389873 21747 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:04.408914 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 104032us
I20260709 12:18:04.389034 21746 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:04.363981 21186 raft_consensus.cc:2410] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:04.398737 21000 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:04.399720 24851 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.404009 20932 catalog_manager.cc:5697] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 8, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 8 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
W20260709 12:18:04.422395 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 181965us
I20260709 12:18:04.427254 24846 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.429453 24754 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.384593 24863 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:04.443423 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.444880 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 47354.7us
I20260709 12:18:04.448832 24671 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.449182 24538 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.398893 24728 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:18:04.449672 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 61133.4us
I20260709 12:18:04.449826 24565 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:04.449898 24538 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.451141 24848 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:04.451974 24716 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.452737 24538 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.453994 24751 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.454460 24716 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.446691 24772 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.455097 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:04.384119 24859 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.459489 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.463241 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.443292 24753 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:04.463841 20932 catalog_manager.cc:5697] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 7, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 7 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:04.465197 21075 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:04.447140 24863 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:04.446883 24851 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:04.477552 24818 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.477954 24613 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:04.473556 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 74942.5us
I20260709 12:18:04.474020 24754 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.482448 24615 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.474670 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.483795 21746 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:18:04.449434 24671 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.475675 24538 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.486057 24856 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:04.488629 24615 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.408296 24733 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:18:04.394820 24612 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.449177 24877 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:18:04.495361 21737 raft_consensus.cc:2410] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:18:04.477006 21075 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:04.507663 24863 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.509225 24741 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.509934 24741 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.512658 24772 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.449409 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:04.514309 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 65120.8us
I20260709 12:18:04.515134 24772 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:04.517464 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.517675 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:04.518469 20920 catalog_manager.cc:5028] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): tablet f16c07bcae284f65a7c0ee0375e00769 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:18:04.519084 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.519336 24565 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:04.519737 24565 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.520093 24565 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:04.514644 20932 catalog_manager.cc:5697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:04.527618 24859 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.521690 24612 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.470552 24561 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:18:04.534947 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 196632us
I20260709 12:18:04.510504 24741 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.528928 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:04.546550 20919 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aaaf493e892d4ee9839b45b601fc8400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a1b891e53adc40a6a1ae813238321e93 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:04.550622 21740 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:04.530771 24733 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:04.552428 24615 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:04.527937 24856 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:04.554092 24733 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.584231 24859 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.585435 24561 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.586439 24733 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:04.586923 24874 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:04.613180 24856 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.588738 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.554136 24615 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:04.621929 21741 raft_consensus.cc:2368] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:18:04.621275 24615 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.585474 24613 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:04.586467 24859 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:04.623473 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 168596us
I20260709 12:18:04.609674 24216 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:04.629205 21151 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:04.630919 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:04.633054 24216 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.634016 24613 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:04.636245 24851 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.640333 21000 leader_election.cc:400] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:18:04.640637 21000 leader_election.cc:403] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:04.642665 24772 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:04.643478 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.644905 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:04.645426 21180 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.646505 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:04.648322 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:04.649014 21108 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:18:04.633239 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:04.629572 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 152671us
I20260709 12:18:04.657143 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.658555 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.623729 20932 catalog_manager.cc:5697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 5, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 5 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:04.664000 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:04.664953 21110 raft_consensus.cc:2410] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:04.666345 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:04.668989 21180 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:04.634734 24613 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:04.678313 21185 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:04.678728 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.679615 21180 raft_consensus.cc:2393] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:04.657181 24863 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:04.680563 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:04.680779 21036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1644) took 2310 ms (client timeout 2916 ms). Trace:
W20260709 12:18:04.681237 21036 rpcz_store.cc:269] 0709 12:18:02.370582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.691417 (+320835us) service_pool.cc:224] Handling call
0709 12:18:04.680564 (+1989147us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000c3ad4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:04.680698 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2984122752}
I20260709 12:18:04.682075 24863 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:04.682965 24733 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.683527 24733 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:04.684197 24741 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:04.685891 21180 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:18:04.677628 24859 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:04.694190 20999 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:04.625896 24876 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:18:04.694775 21182 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:04.703219 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:04.704792 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.704885 21180 raft_consensus.cc:2410] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:04.705931 24822 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:04.704058 24885 log.cc:927] Time spent T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:04.682735 24863 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.703351 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:04.710903 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:04.922644 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.225374 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.777493 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.811946 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.832876 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:04.772107 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:04.712396 21186 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:04.740198 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:04.947958 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 268658us
W20260709 12:18:04.839074 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.896160 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 131464us
I20260709 12:18:05.250705 21149 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:05.252686 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 635797us
I20260709 12:18:04.760659 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:04.772615 24733 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:05.094053 24668 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.854235 24851 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:04.708611 24859 raft_consensus.cc:697] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:04.738824 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:04.708033 24874 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.564s
W20260709 12:18:04.879830 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 91761.6us
I20260709 12:18:04.737771 20932 catalog_manager.cc:5697] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 8, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 8 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:04.895421 24846 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:05.282102 21185 raft_consensus.cc:2410] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:18:05.295830 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.278960 21108 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:05.093650 24716 raft_consensus.cc:3055] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:04.773243 24575 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:05.316277 24613 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:05.299079 21075 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:05.281005 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54436.5us
I20260709 12:18:05.270084 21102 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:05.031939 24216 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.271812 21150 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:04.834327 24863 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.299319 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:05.283109 21103 raft_consensus.cc:2410] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:05.339676 21179 raft_consensus.cc:2410] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:05.346576 21179 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:05.346685 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.251829 24640 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.348832 24640 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.349490 24671 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:05.251662 24728 raft_consensus.cc:3055] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:05.350069 24728 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:18:05.308380 24753 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.001s
I20260709 12:18:05.351133 24753 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:05.351280 24640 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:05.351019 24728 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.351521 21185 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:18:05.352082 24753 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:05.319684 24877 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:05.353091 24877 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.353286 21106 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:05.353479 24877 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:05.353945 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.354705 21107 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:05.315004 21109 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.352375 24728 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:05.315871 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:05.345870 20932 catalog_manager.cc:5697] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 5, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:05.357941 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 621421us
I20260709 12:18:05.358750 21151 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:05.358570 20932 catalog_manager.cc:5697] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 7, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 7 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:05.052379 24822 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:05.324060 24846 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.330870 24716 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:05.339927 24561 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:05.340312 24575 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:05.367254 24846 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:05.378479 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 124557us
I20260709 12:18:05.339556 24668 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.388180 24616 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.388782 24616 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.391208 20932 catalog_manager.cc:5697] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 3 to 4, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:05.392702 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:05.387431 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.392673 20932 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 3 to 6, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 6 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:05.383915 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.387677 24640 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:05.401471 20932 catalog_manager.cc:5697] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 7, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 7 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
W20260709 12:18:05.402877 24856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.043s	sys 0.064s
I20260709 12:18:05.411468 21105 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
W20260709 12:18:05.425011 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 571715us
I20260709 12:18:05.386528 24753 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.385272 24561 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.395854 24822 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.427510 21108 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:05.413403 24795 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:05.428352 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 122349us
W20260709 12:18:05.420840 24856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.043s	sys 0.064s
W20260709 12:18:05.431831 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.420531 24640 raft_consensus.cc:697] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:05.435839 24889 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:18:05.436687 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:05.437281 21738 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.443212 20932 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 8 to 10, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 10 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:05.448848 21712 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:05.454991 24545 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:05.447237 24616 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:05.455296 24653 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:05.455791 24640 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:05.456684 21744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 750) took 1176 ms (client timeout 1510 ms). Trace:
W20260709 12:18:05.457082 21744 rpcz_store.cc:269] 0709 12:18:04.280367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.281137 (+   770us) service_pool.cc:224] Handling call
0709 12:18:05.456485 (+1175348us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5400123754. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:05.456588 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23371136}
W20260709 12:18:05.462297 21178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.017s	sys 0.045s
W20260709 12:18:05.465085 21178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.017s	sys 0.045s
I20260709 12:18:05.464578 20932 catalog_manager.cc:5697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:05.471396 21747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 738) took 1826 ms. Trace:
I20260709 12:18:05.453007 24856 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:05.473480 24822 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:05.473758 24565 consensus_meta.cc:287] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.953s	user 0.011s	sys 0.000s
I20260709 12:18:05.474515 21741 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:05.471772 21747 rpcz_store.cc:276] 0709 12:18:03.645151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.645340 (+   189us) service_pool.cc:224] Handling call
0709 12:18:03.645669 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:04.452120 (+806451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.464369 (+1012249us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54001a63d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:05.471320 (+  6951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678767488}
I20260709 12:18:05.478122 24216 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:05.482160 24615 consensus_meta.cc:287] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.856s	user 0.010s	sys 0.000s
I20260709 12:18:05.462786 24545 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.493263 24613 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:05.476188 24863 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:05.486260 24545 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:05.485749 24616 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:05.482565 24615 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.494907 20932 catalog_manager.cc:5697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:05.502385 24668 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:05.502997 24668 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:05.474217 24716 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.476480 24565 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.506528 21186 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.501072 24616 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:05.508560 21739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 527) took 1051 ms. Trace:
I20260709 12:18:05.504048 24668 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:05.512575 21739 rpcz_store.cc:276] 0709 12:18:04.457026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.460054 (+  3028us) service_pool.cc:224] Handling call
0709 12:18:04.614677 (+154623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:04.619983 (+  5306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.620014 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:04.623160 (+  3146us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:04.623213 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:04.623278 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.508399 (+885121us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540031f6d0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:05.508503 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296535936}
I20260709 12:18:05.503964 24728 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.468228 24859 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.519599 20932 catalog_manager.cc:5697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 7, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 7 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:05.522682 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:05.522886 24716 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:05.483136 24575 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.531608 24575 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.514626 24668 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:05.535811 24668 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.536950 24668 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:05.513815 24616 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:05.539522 24772 consensus_meta.cc:287] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.000s
I20260709 12:18:05.563742 20932 catalog_manager.cc:5697] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:05.519335 24613 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.521481 24728 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.511600 24851 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:18:05.593091 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:05.594082 21109 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:05.538954 24753 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:05.599752 21186 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:05.573570 24772 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:18:05.610136 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:05.607818 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 324241us
I20260709 12:18:05.606871 24863 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.616448 20932 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 6, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 6 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
W20260709 12:18:05.632319 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.636030 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:05.644433 24616 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.645435 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:05.646148 21179 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:18:05.647735 24616 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:05.648267 24728 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:05.540033 24795 consensus_queue.cc:1175] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:18:05.648959 24883 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 1.023s	user 0.001s	sys 0.021s
I20260709 12:18:05.650357 21738 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:05.661799 21075 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:05.664178 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1913) took 1072 ms. Trace:
I20260709 12:18:05.664587 21182 rpcz_store.cc:276] 0709 12:18:04.588198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.616346 (+ 28148us) service_pool.cc:224] Handling call
0709 12:18:04.621283 (+  4937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:04.708407 (+ 87124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.660829 (+952422us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b540038b154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:05.661009 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150063872}
I20260709 12:18:05.615098 24613 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.670557 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:05.669220 20932 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 6, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 6 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:05.667291 24795 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.688656 21075 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:05.644359 24545 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:05.692432 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 81304.7us
I20260709 12:18:05.654712 24863 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.694866 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:05.695588 21186 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:05.681728 24900 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.686046 24565 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:05.702145 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.703226 24907 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.703817 24907 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.704134 24846 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.705166 24863 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:05.705927 24907 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:05.706305 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:05.707165 21746 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:05.707639 24899 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:05.708091 24899 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:05.708446 24899 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.710757 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1920) took 1070 ms. Trace:
W20260709 12:18:05.711585 24893 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:18:05.701777 24900 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.712283 24846 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:05.713570 24615 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:05.698616 24795 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.716974 24795 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:05.711134 21177 rpcz_store.cc:276] 0709 12:18:04.639969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.662859 (+ 22890us) service_pool.cc:224] Handling call
0709 12:18:04.760320 (+ 97461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:04.811573 (+ 51253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.811603 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:04.957688 (+146085us) log.cc:844] Serialized 26 byte log entry
0709 12:18:05.616690 (+659002us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:05.616734 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.616815 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:05.710396 (+ 93581us) raft_consensus.cc:1685] finished
0709 12:18:05.710418 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.710579 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":148,"thread_start_us":493037,"threads_started":1,"wal-append.queue_time_us":600700}
I20260709 12:18:05.728358 21149 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:05.734776 21180 raft_consensus.cc:2393] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:05.736008 24545 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:05.739195 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 380486us
I20260709 12:18:05.739575 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:05.740077 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:05.740284 21744 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:18:05.740442 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:05.740770 20919 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 40fd334874764b26ba28ac382c4199f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a1b891e53adc40a6a1ae813238321e93 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:05.741632 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.742480 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.742622 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.743244 21103 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:18:05.743391 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.742890 21182 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:05.744221 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.745286 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.745640 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:05.745878 21106 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:05.745311 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:05.746776 21181 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:05.747087 21186 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.743625 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.753816 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:05.754683 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.744537 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:05.759241 21185 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:05.729660 24753 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:05.760715 21107 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:05.763728 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.764348 21106 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:05.766994 24616 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:05.767411 24616 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:05.767755 24616 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.760762 24565 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.771889 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.761665 24753 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:05.772501 24753 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:05.772641 21111 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:05.771749 24565 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.773430 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.774001 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:05.774451 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.774624 21105 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.775175 21109 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:05.775542 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.776110 21102 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:05.761961 20932 catalog_manager.cc:5697] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 8, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 8 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:05.779446 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:05.779616 20932 catalog_manager.cc:5697] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:05.773583 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:05.787099 21103 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:05.781349 24733 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:18:05.783470 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 55212.1us
I20260709 12:18:05.785235 21186 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:05.788322 21105 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:05.764178 24613 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:05.792686 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:05.791182 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:05.795301 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1908) took 1730 ms. Trace:
I20260709 12:18:05.796168 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1884) took 1151 ms. Trace:
I20260709 12:18:05.799404 24892 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:05.799427 21183 rpcz_store.cc:276] 0709 12:18:04.064803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.064900 (+    97us) service_pool.cc:224] Handling call
0709 12:18:04.269613 (+204713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:04.270483 (+   870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.270516 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:05.436808 (+1166292us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b2c00061b88. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:18:05.437293 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:18:05.671995 (+234702us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:05.758411 (+ 86416us) log.cc:844] Serialized 14 byte log entry
0709 12:18:05.790707 (+ 32296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.790863 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:05.790901 (+    38us) raft_consensus.cc:1685] finished
0709 12:18:05.794986 (+  4085us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.795136 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32033,"prepare.queue_time_us":115009,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":98006,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":11297,"spinlock_wait_cycles":40993152,"thread_start_us":300266,"threads_started":2,"wal-append.queue_time_us":282750}
I20260709 12:18:05.801419 21104 rpcz_store.cc:276] 0709 12:18:04.645128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.706568 (+ 61440us) service_pool.cc:224] Handling call
0709 12:18:05.279509 (+572941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.283548 (+  4039us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:05.684212 (+400664us) log.cc:844] Serialized 14 byte log entry
0709 12:18:05.795740 (+111528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:05.795790 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:05.795837 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.795898 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.796007 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":396748,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":10106,"raft.queue_time_us":3400,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":159616,"thread_start_us":418221,"threads_started":2}
I20260709 12:18:05.803208 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:05.804119 24668 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:05.804647 24668 raft_consensus.cc:697] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:05.805539 24668 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:05.806273 24910 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:05.804143 21002 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:05.808467 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:18:05.808672 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.780336 24561 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:05.796835 24856 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:05.814635 24903 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:05.815124 24903 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:05.815475 24903 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:05.816671 24909 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:05.817077 24909 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:05.817436 24909 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:05.807588 24216 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:05.818535 24216 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.818881 24216 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:05.824038 21103 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:05.824640 21149 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:05.825174 20932 catalog_manager.cc:5697] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 4, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 4 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:05.828704 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.790282 24733 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:05.808512 24892 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:05.846783 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.872951 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.856544 20999 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:05.857829 20932 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 6, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:05.886570 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1887) took 1203 ms. Trace:
W20260709 12:18:05.887077 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 147102us
I20260709 12:18:05.887403 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:05.899612 21076 leader_election.cc:336] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.514s (SENT)
I20260709 12:18:05.901188 21076 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:05.901306 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 44886.3us
W20260709 12:18:05.902036 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 70038.9us
W20260709 12:18:05.904546 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 65093.9us
I20260709 12:18:05.905309 21149 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:05.832361 24561 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:05.870616 24895 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:05.907910 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:05.911623 21149 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:05.882642 24892 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:05.832749 24565 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:05.906183 20932 catalog_manager.cc:5697] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:05.912986 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.887002 21110 rpcz_store.cc:276] 0709 12:18:04.683144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.697308 (+ 14164us) service_pool.cc:224] Handling call
0709 12:18:05.251699 (+554391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:05.610295 (+358596us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:05.683994 (+ 73699us) log.cc:844] Serialized 14 byte log entry
0709 12:18:05.878037 (+194043us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:05.883909 (+  5872us) log.cc:844] Serialized 26 byte log entry
0709 12:18:05.884058 (+   149us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:05.884097 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.884171 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:05.886048 (+  1877us) raft_consensus.cc:1685] finished
0709 12:18:05.886074 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.886504 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123716,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":91209,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":4201,"spinlock_wait_cycles":6016,"thread_start_us":567832,"threads_started":3,"wal-append.queue_time_us":190040}
I20260709 12:18:05.838924 24877 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:05.920907 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.922555 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.922721 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.925025 21102 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:05.924641 21111 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
W20260709 12:18:05.926250 21711 leader_election.cc:336] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.648s (SENT)
I20260709 12:18:05.926932 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:05.909814 24795 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:05.913838 24615 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:05.927510 21110 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:05.914160 24895 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.908797 24561 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:05.939087 21104 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
W20260709 12:18:05.941944 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.942379 24877 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:05.942476 21711 leader_election.cc:336] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.510s (SENT)
I20260709 12:18:05.942934 21177 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:05.942930 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:05.934424 24916 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:05.936517 21105 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:05.937146 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.917135 24613 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:05.917012 24545 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:05.909669 24907 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:05.953464 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.954267 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:05.940553 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:05.951910 21102 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:05.929894 24575 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:05.959300 21000 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:05.962313 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:05.963371 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:05.963936 21108 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.966161 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:05.967272 24900 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:05.969389 21744 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:05.940681 24895 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:05.959177 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:05.940973 24561 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:05.972873 21185 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:18:05.978077 21741 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:05.928093 24851 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:18:05.979713 21108 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
W20260709 12:18:06.029949 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 110825us
I20260709 12:18:06.030771 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:05.980695 21077 leader_election.cc:336] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.562s (SENT)
I20260709 12:18:06.032528 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:06.032080 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:05.970060 24918 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.033272 24863 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:05.941179 24565 consensus_queue.cc:1059] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 12:18:06.036675 21711 leader_election.cc:336] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.165s (SENT)
I20260709 12:18:06.036798 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:06.037336 21151 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.037964 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:06.034302 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:06.033735 21739 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:18:06.041687 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:06.032121 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 61511.3us
W20260709 12:18:06.043428 21077 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.570s (SENT)
I20260709 12:18:06.036424 24863 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.049773 24863 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.054214 21178 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:05.978950 24545 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:05.969820 24877 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:05.975651 24894 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:05.975170 24613 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:05.930755 24733 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.050524 24616 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:06.057250 24913 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:18:06.068228 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:06.069089 21104 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:18:06.087845 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.091446 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54197.9us
I20260709 12:18:06.059211 24877 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.054891 24851 consensus_queue.cc:1243] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:06.060508 24894 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.111835 21151 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.064713 24859 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.070377 24918 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:06.090943 24876 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:06.119283 21104 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:06.071905 24874 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:06.125193 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 88580.6us
W20260709 12:18:06.121470 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.100742 24877 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:06.130326 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 151902us
I20260709 12:18:06.122260 24876 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:06.127532 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 95791.3us
I20260709 12:18:06.112071 24894 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:06.171522 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:06.098568 24856 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:18:06.175050 21000 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:06.177124 21711 leader_election.cc:336] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.714s (SENT)
W20260709 12:18:06.178364 21076 leader_election.cc:336] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.796s (SENT)
I20260709 12:18:06.132126 24876 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:06.243216 21076 leader_election.cc:336] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.562s (SENT)
W20260709 12:18:06.243592 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 66505.6us
I20260709 12:18:06.243861 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:06.175968 24545 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.121140 24859 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:06.252616 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 81192.7us
W20260709 12:18:06.253103 24926 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:18:06.193121 24613 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.171845 24728 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:06.245815 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 74481.9us
W20260709 12:18:06.246281 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 112062us
I20260709 12:18:06.256709 21744 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
W20260709 12:18:06.259016 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 80471.8us
I20260709 12:18:06.175879 24908 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:18:06.263247 21150 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:06.263171 21712 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:06.266580 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 165278us
W20260709 12:18:06.255825 24923 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.005s
W20260709 12:18:06.267073 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.272439 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:06.273115 21742 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:06.291827 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:06.295255 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:06.298180 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54999.8us
W20260709 12:18:06.298764 21076 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.570s (SENT)
I20260709 12:18:06.299199 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:06.270712 24818 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:06.273478 24916 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.306607 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:06.307794 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:06.308236 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.309974 21746 raft_consensus.cc:2368] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:06.311129 21744 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 14: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:06.312549 24934 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.305176 24933 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.316134 24927 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:06.316589 24927 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.316949 24927 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:06.319134 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 56620.4us
I20260709 12:18:06.327054 21075 leader_election.cc:400] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:06.327446 21075 leader_election.cc:403] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:18:06.336020 24753 consensus_meta.cc:287] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.006s
I20260709 12:18:06.297731 24615 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:06.337425 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:06.339237 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.287578 24668 consensus_queue.cc:1059] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:18:06.347839 24668 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:06.348222 24668 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:06.349038 24668 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.350382 24668 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:06.351202 24616 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:06.351473 24929 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:06.267977 24918 consensus_queue.cc:1059] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:18:06.273764 24671 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:18:06.364841 21076 leader_election.cc:336] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.693s (SENT)
W20260709 12:18:06.338093 24899 consensus_meta.cc:287] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.002s
I20260709 12:18:06.345533 24931 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:06.346484 24617 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
W20260709 12:18:06.354125 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 86503.1us
I20260709 12:18:06.415138 21149 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.415904 21747 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:06.356408 21110 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:06.336488 24753 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.345142 24932 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:06.401008 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 123943us
W20260709 12:18:06.405284 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 126593us
W20260709 12:18:06.414040 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 63649.7us
I20260709 12:18:06.421697 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:06.422356 21185 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:06.427556 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:06.427977 21077 leader_election.cc:336] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.796s (SENT)
I20260709 12:18:06.428419 21180 raft_consensus.cc:2410] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:18:06.428640 24930 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:06.429335 24931 raft_consensus.cc:697] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:06.431391 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:06.431932 21186 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:06.414327 24216 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.001s
I20260709 12:18:06.316082 24933 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:06.433557 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 96224.9us
I20260709 12:18:06.435088 21106 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:06.428431 21077 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:06.436940 21181 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:06.445613 21107 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:06.445587 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:06.444235 21709 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:06.448027 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:06.449688 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:06.435216 24909 consensus_meta.cc:287] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.003s
W20260709 12:18:06.457574 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.327656 24916 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.431010 24874 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:06.480166 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 45895.4us
I20260709 12:18:06.414438 24899 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:06.488622 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 60665.5us
I20260709 12:18:06.484938 21186 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:06.430321 24931 consensus_queue.cc:237] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.494791 21709 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.497563 24933 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:06.498853 24897 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:06.481328 24903 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.000s
W20260709 12:18:06.489565 21077 leader_election.cc:336] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.693s (SENT)
I20260709 12:18:06.504217 21077 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:06.505839 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 51267.8us
I20260709 12:18:06.446624 24216 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.511139 20999 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.491611 24918 raft_consensus.cc:2764] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:18:06.451191 24615 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:18:06.523546 24818 raft_consensus.cc:697] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:06.471856 24909 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.536847 24909 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:06.538633 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 43900.1us
I20260709 12:18:06.541816 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:06.545300 21738 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 12: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:06.548144 21709 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:06.561928 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 56660.1us
I20260709 12:18:06.562834 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.563489 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.567020 24939 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:06.567723 24939 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.570184 24939 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:06.547430 24897 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:06.521375 24877 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.542096 24795 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:06.507232 24903 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.595306 24909 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:18:06.598186 24928 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:06.598655 24928 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.599025 24928 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.589632 24932 raft_consensus.cc:697] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:18:06.600657 24561 consensus_meta.cc:287] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.002s
I20260709 12:18:06.607589 24561 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.608052 21151 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.608695 21179 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:06.601300 24903 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:06.609994 24903 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:06.610836 24903 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:06.611167 24903 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:06.611971 24903 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.587860 24943 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:06.615067 24895 consensus_meta.cc:287] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.004s
I20260709 12:18:06.615479 24895 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.616182 24561 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:06.618224 24863 consensus_meta.cc:287] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.002s
I20260709 12:18:06.587800 24918 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:06.619356 21077 leader_election.cc:336] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.993s (SENT)
I20260709 12:18:06.657449 21077 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:06.601573 24939 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:06.623202 24818 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.623950 24216 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:06.624758 24892 consensus_meta.cc:287] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.000s
I20260709 12:18:06.602183 24753 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:06.609373 21151 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.632071 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:06.635412 24930 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:06.636754 24924 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.536s	user 0.002s	sys 0.000s
I20260709 12:18:06.637111 24948 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:06.602893 21177 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:06.647257 24616 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:06.634135 24895 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:06.651227 21106 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:06.652944 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:06.614714 24907 consensus_meta.cc:287] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.648s	user 0.000s	sys 0.008s
I20260709 12:18:06.676898 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:06.647464 24942 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:06.677089 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:06.630589 24903 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.678931 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:06.679530 24876 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.668120 24863 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.681360 24928 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.686472 24933 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:06.686714 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 67405.9us
I20260709 12:18:06.704303 21744 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:06.776998 21077 leader_election.cc:336] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.147s (SENT)
I20260709 12:18:06.777459 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:06.703521 21746 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:06.778466 21102 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:06.776901 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 167623us
I20260709 12:18:06.780721 21104 raft_consensus.cc:2410] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:06.702142 24951 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.699622 24892 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.783578 21185 raft_consensus.cc:2410] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:06.783860 24907 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:06.709403 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.785060 24892 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:06.699615 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 160116us
I20260709 12:18:06.612109 24877 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:06.657311 24918 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:06.704396 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:06.797168 21103 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.787439 24653 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:06.800093 24575 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:06.800544 24575 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:06.801385 24575 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.719941 24930 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.781100 24753 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:06.803407 21709 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.803864 24859 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:06.804217 24954 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:06.805729 24954 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:06.806147 21104 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:06.806926 24907 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.807423 24907 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.807775 24948 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:06.808285 24930 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:06.808549 24948 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:06.808941 24948 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:06.809340 24907 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:06.791190 24863 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:06.810053 24894 consensus_meta.cc:287] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.000s
I20260709 12:18:06.811797 24899 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:06.779397 24565 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:06.812487 24565 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:06.813205 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:06.792845 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.795348 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:06.814886 21108 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.815673 24910 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:06.816422 24910 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:06.817240 24941 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:06.795480 21102 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:06.817631 24941 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:06.819073 21076 leader_election.cc:336] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.434s (SENT)
I20260709 12:18:06.819525 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:06.800215 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.791985 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:06.793650 21747 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:06.823348 21106 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:06.785799 24795 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.788707 24928 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:06.814313 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:06.798545 24876 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:06.816329 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.822894 21108 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:06.831236 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:06.824342 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:06.818490 24941 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.826614 24903 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:06.844300 24941 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:06.847657 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.851054 24910 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:06.851816 24910 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:06.852120 24910 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.852421 24910 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:06.810482 24894 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.855562 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:06.786674 24616 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:06.809652 21709 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:06.861294 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 51735.1us
I20260709 12:18:06.861923 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:06.802585 24575 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:06.603098 24932 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.835420 21739 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:06.836206 21179 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:06.863344 21709 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:06.829727 21075 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:06.838356 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 241411us
I20260709 12:18:06.798878 24918 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:06.865448 24818 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:06.866155 24668 consensus_meta.cc:287] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.002s
I20260709 12:18:06.835491 24899 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.866854 24818 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:06.868085 24818 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.827455 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:06.875141 21180 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:06.877499 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.839021 24753 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:18:06.883684 24851 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:06.884123 24851 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:06.780509 24927 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.884915 24851 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.866858 24933 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:06.866077 24917 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:06.887019 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 547) took 1391 ms. Trace:
I20260709 12:18:06.886106 24851 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:06.880322 24216 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:06.850672 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:06.898423 21103 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:06.894497 21180 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:06.860309 21106 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:06.887390 21178 rpcz_store.cc:276] 0709 12:18:05.495878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.496039 (+   161us) service_pool.cc:224] Handling call
0709 12:18:05.505400 (+  9361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.059354 (+553954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.886769 (+827415us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540033cf54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:06.886961 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261687680}
I20260709 12:18:06.856686 24894 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:06.904790 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.929992 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:06.929515 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 49643us
I20260709 12:18:06.934259 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:06.934522 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:06.935083 21102 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:06.936247 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:06.937111 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:06.889935 24928 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.935191 21106 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:06.937821 24928 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:06.940349 24928 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:06.878437 24918 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:06.813294 24565 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:07.006652 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.073639 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:06.945946 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:07.064209 21032 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:07.016731 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.047619 21077 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.703s (SENT) [suppressed 74 similar messages]
W20260709 12:18:07.124951 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 77379.2us
I20260709 12:18:06.911823 21105 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:06.945271 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:07.122596 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 271965us
W20260709 12:18:06.955168 21076 leader_election.cc:336] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.609s (SENT)
W20260709 12:18:07.131323 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 176192us
I20260709 12:18:07.132417 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:07.126339 21742 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:07.136078 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:07.115633 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:06.906136 24795 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.137190 21149 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:07.142868 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1815) took 1362 ms. Trace:
I20260709 12:18:06.902458 24933 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:07.145448 24716 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:07.142678 24903 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:07.145459 24955 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:18:07.003764 24917 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:07.146348 24931 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.119027 24902 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:07.151538 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:07.143458 21107 rpcz_store.cc:276] 0709 12:18:05.773731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.774951 (+  1220us) service_pool.cc:224] Handling call
0709 12:18:07.135659 (+1360708us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54000f8f54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:07.135770 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130315520}
I20260709 12:18:07.152460 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:07.143683 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.151068 24795 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.125707 24216 raft_consensus.cc:697] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:07.141093 24863 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:18:07.163676 21029 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:07.164302 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:07.166203 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 259650us
I20260709 12:18:07.154959 24900 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.168617 21149 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:07.157353 24859 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:07.169687 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.142769 24935 consensus_queue.cc:1059] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:18:07.173295 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.173902 21029 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:07.162930 24716 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:07.171994 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.175957 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:07.164532 24903 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:07.180377 24935 raft_consensus.cc:3055] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:07.180742 24935 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:07.181496 24935 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.020015 24616 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.184897 21032 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.170497 24892 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:07.170631 24877 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:07.189142 21742 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:07.182740 24935 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:07.174767 24902 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:07.192067 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:07.196553 24963 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:18:07.196678 21032 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.197779 24917 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.199944 24795 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:07.200241 24927 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:07.182957 24859 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:07.167138 24931 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:07.172092 24900 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:07.219240 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.191075 24877 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:07.222265 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 46408.9us
I20260709 12:18:07.223577 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:07.224524 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.224167 21742 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:07.213894 24902 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:07.201211 24892 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:07.225894 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:07.223555 21709 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:07.237958 24733 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:07.239207 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.240204 24892 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.241009 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.241720 21036 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.242774 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.243098 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.243201 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.244199 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.244546 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.245167 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.245671 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.246344 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.246790 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.247694 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.243263 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.248332 21034 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:07.248579 21033 raft_consensus.cc:2376] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10. Re-sending same reply.
I20260709 12:18:07.249173 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.249887 21032 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:07.243364 21036 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:07.223759 24877 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:07.247097 21027 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:07.253489 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.245765 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:07.257416 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.257464 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.258231 21184 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:07.248878 21186 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:07.261822 21742 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:18:07.263363 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.264968 21186 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:07.265092 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:07.265535 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.262516 24970 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:07.274490 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 50980.5us
I20260709 12:18:07.275875 21000 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:07.277118 21000 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:07.262578 21031 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:07.277899 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.193849 24933 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.279047 21746 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:07.278508 21184 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:07.281750 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:07.282467 21744 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 12: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:07.287256 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:07.287334 21077 leader_election.cc:336] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.609s (SENT)
I20260709 12:18:07.288827 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:07.289963 21186 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:07.221419 24716 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:07.294603 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:07.281176 24927 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:07.280424 24613 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.302654 21186 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:07.281848 24939 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:07.314114 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.315007 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.260409 24903 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:07.316627 21184 raft_consensus.cc:2393] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:07.317314 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.318405 21031 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:07.318940 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:07.319308 21036 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:07.318984 21186 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:07.320530 21077 leader_election.cc:336] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.521s (SENT)
W20260709 12:18:07.320801 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.320469 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.322595 21184 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:07.323805 21184 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:07.231101 24216 consensus_queue.cc:237] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.309291 24613 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.307147 24615 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:18:07.332296 21076 leader_election.cc:336] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.999s (SENT)
I20260709 12:18:07.308799 24927 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:07.313469 24939 raft_consensus.cc:697] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:18:07.341235 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.342527 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.343220 21031 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:07.343763 24613 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:07.347325 21184 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:07.348328 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:07.349987 21184 raft_consensus.cc:2368] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:07.325829 24977 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.346374 24910 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:07.292913 24859 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:07.303128 24902 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:07.363598 24967 log.cc:927] Time spent T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 12:18:07.365252 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.366037 21028 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.366817 24931 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:07.367995 24900 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:07.376274 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:07.377058 21184 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:07.411015 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.376307 24916 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:07.389529 24965 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:07.358248 24977 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:07.484525 21077 leader_election.cc:336] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.837s (SENT)
I20260709 12:18:07.500455 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.500896 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:07.503485 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.515465 21033 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.502442 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:07.435670 21028 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:07.522014 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.522694 21179 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:07.520869 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.535379 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.410193 24927 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:07.671586 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 187080us
W20260709 12:18:07.671919 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.672312 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.672787 21077 leader_election.cc:336] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.938s (SENT)
W20260709 12:18:07.673384 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 171009us
I20260709 12:18:07.673432 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:07.582119 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:07.627655 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.586673 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.675195 21178 raft_consensus.cc:2376] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8. Re-sending same reply.
I20260709 12:18:07.679654 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:07.680330 21179 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:07.680884 21077 leader_election.cc:336] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.999s (SENT)
I20260709 12:18:07.681255 21077 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:07.552994 24916 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:07.526590 24900 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:07.687970 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:07.555305 24971 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:18:07.692011 21183 raft_consensus.cc:2410] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:07.689101 24977 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:07.695655 24935 consensus_meta.cc:287] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 12:18:07.696189 21182 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:07.697955 21184 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:07.679201 24930 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:07.699424 24930 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:07.679088 24964 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:18:07.700459 21179 raft_consensus.cc:2410] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:18:07.700340 24930 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:07.701427 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.703534 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.707914 21035 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:07.709514 21028 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:07.710973 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.712023 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:07.712612 21179 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:07.714447 21178 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:07.715858 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:07.707006 24941 consensus_meta.cc:287] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.862s	user 0.008s	sys 0.004s
W20260709 12:18:07.717432 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.717336 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:07.716595 21033 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:07.747650 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.748809 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.749336 21179 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:07.749954 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:07.706494 24916 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:07.750447 21104 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:07.750543 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.752187 21184 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:07.752187 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.752803 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.713145 24615 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:07.763588 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.769843 21028 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:07.763863 21184 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:07.750252 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:07.772644 21179 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:07.536334 24939 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.778100 21186 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:07.793684 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.797133 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.797832 21033 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:07.800625 24916 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:07.804687 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.806268 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:07.807502 21184 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.812752 24616 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:07.817230 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.818468 21107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "861699cfca584c7b963879b6d12f2866"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:07.819150 21107 raft_consensus.cc:606] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:07.819496 21107 raft_consensus.cc:614] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:07.821069 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.821811 21033 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.822433 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.822635 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.823386 21033 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:07.824285 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.824990 21033 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.825810 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:07.826331 21183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1935) took 1401 ms (client timeout 1751 ms). Trace:
W20260709 12:18:07.819159 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.828476 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.828758 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.823606 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.829684 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.830036 21035 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:07.830346 21028 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.824185 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.830801 24965 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:07.831346 24965 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:07.831317 21030 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:07.837670 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.838330 21030 raft_consensus.cc:2368] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:07.838657 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.839001 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:07.839725 21030 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.839967 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:07.826735 21183 rpcz_store.cc:269] 0709 12:18:06.424884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.425029 (+   145us) service_pool.cc:224] Handling call
0709 12:18:07.826134 (+1401105us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540024e0d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:07.826277 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2852456320}
I20260709 12:18:07.840982 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:07.841568 21076 leader_election.cc:336] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.388s (SENT)
I20260709 12:18:07.840394 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:07.842239 24877 consensus_meta.cc:287] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.003s
I20260709 12:18:07.842418 21030 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.841657 21035 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:07.842895 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.842753 24918 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:07.843488 21028 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:07.840513 21033 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:07.844130 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.848524 21035 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:07.848824 21181 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:07.847357 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:07.847818 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 172604us
W20260709 12:18:07.859884 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.861506 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:07.850044 24877 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:07.880157 24896 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:07.880797 21177 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:07.881045 24896 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:07.881441 24896 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:07.881975 24877 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:07.883185 21711 leader_election.cc:336] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.558s (SENT)
I20260709 12:18:07.883680 21711 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:07.872200 24899 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.925611 21179 raft_consensus.cc:2410] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:18:07.882323 24896 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:07.932355 21180 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 12. Ops: []
I20260709 12:18:08.145545 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1936) took 1713 ms. Trace:
I20260709 12:18:08.385130 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.388446 21179 raft_consensus.cc:2410] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 12:18:08.386216 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.919343 24918 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:08.393119 21711 leader_election.cc:336] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.970s (SENT)
I20260709 12:18:08.418998 21711 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:08.383494 21185 rpcz_store.cc:276] 0709 12:18:06.431890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.437181 (+  5291us) service_pool.cc:224] Handling call
0709 12:18:08.145303 (+1708122us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54002620d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:08.145474 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773233536}
W20260709 12:18:08.419092 21077 leader_election.cc:336] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.388s (SENT)
W20260709 12:18:08.390070 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 505429us
I20260709 12:18:08.419977 21077 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:08.421979 21747 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:08.426744 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:08.427219 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.453492 21178 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 12:18:08.219787 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.106163 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:08.456179 21107 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:08.045863 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:08.032963 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.998380 24653 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.459649 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.144347 24941 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:08.421555 24916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.010s	sys 0.080s
I20260709 12:18:08.462236 21185 raft_consensus.cc:2410] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:08.417975 24954 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:08.483582 24916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.011s	sys 0.080s
W20260709 12:18:08.381587 24965 consensus_meta.cc:287] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.001s
W20260709 12:18:08.426903 20984 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.016s	sys 0.038s
W20260709 12:18:08.024219 20919 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 40fd334874764b26ba28ac382c4199f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a1b891e53adc40a6a1ae813238321e93 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:08.465545 24896 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:08.461364 24986 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.021s	sys 0.057s
I20260709 12:18:08.465377 24653 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:08.498593 20984 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.017s	sys 0.040s
W20260709 12:18:08.508384 20919 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 484202us
W20260709 12:18:08.509141 24986 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.022s	sys 0.057s
I20260709 12:18:08.509725 24653 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:08.510524 24653 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:08.466531 21180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2360) took 1253 ms. Trace:
I20260709 12:18:08.467648 24615 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:07.920562 24899 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:08.471295 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.496546 24962 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:08.471904 24910 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:08.472121 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.473104 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2517) took 1144 ms. Trace:
I20260709 12:18:08.473562 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:08.473665 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.526680 21032 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:08.473989 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.474237 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.528407 21033 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:08.474871 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:08.529440 21185 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:08.475481 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.530063 21181 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:08.022877 24948 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:08.475957 21104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 503) took 1541 ms (client timeout 1830 ms). Trace:
W20260709 12:18:08.541922 21104 rpcz_store.cc:269] 0709 12:18:06.934170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.935834 (+  1664us) service_pool.cc:224] Handling call
0709 12:18:08.473201 (+1537367us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54002535d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:08.475899 (+  2698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870339968}
I20260709 12:18:08.478583 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.543584 21179 raft_consensus.cc:2410] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:08.479327 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.479879 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.144496 24933 consensus_queue.cc:1059] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.372s
I20260709 12:18:08.544392 21030 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:08.215394 24900 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:08.480360 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.425971 24966 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:08.482868 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.546306 21031 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
W20260709 12:18:08.546556 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.418444 24927 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.511953 21180 rpcz_store.cc:276] 0709 12:18:07.212896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.213181 (+   285us) service_pool.cc:224] Handling call
0709 12:18:07.213512 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.383386 (+1169874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.466298 (+ 82912us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b540001c2d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:08.466475 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652603264}
I20260709 12:18:08.519822 21034 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:08.471279 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.486405 24941 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:08.485966 24954 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:08.548981 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.527325 21035 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:08.539938 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.545089 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.527922 21178 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:08.526997 21036 rpcz_store.cc:276] 0709 12:18:07.328411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.328540 (+   129us) service_pool.cc:224] Handling call
0709 12:18:07.350455 (+ 21915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.353528 (+  3073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.353559 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:07.375965 (+ 22406us) log.cc:844] Serialized 26 byte log entry
0709 12:18:07.771037 (+395072us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:07.771074 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.771137 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:08.472893 (+701756us) raft_consensus.cc:1685] finished
0709 12:18:08.472912 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.473031 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4363,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":1251,"thread_start_us":354605,"threads_started":1,"wal-append.queue_time_us":1060565}
I20260709 12:18:08.576225 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:08.575713 21028 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:08.577183 21185 raft_consensus.cc:2410] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:08.484969 24908 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.547861 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:08.511121 24653 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:08.578519 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:08.582391 21179 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:08.583184 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.506564 24965 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:08.548768 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.585654 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.586994 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.591213 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:08.595978 21181 raft_consensus.cc:2368] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:08.586338 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.598057 21031 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:08.598245 21178 raft_consensus.cc:2393] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:08.583849 21027 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:08.599246 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.600659 21183 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:08.599892 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.608244 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.611410 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.612077 21181 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
W20260709 12:18:08.611555 24994 log.cc:927] Time spent T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:08.578907 24933 consensus_queue.cc:1243] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer a1b891e53adc40a6a1ae813238321e93 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:08.618250 21036 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:18:08.587163 24859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.013s
W20260709 12:18:08.618865 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.620015 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.620308 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:08.620473 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:08.620905 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.621048 21185 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:08.621413 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.623186 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:08.548651 24927 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:08.574096 24966 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:08.577981 24900 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:08.591753 24908 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:08.627269 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 234156us
I20260709 12:18:08.855974 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:08.856312 21711 leader_election.cc:336] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.043s (SENT)
I20260709 12:18:08.856977 21178 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:08.857481 21179 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
W20260709 12:18:08.857586 21711 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.194s (SENT)
I20260709 12:18:08.858034 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:08.623654 24859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.007s	sys 0.013s
W20260709 12:18:08.673025 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 253926us
W20260709 12:18:08.780854 24970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.032s
I20260709 12:18:08.860638 21028 raft_consensus.cc:2410] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:18:08.860849 24970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.002s	sys 0.038s
I20260709 12:18:08.860241 21033 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:08.862457 24927 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:08.846555 24933 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:08.833788 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:08.769917 21709 leader_election.cc:336] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.830s (SENT)
W20260709 12:18:08.864413 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:08.864971 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 95096.9us
I20260709 12:18:08.641018 21185 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:08.728546 21107 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:08.859220 21178 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:08.859068 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.868117 21180 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:08.856422 21183 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:08.868347 21077 leader_election.cc:336] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.517s (SENT)
I20260709 12:18:08.863320 21034 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:08.858784 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.870536 21179 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:08.881193 21709 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:08.871001 21077 leader_election.cc:336] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.594s (SENT)
I20260709 12:18:08.884186 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:08.885432 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:08.886062 21110 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:18:08.887355 21709 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:08.863528 24900 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:08.782064 25000 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 12:18:08.897267 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.898499 21105 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:18:08.708359 24939 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.012s	sys 0.038s
I20260709 12:18:08.902365 21104 raft_consensus.cc:3055] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:08.904978 21747 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:08.905704 21744 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:08.907757 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:08.912505 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.900446 24927 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.890132 24916 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:08.863656 24933 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:08.976179 21103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.018s	sys 0.036s
W20260709 12:18:09.148821 21103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.037s	sys 0.055s
I20260709 12:18:08.931934 25004 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:09.138696 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:09.151419 21178 raft_consensus.cc:2368] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:08.932292 25009 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:09.151580 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.151901 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:09.119567 20919 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 40fd334874764b26ba28ac382c4199f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a1b891e53adc40a6a1ae813238321e93 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:09.152057 25009 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.154104 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:09.152741 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.154806 21035 raft_consensus.cc:2368] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11.
I20260709 12:18:09.155256 21178 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:09.154420 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.156473 25009 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.156437 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:09.111246 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.157608 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.157778 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.120240 24565 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:09.158412 21027 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:09.155093 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:08.948535 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.948127 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.166015 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.137830 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:09.081354 21077 leader_election.cc:336] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.668s (SENT)
I20260709 12:18:09.172646 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:09.172992 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 91679.9us
I20260709 12:18:09.173556 21181 raft_consensus.cc:2368] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
W20260709 12:18:09.173556 21077 leader_election.cc:336] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.748s (SENT)
I20260709 12:18:09.174475 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:09.170500 21104 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:09.146925 25006 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:08.997948 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 110655us
W20260709 12:18:09.178318 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.069463 24900 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:18:09.178695 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.163259 25007 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:09.181342 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.181175 24900 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.181461 25007 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:08.972714 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.182542 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.178886 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.183844 21185 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:09.184370 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.184712 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.185519 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:09.011759 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.197664 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.180480 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.187983 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.198874 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.199687 21181 raft_consensus.cc:2393] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:09.178977 24902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.016s	sys 0.025s
I20260709 12:18:09.179806 21104 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.196587 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:09.186184 24927 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.170151 21107 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:18:09.208184 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.209170 21178 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:09.209829 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.215637 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.212325 21179 raft_consensus.cc:2410] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:18:09.217144 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:09.218905 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:09.133471 24896 consensus_meta.cc:287] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.004s
I20260709 12:18:09.215405 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:09.171363 24939 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.014s	sys 0.059s
I20260709 12:18:09.218735 21104 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.217947 24795 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:18:09.250686 25012 log.cc:927] Time spent T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:18:09.251324 24908 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.253633 24927 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:08.916404 24899 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.248813 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:09.249033 21739 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:09.255736 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:08.915149 24653 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:09.258049 21185 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:09.258461 21034 raft_consensus.cc:2410] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:08.947141 24954 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.221778 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:09.221130 21183 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:08.968830 25001 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:09.213393 24575 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.230914 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.223836 21179 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:08.942653 24941 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:09.221079 25011 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:18:09.300489 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 126957us
W20260709 12:18:09.210494 24902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.016s	sys 0.025s
W20260709 12:18:09.304344 21077 leader_election.cc:336] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.820s (SENT)
W20260709 12:18:09.298635 21076 leader_election.cc:336] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.510s (SENT)
I20260709 12:18:09.311776 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:09.304916 21077 leader_election.cc:336] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.896s (SENT)
I20260709 12:18:09.313723 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:09.314819 21077 leader_election.cc:336] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.904s (SENT)
W20260709 12:18:09.315740 21077 leader_election.cc:336] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.939s (SENT)
W20260709 12:18:09.316641 21077 leader_election.cc:336] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.084s (SENT)
W20260709 12:18:09.317185 21077 leader_election.cc:336] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.101s (SENT)
W20260709 12:18:09.318954 21182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2368) took 2077 ms (client timeout 1938 ms). Trace:
W20260709 12:18:09.319350 21182 rpcz_store.cc:269] 0709 12:18:07.241715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.245430 (+  3715us) service_pool.cc:224] Handling call
0709 12:18:09.318752 (+2073322us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540001b3d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:09.318886 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034542336}
W20260709 12:18:09.321009 21076 leader_election.cc:336] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.517s (SENT)
I20260709 12:18:09.321441 21076 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:09.256809 25015 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:09.324859 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:09.325474 21110 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:18:09.303717 24859 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.180518 25006 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:09.328595 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.280128 24899 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.301167 24575 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.329797 24859 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.209313 24916 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.301229 24653 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:09.343149 21738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:53714
I20260709 12:18:09.297830 25018 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:09.340490 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.305275 25004 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:09.348533 21711 leader_election.cc:336] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.685s (SENT)
I20260709 12:18:09.351956 21711 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:09.338171 21076 leader_election.cc:336] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.521s (SENT)
I20260709 12:18:09.350229 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:09.351158 21111 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:09.355121 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:09.326627 25015 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.351379 21741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 763) took 2402 ms. Trace:
I20260709 12:18:09.330721 24902 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.359921 21110 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:09.360428 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:09.360605 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:09.331200 24941 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:09.315163 24927 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:18:09.357592 21741 rpcz_store.cc:276] 0709 12:18:06.940433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.940747 (+   314us) service_pool.cc:224] Handling call
0709 12:18:06.941063 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.263897 (+322834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.263932 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:08.173013 (+909081us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b2c0012b758. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:18:08.173510 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:18:08.499127 (+325617us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:08.499170 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.499239 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:09.335118 (+835879us) raft_consensus.cc:1685] finished
0709 12:18:09.335138 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.342925 (+  7787us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75753,"raft.queue_time_us":237358,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7853,"spinlock_wait_cycles":65752960,"thread_start_us":540643,"threads_started":2,"wal-append.queue_time_us":449631}
I20260709 12:18:09.302690 25001 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:09.439778 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 61683.4us
W20260709 12:18:09.440446 21076 leader_election.cc:336] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.594s (SENT)
I20260709 12:18:09.440814 21076 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:09.342190 24899 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.360116 25015 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:09.473999 21076 leader_election.cc:336] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.668s (SENT)
I20260709 12:18:09.474442 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:09.482074 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 150116us
W20260709 12:18:09.491380 21076 leader_election.cc:336] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.672s (SENT)
I20260709 12:18:09.491907 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:09.496869 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 505) took 1452 ms. Trace:
I20260709 12:18:09.503582 21151 leader_election.cc:400] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11.
I20260709 12:18:09.503952 21151 leader_election.cc:403] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:18:09.497319 21103 rpcz_store.cc:276] 0709 12:18:08.044699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.045430 (+   731us) service_pool.cc:224] Handling call
0709 12:18:08.106838 (+ 61408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:08.107267 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:08.107296 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:08.107829 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:18:09.149222 (+1041393us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:09.149262 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.149325 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:09.496619 (+347294us) raft_consensus.cc:1685] finished
0709 12:18:09.496640 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.496804 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":985,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8670,"thread_start_us":707370,"threads_started":1,"wal-append.queue_time_us":1039295}
W20260709 12:18:09.506817 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 153771us
W20260709 12:18:09.507551 21711 leader_election.cc:336] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.799s (SENT)
I20260709 12:18:09.441579 24954 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:09.472052 24653 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:09.442091 24900 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.378165 25017 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:09.371189 24902 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.495370 24941 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:09.473232 24932 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:09.364555 25018 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:09.508764 21711 leader_election.cc:336] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.023s (SENT)
I20260709 12:18:09.525585 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:09.526713 21711 leader_election.cc:336] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.054s (SENT)
W20260709 12:18:09.531200 21711 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.161s (SENT)
I20260709 12:18:09.520478 24900 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:09.522511 25025 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:09.538652 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55759us
I20260709 12:18:09.540527 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:09.527129 24933 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:09.528827 24653 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.552753 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:09.529878 25023 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:09.525638 24954 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:18:09.540560 24932 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11.
I20260709 12:18:09.570523 21027 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:09.569200 21104 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:09.573813 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.574409 21027 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:09.576207 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:09.576994 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:09.578147 21027 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:09.566926 25021 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:18:09.520196 25004 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.567335 25031 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:09.577610 25016 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 12:18:09.581022 24615 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:18:09.588521 25023 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:09.594465 25017 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:09.543879 25025 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.567180 24933 consensus_queue.cc:1059] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:18:09.595917 21179 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:09.577802 24899 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.580440 24932 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:09.625006 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.625316 21029 raft_consensus.cc:2410] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:18:09.625584 21183 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:18:09.625674 21179 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:09.626056 21183 pending_rounds.cc:85] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 8
W20260709 12:18:09.599254 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 46545.6us
I20260709 12:18:09.599948 21077 leader_election.cc:400] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:09.570815 24653 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.580917 24575 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:09.583812 24859 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:09.572341 24900 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:18:09.619601 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.595356 25033 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:09.598062 25023 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:09.601850 24916 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.626365 21183 pending_rounds.cc:107] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 12:18:09.597777 25031 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.629462 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.631995 21182 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:09.636821 21077 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:09.602077 25039 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:09.648348 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.648927 21180 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
W20260709 12:18:09.636456 25026 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:18:09.640473 21183 raft_consensus.cc:2889] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:09.651800 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:09.643175 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.647619 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.653026 21179 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:18:09.647874 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.627290 21027 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:09.650220 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:09.637768 24933 raft_consensus.cc:3055] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:09.657210 21178 raft_consensus.cc:2393] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:09.656697 21077 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:09.658422 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 570) took 1812 ms. Trace:
I20260709 12:18:09.635936 24900 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:09.658978 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:09.660871 21035 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:09.661979 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.661312 24902 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:09.663740 25007 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:09.663986 25032 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:18:09.664386 25025 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.665668 25006 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.666039 24615 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:09.661571 25038 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:09.666482 24615 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.666878 24615 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.667865 25031 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.670763 24653 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.666637 25038 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:09.673110 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.674365 24615 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.644130 25023 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.659770 25017 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:09.676802 25017 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.677127 25017 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:09.679529 24900 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:09.680330 24900 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.681452 24900 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.681810 25006 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.651360 25033 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:09.683236 25033 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.685185 25033 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:09.660234 24933 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:09.682323 25006 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.685711 24615 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.635162 25036 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:09.660986 21184 rpcz_store.cc:276] 0709 12:18:07.845580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.645702 (+1800122us) service_pool.cc:224] Handling call
0709 12:18:09.657972 (+ 12270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.658134 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.658158 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:09.658198 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:09.658228 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.658287 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.658368 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.686908 25007 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:18:09.673242 25038 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:09.696758 25018 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.697417 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:09.704370 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:09.699620 21077 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:09.701746 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:09.705120 21035 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.706161 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.706704 21027 raft_consensus.cc:2376] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12. Re-sending same reply.
W20260709 12:18:09.711865 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 296872us
I20260709 12:18:09.712881 25031 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:09.714397 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.715250 21184 raft_consensus.cc:2410] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:18:09.716421 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.717845 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:09.708223 25001 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.709196 25018 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:09.707787 25015 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.725358 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:09.702975 25036 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:09.728650 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:09.728875 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.729190 21027 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.729406 21178 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:09.734393 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.736625 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.737187 21181 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:09.738533 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.739876 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.740408 21179 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:09.741751 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.755929 21027 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:18:09.723989 24930 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:09.757741 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.758141 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:09.758414 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:09.761312 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:09.728222 25038 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.764285 21181 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:09.764369 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.758435 25006 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:09.767011 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.686553 24933 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.771121 21184 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:09.773908 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:09.774513 21184 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.776542 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.778757 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:09.768221 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 276858us
W20260709 12:18:09.780581 21076 leader_election.cc:336] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.820s (SENT)
I20260709 12:18:09.780997 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.782336 21031 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:09.747278 24927 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:09.783196 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.777168 21179 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
W20260709 12:18:09.783818 21150 connection.cc:256] RPC call timeout handler was delayed by -1.2812771419999081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26789999999999997s for a response
I20260709 12:18:09.784422 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.786299 21150 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:09.786203 21076 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:09.732669 24931 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:18:09.788662 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:09.789535 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.790182 21104 raft_consensus.cc:2410] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:09.788769 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:09.792088 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:09.792693 21183 raft_consensus.cc:2393] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:09.792754 21031 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:09.794402 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:09.794667 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.794564 21149 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:09.796739 21106 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:09.797242 21104 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:09.751329 24795 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:09.798413 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.771369 25036 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:09.796075 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:09.799275 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:09.801458 21031 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:18:09.788949 25039 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:18:09.791982 25045 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.806659 21077 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:09.811618 21031 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:09.804145 21184 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:09.783509 25038 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.842823 21031 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:18:10.109987 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:10.297077 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 470) took 1723 ms. Trace:
I20260709 12:18:10.298542 21185 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:09.818655 21105 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:10.166061 21103 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:10.220822 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.813199 21027 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:10.300014 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:10.185817 21111 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:18:10.300292 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.832523 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2556) took 1357 ms. Trace:
I20260709 12:18:09.802021 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:09.826145 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:09.833737 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2359) took 2639 ms. Trace:
I20260709 12:18:09.834167 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:10.302718 21737 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:09.991607 21104 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:10.303913 21177 rpcz_store.cc:276] 0709 12:18:07.194097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.194221 (+   124us) service_pool.cc:224] Handling call
0709 12:18:07.196838 (+  2617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.881185 (+684347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.830731 (+1949546us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540024dbd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:09.833680 (+  2949us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572537216}
I20260709 12:18:10.296732 21031 pending_rounds.cc:85] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 6
I20260709 12:18:10.320166 21031 pending_rounds.cc:107] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:18:10.297606 21032 rpcz_store.cc:276] 0709 12:18:08.573823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.612694 (+ 38871us) service_pool.cc:224] Handling call
0709 12:18:09.762890 (+1150196us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800003698. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:18:09.763063 (+   173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.763361 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.763388 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.763819 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:18:09.790305 (+ 26486us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:09.802164 (+ 11859us) log.cc:844] Serialized 14 byte log entry
0709 12:18:09.802357 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.802423 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.237661 (+435238us) raft_consensus.cc:1685] finished
0709 12:18:10.237776 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.297005 (+ 59229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23189,"prepare.queue_time_us":11736,"raft.queue_time_us":20943,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":20548,"spinlock_wait_cycles":26163456,"thread_start_us":26139,"threads_started":1,"wal-append.queue_time_us":420545}
W20260709 12:18:10.136027 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 387167us
I20260709 12:18:09.833804 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:10.320596 21031 raft_consensus.cc:2889] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:10.321743 21002 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:10.323589 21027 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:09.910255 21743 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:10.156935 21149 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:10.084188 21107 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:10.302083 21028 rpcz_store.cc:276] 0709 12:18:08.475285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.586732 (+111447us) service_pool.cc:224] Handling call
0709 12:18:09.832361 (+1245629us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54000640d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:09.832473 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602106624}
I20260709 12:18:10.295090 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:10.301069 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:10.301632 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 521030us
I20260709 12:18:10.328758 21182 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:18:10.330943 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.331700 21076 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.837s (SENT)
I20260709 12:18:10.333223 21076 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:10.295403 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:10.081842 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:10.337883 21746 raft_consensus.cc:2393] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:10.328893 21032 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:09.831611 21740 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:10.060747 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:10.349875 21180 raft_consensus.cc:2376] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11. Re-sending same reply.
I20260709 12:18:10.302047 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:10.351565 21031 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:10.350932 21178 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:18:10.283272 25040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.015s
W20260709 12:18:10.360496 21035 consensus_meta.cc:287] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.000s
I20260709 12:18:10.354804 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:10.303586 25049 raft_consensus.cc:2764] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:18:10.444489 21035 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:10.444537 21179 raft_consensus.cc:2376] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8. Re-sending same reply.
I20260709 12:18:09.814085 24966 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:10.444656 25040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.007s	sys 0.030s
I20260709 12:18:10.351814 25061 consensus_queue.cc:1059] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 12:18:10.306383 24932 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.979736 25047 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:09.805194 24933 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.806396 25006 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:10.468655 21027 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:10.469120 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1959) took 2696 ms. Trace:
I20260709 12:18:09.806805 25018 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:09.839619 24902 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:10.473379 24900 consensus_meta.cc:287] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.000s
I20260709 12:18:10.479112 21106 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:18:10.471240 20930 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 10, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 10 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:09.826040 24859 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.565s
I20260709 12:18:10.481148 21186 rpcz_store.cc:276] 0709 12:18:07.772546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.359442 (+2586896us) service_pool.cc:224] Handling call
0709 12:18:10.468624 (+109182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.468811 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.468837 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:10.468875 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:10.468909 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.468961 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.469064 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.830713 25017 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:09.811508 25050 consensus_queue.cc:1059] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.662s
I20260709 12:18:09.802016 25046 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:10.484396 21036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.017s	sys 0.021s
W20260709 12:18:10.486008 25000 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:18:10.480607 25004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.034s	sys 0.021s
I20260709 12:18:10.490226 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1663) took 1339 ms. Trace:
W20260709 12:18:10.480340 25023 consensus_meta.cc:287] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.000s
I20260709 12:18:10.507674 21034 rpcz_store.cc:276] 0709 12:18:09.151179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.151304 (+   125us) service_pool.cc:224] Handling call
0709 12:18:10.485025 (+1333721us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003d4fd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:10.490161 (+  5136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243751680}
W20260709 12:18:10.515594 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.519377 21738 raft_consensus.cc:606] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:10.329232 24931 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
W20260709 12:18:10.501724 21036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.017s	sys 0.021s
I20260709 12:18:10.327414 24908 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:09.813288 25045 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:10.368460 24795 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.124s
W20260709 12:18:10.496176 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 694179us
I20260709 12:18:10.535758 21151 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:10.530869 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 202180us
I20260709 12:18:10.494575 25047 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:18:10.531286 25056 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 12:18:10.508092 25006 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:10.532986 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 699181us
I20260709 12:18:10.530524 24908 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.515161 25018 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.546269 25017 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:10.519167 25023 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.511473 25029 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:10.494619 25025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.040s
I20260709 12:18:10.495079 24902 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.554075 21077 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:10.531215 25050 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:10.520859 25046 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.564070 24908 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.483973 24932 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:10.559875 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:10.568851 25025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.040s
I20260709 12:18:10.561363 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:10.562522 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:10.570290 21034 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:10.583261 21181 raft_consensus.cc:2410] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:10.553256 25006 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.549006 25047 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:10.555889 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 398997us
I20260709 12:18:10.580227 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:10.588260 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.585150 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:10.571972 25050 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:10.592468 21029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2503) took 3367 ms (client timeout 2193 ms). Trace:
W20260709 12:18:10.596681 21029 rpcz_store.cc:269] 0709 12:18:07.225972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.231767 (+  5795us) service_pool.cc:224] Handling call
0709 12:18:10.592257 (+3360490us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b540035cd54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:10.592384 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5471358848}
I20260709 12:18:10.583657 25017 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:10.601766 25017 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:10.602317 25045 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:10.599315 24900 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:10.597692 24931 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:10.600452 24902 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:10.601146 24932 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:10.586426 25006 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.591262 25018 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:10.612931 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 281240us
W20260709 12:18:10.615667 21076 leader_election.cc:336] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.904s (SENT)
I20260709 12:18:10.598613 25050 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.616231 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:10.591528 25077 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:10.616011 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 80322.7us
I20260709 12:18:10.585769 25046 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.615118 25071 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:10.623201 25071 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:10.623553 25071 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.624361 25046 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:10.610366 25038 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:10.618300 25069 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:10.602717 25017 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:10.611920 24900 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.628829 21738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53714 (request call id 0) took 1302 ms. Trace:
I20260709 12:18:10.629421 24900 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:10.629159 21738 rpcz_store.cc:276] 0709 12:18:09.334225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.343013 (+  8788us) service_pool.cc:224] Handling call
0709 12:18:10.628664 (+1285651us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400561654. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f98e853 00007fcba495c60a 00007fcb9dee27d4 00007fcb9dee2762 00007fcb9dee2691 00007fcb9dee260c 00007fcb9dee18c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:10.628749 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2703579904}
I20260709 12:18:10.632581 21182 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:10.642889 21076 leader_election.cc:336] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.939s (SENT)
I20260709 12:18:10.643354 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:10.615808 24931 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:10.659708 24931 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.664212 25075 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.664673 25075 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.666594 25015 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:10.646317 24989 consensus_queue.cc:1059] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:10.634778 24902 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.651916 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:10.654171 25071 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:10.658275 25067 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:10.670475 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:10.676154 21182 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.641376 25077 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:10.679287 24902 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.681231 24902 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:10.682660 25071 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:10.685813 21182 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:10.687106 21712 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:10.688063 25019 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:10.688560 25019 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:10.689371 25019 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:10.674084 21151 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:10.693600 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:10.698251 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55398.2us
I20260709 12:18:10.703006 21151 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:10.677358 25006 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:10.709446 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.712538 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:10.713536 25066 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.717222 25050 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:10.718034 25066 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.710438 25029 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:10.715917 25077 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.666639 25075 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:10.711903 21711 leader_election.cc:336] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.849s (SENT)
W20260709 12:18:10.707948 21076 leader_election.cc:336] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.084s (SENT)
I20260709 12:18:10.740473 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:10.720297 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:10.718552 21181 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:18:10.732781 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:10.733652 21033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35652 (request call id 467) took 2208 ms (client timeout 1714 ms). Trace:
I20260709 12:18:10.740747 21076 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:10.748916 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 50091.5us
I20260709 12:18:10.672482 25023 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:10.645470 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1689) took 1128 ms. Trace:
W20260709 12:18:10.747466 21033 rpcz_store.cc:269] 0709 12:18:08.524836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.529021 (+  4185us) service_pool.cc:224] Handling call
0709 12:18:10.733491 (+2204470us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54002b84d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:10.733586 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656758144}
I20260709 12:18:10.752597 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:10.752786 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:10.753816 21076 leader_election.cc:336] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 3.013s (SENT)
I20260709 12:18:10.754614 21109 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:18:10.749445 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 91459.7us
I20260709 12:18:10.758224 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:10.759151 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:10.718425 25066 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.759759 21105 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:10.753989 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:10.759546 21151 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:10.709863 25071 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:10.764801 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:10.707883 25078 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:10.747494 25045 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:10.770677 21076 leader_election.cc:336] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.101s (SENT)
I20260709 12:18:10.774745 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:10.780357 21109 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:10.750644 25015 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:10.752437 24941 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.750213 24989 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:10.782629 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:10.762063 25046 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:10.785188 25006 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:10.787352 25078 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:10.788160 21076 leader_election.cc:336] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.193s (SENT)
I20260709 12:18:10.801234 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:10.788693 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:10.788882 25068 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:10.754133 21036 rpcz_store.cc:276] 0709 12:18:09.517194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.832212 (+315018us) service_pool.cc:224] Handling call
0709 12:18:09.832498 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.912939 (+ 80441us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:09.913251 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.567125 (+653874us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.573488 (+  6363us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.586871 (+ 13383us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:10.589291 (+  2420us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.645163 (+ 55872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.645246 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.645286 (+    40us) raft_consensus.cc:1685] finished
0709 12:18:10.645300 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.645411 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60454,"prepare.queue_time_us":77594,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":3237,"raft.queue_time_us":167009,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":211,"spinlock_wait_cycles":18456320,"thread_start_us":653424,"threads_started":2,"wal-append.queue_time_us":624068}
I20260709 12:18:10.790690 21184 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:10.784875 24908 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.766665 24965 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:10.798105 21709 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:10.803305 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.808156 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:10.773828 25076 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:10.835567 21102 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:10.837023 21000 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:10.840281 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 52145.7us
I20260709 12:18:10.840452 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:10.794535 25038 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:18:10.793068 25015 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:10.854013 21182 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:10.846666 24931 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:10.842803 24965 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:10.848990 25019 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:10.793860 24989 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:11.094372 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.957860 25088 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:18:10.957794 21030 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 5. Current term is 7. Ops: []
I20260709 12:18:11.126466 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 471) took 2499 ms. Trace:
I20260709 12:18:10.841691 25045 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:18:11.131423 21150 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:10.859262 24932 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:10.968057 25080 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:18:10.985086 25050 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:10.967495 25081 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:18:10.977562 24908 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:10.844964 25046 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:18:11.010998 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.859362 24902 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:18:10.850572 25071 raft_consensus.cc:697] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:10.852450 25006 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:10.974539 25086 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:18:10.982029 25047 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:10.983331 21036 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:10.861474 25015 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:11.103341 21076 leader_election.cc:336] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.774s (SENT)
I20260709 12:18:11.108162 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:11.112284 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 314874us
W20260709 12:18:11.029974 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 194106us
I20260709 12:18:10.983810 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1925) took 1647 ms. Trace:
W20260709 12:18:11.014055 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.199729 21110 rpcz_store.cc:276] 0709 12:18:09.336044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.336168 (+   124us) service_pool.cc:224] Handling call
0709 12:18:09.336448 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.365174 (+ 28726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.983589 (+1618415us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b54003697d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:10.983754 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53280640}
I20260709 12:18:10.968258 24899 raft_consensus.cc:3055] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:11.171598 21177 raft_consensus.cc:3055] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:11.119652 25019 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.188848 24948 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.193691 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:11.172497 25067 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:11.200315 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.210209 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.208673 21183 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:11.126830 21030 rpcz_store.cc:276] 0709 12:18:08.626616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.894567 (+2267951us) service_pool.cc:224] Handling call
0709 12:18:10.957622 (+ 63055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:11.126177 (+168555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.126407 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:11.211118 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:11.211889 21744 raft_consensus.cc:2410] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:18:11.212370 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.199939 21709 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:11.199585 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 96290.6us
I20260709 12:18:11.202479 21177 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:18:11.187050 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 55711.9us
I20260709 12:18:11.191074 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:11.209192 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 440226us
I20260709 12:18:11.173132 25068 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:18:11.214017 21108 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:11.207865 25019 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:11.173012 25049 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:18:11.237337 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:11.229007 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.197965 24795 raft_consensus.cc:3055] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:11.246381 21741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:53714
I20260709 12:18:11.246927 21741 raft_consensus.cc:606] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:11.233654 21110 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:11.234952 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:11.202303 24899 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:11.203408 24941 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:11.210477 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:11.238374 21076 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.865s (SENT)
I20260709 12:18:11.243497 21177 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:11.209798 20919 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 40fd334874764b26ba28ac382c4199f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a1b891e53adc40a6a1ae813238321e93 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:11.251227 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:11.253866 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.237799 24965 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:11.213982 25079 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:18:11.245939 24795 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:18:11.281610 21106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1935) took 1282 ms (client timeout 1675 ms). Trace:
W20260709 12:18:11.282011 21106 rpcz_store.cc:269] 0709 12:18:09.999343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.999473 (+   130us) service_pool.cc:224] Handling call
0709 12:18:11.281470 (+1281997us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000dd9d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:11.281560 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347689856}
I20260709 12:18:11.286265 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.267467 25068 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:18:11.267318 25067 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:18:11.291548 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:11.292092 21104 raft_consensus.cc:606] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:11.292390 21104 raft_consensus.cc:614] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:11.293517 21747 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:11.294027 24960 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.294474 24960 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:11.262571 25071 consensus_queue.cc:237] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.314406 24989 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:11.318993 24899 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.320039 24899 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:11.321321 25047 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:11.285598 25023 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:11.267586 25029 consensus_queue.cc:1059] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:18:11.267477 25057 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:18:11.265750 24941 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:11.263190 25066 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:11.348143 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 143844us
I20260709 12:18:11.355769 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.393702 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:11.394883 21104 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:11.396056 21029 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:11.395991 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:11.397327 21108 raft_consensus.cc:2410] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:18:11.400267 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:11.324687 25009 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:11.431524 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.434316 21104 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:11.435310 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:11.395630 25047 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.355165 25029 consensus_queue.cc:1243] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:11.437222 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:11.437459 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 206970us
I20260709 12:18:11.438625 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:11.440629 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.440891 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:11.435655 21103 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:18:11.506945 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.506834 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:11.577299 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 141322us
I20260709 12:18:11.508879 21185 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:11.526917 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:11.509519 21178 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:11.584532 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1981) took 1040 ms. Trace:
I20260709 12:18:11.525346 21107 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:11.584951 21186 rpcz_store.cc:276] 0709 12:18:10.544203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.544332 (+   129us) service_pool.cc:224] Handling call
0709 12:18:10.544710 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:10.583645 (+ 38935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.583687 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:10.586389 (+  2702us) log.cc:844] Serialized 52 byte log entry
0709 12:18:10.673723 (+ 87334us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:10.673765 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.584170 (+910405us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b540001a4d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:11.584222 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:11.584261 (+    39us) raft_consensus.cc:1685] finished
0709 12:18:11.584274 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.584478 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34096,"raft.queue_time_us":38214,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"spinlock_wait_cycles":64425856,"thread_start_us":57371,"threads_started":1,"wal-append.queue_time_us":142873}
I20260709 12:18:11.582345 21105 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.590346 20930 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 9, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 9 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:11.593636 20930 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:11.583539 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 345168us
W20260709 12:18:11.595674 21076 leader_election.cc:336] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.920s (SENT)
W20260709 12:18:11.597390 21076 leader_election.cc:336] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.249s (SENT)
I20260709 12:18:11.597764 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:11.599463 25070 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:11.581472 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.525369 21108 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:11.508095 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:11.600358 21036 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:11.600853 21181 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:11.603408 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 372287us
W20260709 12:18:11.578263 25100 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:18:11.605219 21102 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:18:11.607817 21076 leader_election.cc:336] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.109s (SENT)
I20260709 12:18:11.609724 21076 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:11.604840 25076 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:11.577415 25098 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:11.623677 25098 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:11.624028 25098 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.625039 25027 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:11.628821 21105 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:11.503010 24989 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.631235 24989 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.632524 25019 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:11.614995 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:11.634152 21149 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:11.634481 25019 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:11.635200 21149 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:11.636036 25045 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:11.616062 21076 leader_election.cc:336] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.110s (SENT)
I20260709 12:18:11.544111 25080 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:11.637770 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:11.644517 21076 leader_election.cc:336] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 3.468s (SENT)
W20260709 12:18:11.619922 21747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 767) took 2356 ms (client timeout 1557 ms). Trace:
I20260709 12:18:11.439342 25009 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.645093 21076 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:11.643316 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:11.638640 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:11.646401 21747 rpcz_store.cc:269] 0709 12:18:09.263289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.263402 (+   113us) service_pool.cc:224] Handling call
0709 12:18:11.619758 (+2356356us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54006a6b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:11.619851 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4555980032}
W20260709 12:18:11.648518 21076 leader_election.cc:336] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.192s (SENT)
I20260709 12:18:11.650478 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:11.653175 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.653419 21102 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:18:11.653522 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.653764 21036 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:11.624185 24941 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:11.516572 25047 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.660491 21712 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:11.664680 25067 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:11.666217 25067 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:11.666996 21102 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:11.667541 25066 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:11.667948 25078 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:11.668300 25066 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:11.669575 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:11.643872 25080 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:11.651157 25050 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:11.671402 25050 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.671707 21742 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:18:11.671526 25080 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:11.650074 25098 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.637176 25046 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:18:11.441246 24795 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.674459 25098 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:11.658625 25019 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:11.675014 24795 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.643628 24989 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:11.687285 25102 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.687750 25029 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:11.688603 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.689533 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.690641 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:11.690917 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.691316 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:11.691761 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.691972 21033 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:11.682657 25045 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:11.692991 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.693312 25045 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:11.682855 25018 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.696827 25023 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:11.682992 25027 consensus_queue.cc:1175] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 10 status { last_received { term: 9 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:11.683116 25050 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.699005 21177 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.699208 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.700183 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.700680 21036 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:11.701375 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.702250 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.704483 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.704615 21181 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:11.683391 25034 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:18:11.705955 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.708736 21002 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:11.691884 21034 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:11.686014 25009 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:11.705547 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.711987 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.712548 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.708923 21181 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:11.706676 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.705181 21033 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:11.713960 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.714108 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.713069 21032 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:11.714334 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.711932 21030 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:11.705895 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:11.722510 25104 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.723034 25104 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.724314 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:11.725044 25104 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:11.725562 25107 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:11.726056 25107 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.726375 25107 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.728178 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.721889 24948 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:11.732208 21028 raft_consensus.cc:3055] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:11.733079 21036 raft_consensus.cc:3055] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:11.733443 21027 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:11.734315 21032 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:11.732533 21028 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:11.733420 21036 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:11.738886 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:11.740847 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:11.742233 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:11.742813 21185 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:11.744174 21179 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:11.693852 25045 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.745200 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:11.745908 21179 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:11.717762 25029 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.747092 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:11.747234 25029 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.747973 24960 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:11.748188 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:11.748801 21180 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:11.749197 25029 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:11.749890 21180 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:18:11.750710 21181 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:11.709519 25020 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:11.751747 25020 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:11.752082 25020 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:11.753243 25050 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.755080 21028 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:11.716588 24916 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:18:11.756114 21028 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:11.756807 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 48145.3us
W20260709 12:18:11.758628 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.758862 24948 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:11.759635 24948 raft_consensus.cc:3055] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:11.760011 24948 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:11.760748 24948 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:11.698724 25070 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:11.684010 25047 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:11.765522 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.750780 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.761885 24948 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.738193 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:11.767587 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.769022 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.767361 21738 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:18:11.746603 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:11.771034 21035 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:11.771615 21029 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:11.739233 21036 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:11.660444 25071 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:18:11.775028 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.775163 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.774013 21033 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:11.775835 21031 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:11.759573 24939 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:11.777985 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.778126 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.781590 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.778690 21030 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:11.782168 21035 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.782027 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:11.783118 21184 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:11.784029 21184 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:11.785869 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:11.777520 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.762640 25038 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.787019 21033 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:11.792307 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.787226 21027 raft_consensus.cc:2410] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:18:11.787488 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:11.793052 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1977) took 1439 ms. Trace:
I20260709 12:18:11.788657 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:11.793869 21184 raft_consensus.cc:2376] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7. Re-sending same reply.
I20260709 12:18:11.793453 21177 rpcz_store.cc:276] 0709 12:18:10.353266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.353410 (+   144us) service_pool.cc:224] Handling call
0709 12:18:10.471879 (+118469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:11.171512 (+699633us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b54001e85a0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f90bdc0 00007fcb9f9961c0 00007fcb9f997231 00007fcb9f993d8f 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c
0709 12:18:11.698624 (+527112us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b58007d3cd0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f8f00aa 00007fcb9f972447 00007fcb9f98afe7 00007fcb9f98c7de 00007fcb9f996b49 00007fcb9f997416 00007fcb9f993d8f 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4
0709 12:18:11.785157 (+ 86533us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:11.785184 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:11.792788 (+  7604us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:11.792840 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.792903 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.792999 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48460,"raft.queue_time_us":49553,"spinlock_wait_cycles":912550016}
I20260709 12:18:11.789491 21181 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:11.766989 25079 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:11.789922 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 154785us
I20260709 12:18:11.798329 21149 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:11.800817 21185 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:11.801934 21036 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.777226 24960 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:11.806090 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.806664 21034 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:11.807617 21077 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:11.794732 24939 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:11.818431 24939 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.815006 25111 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:11.821892 25111 raft_consensus.cc:697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:11.822722 25111 consensus_queue.cc:237] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.794253 25047 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:11.824245 25047 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.824579 25047 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:11.804121 24859 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:18:11.773011 24899 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:18:11.831393 21712 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:11.805460 24965 consensus_meta.cc:287] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.000s
I20260709 12:18:11.833312 21035 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:11.834360 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.835108 21035 raft_consensus.cc:2410] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:18:11.835791 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.816289 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:11.836896 21029 raft_consensus.cc:2410] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:11.802253 25038 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.844410 21036 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:11.812321 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:11.827322 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:11.845816 21028 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.804050 24960 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:11.794713 25070 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:18:11.812927 25050 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:11.803278 24932 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:18:11.857280 21178 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:11.859535 21028 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:11.808564 25079 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.848392 25042 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:11.849318 24965 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:11.899907 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 101665us
I20260709 12:18:11.901789 21149 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:11.850489 24899 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:11.908618 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 53089.1us
W20260709 12:18:11.909301 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.912581 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.921432 21184 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:11.902199 25042 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.907953 25006 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.899832 25029 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.900332 25128 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:11.910313 24899 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:11.913123 25071 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:11.872613 24896 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:18:11.929649 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:11.927201 25042 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.940727 24932 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:11.941445 25071 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.945168 25070 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.940914 25095 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:18:11.931430 25006 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:12.023089 20999 connection.cc:256] RPC call timeout handler was delayed by -6.5018398940001134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 12:18:11.952755 24795 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:11.937759 25029 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:11.953470 25111 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.065923 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:12.024511 21076 leader_election.cc:336] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.703s (SENT)
I20260709 12:18:11.926609 24960 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:11.963889 25071 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.067509 21076 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:12.069494 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45017.5us
I20260709 12:18:12.024644 25138 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:12.075052 21076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 3.023s (SENT) [suppressed 36 similar messages]
I20260709 12:18:12.030648 25127 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:12.029953 24795 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:12.083143 25001 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:12.085867 25045 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:12.090199 25131 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:18:12.029496 24932 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:12.124109 21034 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:12.090117 25038 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:18:11.963195 24899 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.124822 24960 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:12.122815 25023 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:12.027372 25070 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.131393 25128 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:12.069900 25111 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:12.152968 25136 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:18:12.156579 25121 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 12:18:12.186702 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 120864us
I20260709 12:18:12.188549 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.189857 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.191082 21031 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 14: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:12.190944 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:12.191474 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 261878us
I20260709 12:18:12.191933 21035 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:12.192227 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.177333 25038 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.193742 21031 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:12.183997 25001 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:12.200244 25001 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.201434 25128 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.202284 25001 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:12.185397 24939 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:12.202836 24939 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:12.203323 24939 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.196725 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.204257 21029 raft_consensus.cc:2368] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
W20260709 12:18:12.204504 25137 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:18:12.197456 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.205634 25070 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:12.193061 25141 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:18:12.209028 25098 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:12.209415 25098 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:12.210162 25098 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.125988 25138 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.211153 24932 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.212342 25006 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:12.212809 24939 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.219115 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.220376 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.220958 21107 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:12.197876 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:12.198833 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.225728 21151 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:12.226488 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.227104 21107 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:12.239686 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.241613 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.242533 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.243283 21107 raft_consensus.cc:2368] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:18:12.249698 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.249943 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.250289 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.250438 21105 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.251153 21110 raft_consensus.cc:2410] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:12.253165 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.253722 21107 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:18:12.254532 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.255230 21104 raft_consensus.cc:2368] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12.
W20260709 12:18:12.206399 25130 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:18:12.203446 25132 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:18:12.261662 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:12.176733 25023 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.264123 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.265321 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:12.265964 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.266151 21738 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:12.270059 21105 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:12.272658 21738 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:18:12.276253 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.276907 21028 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:12.277719 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.278380 21030 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:12.282137 21106 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:12.282261 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.283212 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.283492 21102 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:12.284096 21102 pending_rounds.cc:85] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 5
I20260709 12:18:12.284322 21102 pending_rounds.cc:107] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:18:12.284551 21102 raft_consensus.cc:2889] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:12.284816 21107 raft_consensus.cc:1217] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Deduplicated request from leader. Original: 7.4->[10.5-10.5]   Dedup: 10.5->[]
I20260709 12:18:12.285769 21107 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:18:12.286873 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.283612 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.287339 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.283149 21103 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:12.287869 21107 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.285737 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.289153 21105 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:12.289242 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.290376 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.291255 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.292335 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.288585 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.294121 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.294260 21103 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:12.295156 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.295531 21106 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:12.295689 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.295626 21035 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:12.295883 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.296253 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.296942 21105 raft_consensus.cc:2410] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:12.299221 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.299767 21029 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:12.300350 21031 raft_consensus.cc:2368] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:12.301204 21028 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:12.307039 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.214043 25047 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:12.321945 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:12.322423 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:12.322717 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.326666 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.327278 21032 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:12.328007 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.307729 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.275234 25098 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:12.309430 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.310952 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.311203 25138 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:12.259742 24965 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:18:12.190572 24795 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.334589 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.317644 25079 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:12.318018 21035 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:12.244071 25038 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.329095 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.329746 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.257752 25006 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:18:12.329936 21076 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:12.360272 25108 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.755s	user 0.002s	sys 0.001s
I20260709 12:18:12.360561 25038 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:12.360817 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.361569 21032 raft_consensus.cc:2393] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:12.362190 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 519) took 1638 ms. Trace:
I20260709 12:18:12.260149 25070 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:18:12.330786 21181 pending_rounds.cc:85] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 7
I20260709 12:18:12.331483 21102 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:12.334149 21029 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:12.377027 21181 pending_rounds.cc:107] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:18:12.377399 21181 raft_consensus.cc:2889] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:12.356916 21177 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:12.357491 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.357553 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.362367 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.362807 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.380224 21032 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:12.380362 21035 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:12.377041 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.381556 21106 raft_consensus.cc:2410] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:18:12.308702 25029 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:12.356096 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.379737 21111 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:12.362564 21109 rpcz_store.cc:276] 0709 12:18:10.723587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.841609 (+118022us) service_pool.cc:224] Handling call
0709 12:18:10.893041 (+ 51432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.893434 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.893463 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.893923 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:18:11.287439 (+393516us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b180030c520. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b 00007fcb9f533d23 00007fcb9f5340d1 00007fcb9f94fa0f
0709 12:18:11.436344 (+148905us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:11.436383 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.436448 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.359623 (+923175us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:12.361991 (+  2368us) raft_consensus.cc:1685] finished
0709 12:18:12.362010 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.362130 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":60659,"spinlock_wait_cycles":179299968,"thread_start_us":148740,"threads_started":1,"wal-append.queue_time_us":623878}
I20260709 12:18:12.385550 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:12.322500 25047 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:12.390793 25080 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:12.392243 24939 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:12.395577 21107 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
W20260709 12:18:12.401453 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.386135 21739 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:12.403256 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.330700 25141 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:12.419166 25074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.009s	sys 0.004s
W20260709 12:18:12.419533 25074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.009s	sys 0.004s
I20260709 12:18:12.404937 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.421684 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:12.405467 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:12.422637 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.406409 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.417717 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.418015 21029 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:12.424823 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.418635 21150 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:12.423735 21031 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:12.428758 21106 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:12.429736 21104 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:12.433753 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.434513 21107 raft_consensus.cc:2368] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11.
I20260709 12:18:12.435601 21109 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:12.376835 25023 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:12.436057 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.438941 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:12.439939 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 105421us
I20260709 12:18:12.361601 25154 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:12.442893 21029 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:12.444506 21035 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
W20260709 12:18:12.445883 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 85139.8us
I20260709 12:18:12.446280 21028 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
W20260709 12:18:12.446628 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.446589 21076 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.439545 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:12.448359 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 202520us
I20260709 12:18:12.431058 24795 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:12.427775 25095 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:12.455749 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.456820 25154 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:12.457968 24899 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:12.456575 21076 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:12.488445 21076 leader_election.cc:400] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:12.489387 21076 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:12.461391 21103 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 11. Ops: []
I20260709 12:18:12.466274 20930 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 9, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 9 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:12.469864 24916 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:18:12.472450 25147 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.163s	user 0.003s	sys 0.000s
W20260709 12:18:12.474323 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 73038.4us
I20260709 12:18:12.430923 25045 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:12.483404 21109 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:12.483758 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:12.483731 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 258056us
I20260709 12:18:12.484884 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.490698 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.497344 21076 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.494685 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.498664 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:12.496258 21102 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:18:12.519322 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:12.533875 21076 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.477298 25023 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:12.477394 25095 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:12.521248 25070 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:12.525647 25144 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:12.525825 25078 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:12.525532 25047 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:12.526036 25150 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:12.521540 25141 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:12.530156 21104 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:12.492645 25111 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:12.537032 21711 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:12.547544 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.548482 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.499442 25001 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:12.567876 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:12.510313 25128 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:12.550194 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 47746.1us
I20260709 12:18:12.551460 21178 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:12.551251 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 52653.8us
I20260709 12:18:12.576045 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.576464 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.557302 25104 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:12.565289 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 115304us
W20260709 12:18:12.557699 21149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.006s	sys 0.003s
W20260709 12:18:12.582615 21149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.006s	sys 0.009s
I20260709 12:18:12.556350 25095 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:12.566457 25148 log.cc:927] Time spent T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:18:12.561653 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.556080 25018 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:12.582337 21076 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:12.582993 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 640657us
I20260709 12:18:12.583364 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:12.551929 24941 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:12.577812 21151 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:12.600881 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:12.601476 21177 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:12.601500 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:12.584872 21111 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:12.588105 21104 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:12.606976 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:12.607597 21102 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:12.607928 21102 pending_rounds.cc:85] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 5
I20260709 12:18:12.608147 21102 pending_rounds.cc:107] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:18:12.608362 21102 raft_consensus.cc:2889] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:12.609182 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:12.609313 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:12.609762 21177 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:12.609869 21185 raft_consensus.cc:2376] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12. Re-sending same reply.
I20260709 12:18:12.609321 21711 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.577159 25111 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:12.578696 24965 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:12.611304 21076 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.618484 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.620226 21076 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.613363 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.575155 25128 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:12.565047 25078 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.612192 24941 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:12.614223 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:12.614938 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:12.615918 21180 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:12.611315 21077 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:18:12.607376 25020 consensus_meta.cc:287] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.855s	user 0.006s	sys 0.013s
I20260709 12:18:12.591737 25023 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:12.616856 25070 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:12.621719 25164 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:12.628798 25155 log.cc:927] Time spent T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:18:12.697016 25172 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:12.698037 21109 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:18:12.629635 25107 consensus_meta.cc:287] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.903s	user 0.005s	sys 0.005s
I20260709 12:18:12.630064 25111 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:12.619154 25006 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:12.566486 25047 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.631127 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.607160 25104 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:12.627897 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:12.616407 25151 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:18:12.612233 25045 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:12.681756 25163 log.cc:927] Time spent T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:18:12.620110 24965 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:12.621317 25141 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:12.684722 21184 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:12.624282 25161 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:18:12.685508 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 46124.7us
I20260709 12:18:12.686167 21186 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:18:12.625066 25071 consensus_meta.cc:287] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.003s
I20260709 12:18:12.750790 25071 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.752691 25071 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:12.692006 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 80760.4us
I20260709 12:18:12.695292 25167 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:12.700237 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 90988.7us
I20260709 12:18:12.754588 21077 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.702432 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:12.627511 25042 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.000s
I20260709 12:18:12.757262 25042 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.757404 25169 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:12.759008 21108 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:12.759236 25042 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:12.759624 21743 raft_consensus.cc:2368] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:12.759888 21179 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:12.708863 21107 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:18:12.760993 25167 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:12.761854 25047 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:12.762388 25047 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:12.683527 25023 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:12.776029 25170 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 12:18:12.582446 25154 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.687430 25070 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:12.687129 25164 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:12.735431 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:12.735452 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.739252 25078 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:12.740437 25018 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.744959 21184 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:12.663559 25128 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:12.764112 25153 log.cc:927] Time spent T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
I20260709 12:18:12.710489 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.762635 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.841382 21107 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.759819 25042 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:18:12.766363 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:12.770251 25103 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.770953 25076 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:12.685487 25020 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.729882 25045 raft_consensus.cc:697] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:12.729457 24965 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.766300 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.868700 21103 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:12.762225 25167 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:12.703044 25111 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:12.705591 25034 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:12.699638 25107 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.763948 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:12.880645 21107 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:12.819804 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:12.881289 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 61557.9us
W20260709 12:18:12.829691 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 94331.2us
I20260709 12:18:12.882421 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:12.834434 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:12.883323 21180 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.836099 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:12.884389 21185 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:12.837916 21177 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:12.626998 25144 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:12.840277 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.886533 21036 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:12.840907 21106 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:12.813482 25080 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.756651 24899 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:12.817287 25070 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:12.862119 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 241937us
I20260709 12:18:12.915796 20999 leader_election.cc:400] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8.
I20260709 12:18:12.865674 20930 catalog_manager.cc:5697] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 6 to 7, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 7 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:12.839463 24896 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:12.827320 25164 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.935079 25045 consensus_queue.cc:237] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.936376 25176 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:12.936972 25176 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:12.937813 25176 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.913870 25080 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.889094 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.889747 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.890405 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:12.967105 21035 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:12.892567 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.892876 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:12.968127 21032 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.775982 25104 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.905238 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:12.968992 21106 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:12.905861 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:12.912257 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.969439 21107 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.846930 25078 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 12:18:12.919054 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 162312us
I20260709 12:18:12.970726 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:12.919636 20999 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:12.973263 21739 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:12.880496 25111 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:12.921967 21105 raft_consensus.cc:2393] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:12.922284 21742 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:18:12.980795 21742 pending_rounds.cc:85] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Aborting all ops after (but not including) 8
I20260709 12:18:12.981033 21742 pending_rounds.cc:107] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:18:12.981282 21742 raft_consensus.cc:2889] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:12.922988 24896 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:12.845098 25018 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.927039 25009 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:12.929812 25095 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:13.002876 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 83337.6us
I20260709 12:18:13.003638 20999 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:12.854683 25103 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.932288 24795 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:12.934640 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.861575 25076 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:12.782660 25023 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.958581 21034 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:12.942992 25177 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:18:12.831200 24941 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:12.939026 25168 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:12.959148 21103 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:12.962260 21180 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:12.917727 21111 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
W20260709 12:18:12.963984 25170 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:12.965287 24989 consensus_queue.cc:1059] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:18:13.016350 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:13.017025 21103 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:13.017864 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:12.982122 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 61429.5us
I20260709 12:18:12.985316 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:13.000594 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:13.020929 20999 leader_election.cc:400] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12.
I20260709 12:18:13.021229 20999 leader_election.cc:403] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:13.000057 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 179894us
I20260709 12:18:12.981303 25057 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:12.997897 24896 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:13.012776 21149 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:12.983441 21107 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:12.999946 25009 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.015990 21178 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:18:13.022078 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.024327 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:13.028172 21149 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:13.026437 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:13.029882 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.007324 25149 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:13.002755 25046 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:18:13.033854 21108 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:13.035681 21149 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:13.034760 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:13.036854 21108 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.037575 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:13.038226 21107 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:13.012012 25168 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:13.025013 25159 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:13.044891 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.031420 25009 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.027024 25075 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12.
I20260709 12:18:13.030828 25057 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.041154 24902 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:13.041025 25098 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:13.091070 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:13.033893 25047 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:13.102240 21149 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.106769 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:13.046639 25143 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:13.101542 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:13.107580 21744 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:13.100414 21032 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:13.047879 25168 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:13.079640 25010 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:13.111080 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:13.046888 25162 log.cc:927] Time spent T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.576s	user 0.000s	sys 0.006s
I20260709 12:18:13.102761 25098 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.160802 25098 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.160518 24965 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.043040 24931 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:13.167973 25057 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.168545 21109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:13.111574 25047 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.171859 24896 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.126148 25157 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:13.172910 25047 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.131227 21108 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:13.174612 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:13.107892 21106 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:13.071318 25107 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.073443 25018 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.080865 25103 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:13.074368 25001 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:13.069438 25076 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.046358 25144 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.109761 24908 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:13.155448 25182 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:18:13.127122 25080 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:13.157660 25111 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:13.159337 25152 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.698s	user 0.004s	sys 0.000s
I20260709 12:18:13.111057 25143 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.072427 25128 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.198176 21180 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:13.086136 25164 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.066105 25070 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.073674 25072 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 12:18:13.177906 21149 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:13.179993 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 136817us
I20260709 12:18:13.110020 24902 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:13.200035 25107 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:13.109015 25020 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.195930 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:13.184044 25001 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:13.198675 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:13.202723 21002 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:13.118125 21107 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:13.209299 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:13.211645 21186 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:13.212013 21184 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:13.209880 21185 raft_consensus.cc:2393] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:13.213369 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:13.214303 21109 raft_consensus.cc:606] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:13.214533 21149 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:13.214895 21109 raft_consensus.cc:614] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:13.215653 21747 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:13.215672 21104 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:13.216320 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:13.197867 25143 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:13.218206 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:13.226214 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:13.226459 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 181635us
I20260709 12:18:13.209067 25103 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:13.230183 21150 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.185364 25144 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.210602 24965 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:13.236763 25186 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:13.223740 25018 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:13.224799 25046 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:13.227947 25095 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.223949 25047 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:13.233500 25103 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.224162 25188 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:13.261348 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.265697 20999 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.269539 25027 raft_consensus.cc:3055] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:13.269817 25098 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.246055 25018 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:13.271106 25018 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:13.274891 25010 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:13.276561 25009 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:13.277534 25171 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.818s	user 0.004s	sys 0.004s
I20260709 12:18:13.278553 25009 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.278785 21186 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:18:13.278860 25027 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:13.279491 21033 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:13.279735 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.280915 25128 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.281915 25164 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.227288 25075 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:18:13.284755 20999 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.290609 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:13.293874 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:13.296118 21032 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:13.291113 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:13.296591 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.296698 21186 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.297153 21027 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:13.264647 25047 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.264091 25103 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.264292 25188 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.300776 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:13.266520 25046 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:18:13.302992 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 48935.4us
I20260709 12:18:13.289433 25010 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:13.310155 21186 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
W20260709 12:18:13.395393 21179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2463) took 1655 ms (client timeout 1621 ms). Trace:
I20260709 12:18:13.299068 25009 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:13.301322 25047 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:13.469385 21179 rpcz_store.cc:269] 0709 12:18:11.739632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.746382 (+  6750us) service_pool.cc:224] Handling call
0709 12:18:13.395177 (+1648795us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b540015de54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:13.395318 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275540736}
I20260709 12:18:13.301997 24896 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.299125 25192 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:13.308796 25128 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:13.301065 25188 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:13.264329 25189 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 12:18:13.475229 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 172912us
I20260709 12:18:13.484719 20999 leader_election.cc:400] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11.
I20260709 12:18:13.485008 20999 leader_election.cc:403] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:13.487012 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.493651 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:13.465497 25027 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.494439 21739 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:18:13.481829 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 179899us
I20260709 12:18:13.498231 20999 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:13.499753 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.500262 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:13.288551 24902 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.503225 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:13.506493 21179 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:18:13.501333 25181 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 12:18:13.494040 25010 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.486107 25072 consensus_queue.cc:1059] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:18:13.481170 24989 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:18:13.494614 25111 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.486930 25128 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.506094 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:13.511161 25027 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:13.503192 25009 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:13.501236 25192 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:13.523798 21739 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:13.488444 24896 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:18:13.501328 21111 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:13.542030 21744 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:13.544911 25080 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:13.520296 25070 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.570598 21111 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:18:13.573030 25198 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:18:13.537362 25009 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.574129 25009 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:13.579226 25190 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:18:13.582998 25150 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:13.584667 24896 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:13.585162 24896 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:18:13.568825 25023 consensus_meta.cc:287] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
I20260709 12:18:13.549744 25189 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:13.598452 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:13.512874 25046 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.593514 25192 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:13.605409 25191 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 12:18:13.570142 25183 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:18:13.601217 25023 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.644737 25023 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.585983 24896 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.649284 25001 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.649684 25143 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.651511 21103 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:13.653075 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:13.654549 25001 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.655567 24931 raft_consensus.cc:3055] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:13.655942 24931 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:18:13.654752 25160 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 1.193s	user 0.009s	sys 0.007s
I20260709 12:18:13.660382 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:13.666182 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 94289.9us
W20260709 12:18:13.640264 25196 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:18:13.619508 25192 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:13.602756 25018 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:13.674258 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 174561us
I20260709 12:18:13.677278 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.637765 25189 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:18:13.666021 25145 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.673938 25023 raft_consensus.cc:3055] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:18:13.682943 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 176899us
W20260709 12:18:13.678117 25168 consensus_meta.cc:287] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.541s	user 0.002s	sys 0.006s
I20260709 12:18:13.688309 25018 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.689772 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:13.690471 21744 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:13.693666 25047 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.695467 25143 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:13.696349 21107 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:13.659116 25009 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.702252 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:13.685061 25023 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:13.713449 25023 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.719211 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:13.719866 21186 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:13.729650 25202 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:18:13.730825 25078 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:13.731021 25023 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.731446 25078 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.733497 25078 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.733989 25128 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.715694 25192 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.735759 25192 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.741894 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2466) took 1141 ms. Trace:
I20260709 12:18:13.742272 21178 rpcz_store.cc:276] 0709 12:18:12.600274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.600406 (+   132us) service_pool.cc:224] Handling call
0709 12:18:12.617417 (+ 17011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.026748 (+409331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.741655 (+714907us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b540001b3d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:13.741837 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916059904}
W20260709 12:18:13.744081 21743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 773) took 1525 ms (client timeout 1557 ms). Trace:
W20260709 12:18:13.744491 21743 rpcz_store.cc:269] 0709 12:18:12.218344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.218777 (+   433us) service_pool.cc:224] Handling call
0709 12:18:13.743888 (+1525111us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54006a6b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:13.744024 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135152896}
W20260709 12:18:13.750982 25175 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.863s	user 0.000s	sys 0.009s
W20260709 12:18:13.755890 25165 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 1.299s	user 0.000s	sys 0.027s
I20260709 12:18:13.756425 24939 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:13.757236 24939 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:13.757972 24939 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.718932 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:13.760049 24939 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:13.766728 21075 leader_election.cc:400] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:13.767083 21075 leader_election.cc:403] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:13.769874 21186 raft_consensus.cc:2410] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:18:13.760092 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.775979 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:13.775043 25128 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
W20260709 12:18:13.778728 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 76547us
I20260709 12:18:13.779327 25075 raft_consensus.cc:2764] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:18:13.781268 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.782001 25189 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:13.779076 25103 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.783504 24795 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:13.784271 25103 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:13.775542 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.785948 20999 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.790393 21102 raft_consensus.cc:1240] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:13.793800 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:13.795359 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.796578 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:13.797572 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:13.705008 25168 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.805143 21000 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:13.816396 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.819869 21110 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:13.802673 25009 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.764532 25188 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:13.836025 25103 consensus_queue.cc:1059] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:13.836220 24859 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:13.837230 25188 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:13.807013 25164 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:13.823788 25178 consensus_queue.cc:1059] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:13.820613 24989 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:13.822901 25098 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:13.823822 25211 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:18:13.834511 25145 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:13.807713 25027 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:13.810967 25075 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:13.837795 25103 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:13.850510 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.852185 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:13.849013 21102 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:13.855067 25027 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:13.855764 21185 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:13.875937 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1982) took 1100 ms. Trace:
I20260709 12:18:13.876446 21109 rpcz_store.cc:276] 0709 12:18:12.775102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.585013 (+809911us) service_pool.cc:224] Handling call
0709 12:18:13.585286 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.585471 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:13.585737 (+   266us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.823299 (+237562us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.875606 (+ 52307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:13.875659 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:13.875710 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.875773 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.875883 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51657,"prepare.queue_time_us":1732,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":11898,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":226888,"threads_started":1}
I20260709 12:18:13.844894 25010 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11.
I20260709 12:18:13.899348 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:13.870924 25217 log.cc:927] Time spent T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:18:13.862146 25071 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.859665 25103 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:13.849933 25164 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:13.862404 25098 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:13.907161 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:13.910331 21179 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:18:13.921751 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:13.902894 25215 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:18:13.923662 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:13.923939 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.924850 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:13.925921 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 124460us
I20260709 12:18:13.900893 25047 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:13.927004 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:13.933887 21181 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:13.972508 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:13.973304 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:13.973945 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:13.974556 21180 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
W20260709 12:18:13.975955 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 51417.4us
I20260709 12:18:13.902081 24902 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:13.893527 25128 consensus_queue.cc:1059] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:18:13.988432 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 178542us
I20260709 12:18:13.980876 21181 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:13.993300 21177 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
W20260709 12:18:13.982956 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 173608us
I20260709 12:18:13.995918 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:13.971720 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:13.922001 25098 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:13.924604 25143 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:13.996785 21178 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:13.999455 21709 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:14.010664 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:14.135164 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:14.177989 21034 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:14.178428 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.123636 25224 raft_consensus.cc:3055] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:13.994197 25078 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 12:18:14.141507 25128 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:14.159726 25187 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:14.023406 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:14.115569 21036 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:14.207293 21032 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.115895 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:14.208110 21180 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:14.114779 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:13.996734 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:14.209280 21184 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:14.200932 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 205086us
I20260709 12:18:14.216135 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 538) took 1187 ms. Trace:
W20260709 12:18:14.116307 25193 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:18:14.231266 21034 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:14.220247 21032 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:14.231266 21184 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:13.994314 25023 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.006398 25098 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:14.224813 25078 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.181891 25224 raft_consensus.cc:740] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:14.211633 25172 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:14.214733 25128 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.228392 25168 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.222672 21108 rpcz_store.cc:276] 0709 12:18:13.028262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.641176 (+612914us) service_pool.cc:224] Handling call
0709 12:18:13.659628 (+ 18452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.669067 (+  9439us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:13.673521 (+  4454us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.804575 (+131054us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.812570 (+  7995us) log.cc:844] Serialized 26 byte log entry
0709 12:18:13.812728 (+   158us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:13.812762 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.812834 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:14.215954 (+403120us) raft_consensus.cc:1685] finished
0709 12:18:14.215973 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.216083 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17711,"prepare.queue_time_us":4099,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":16481,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":8319,"thread_start_us":130252,"threads_started":1,"wal-append.queue_time_us":141177}
I20260709 12:18:13.994439 24902 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.135039 25164 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.023460 25103 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:14.300800 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.572681 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1988) took 1024 ms. Trace:
I20260709 12:18:14.573096 21103 rpcz_store.cc:276] 0709 12:18:13.548543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.652743 (+104200us) service_pool.cc:224] Handling call
0709 12:18:13.653006 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.666060 (+ 13054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.666088 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.676429 (+ 10341us) log.cc:844] Serialized 26 byte log entry
0709 12:18:13.935990 (+259561us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:13.936029 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.936091 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:14.572481 (+636390us) raft_consensus.cc:1685] finished
0709 12:18:14.572499 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.572627 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13339,"raft.queue_time_us":13098,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":3354,"thread_start_us":240909,"threads_started":1,"wal-append.queue_time_us":540235}
I20260709 12:18:14.215346 25187 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.272581 25023 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.578658 25023 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.579331 25078 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.211151 25233 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.580267 25233 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:14.367599 25218 log.cc:927] Time spent T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:18:14.582306 25233 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:14.481303 25235 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:18:14.238396 20999 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:14.320401 25046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.007s
I20260709 12:18:14.583374 25224 consensus_queue.cc:260] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:14.584095 25046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.009s	sys 0.009s
I20260709 12:18:14.264911 21180 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
W20260709 12:18:14.468101 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.014061 25143 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.586375 21179 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:14.587705 25143 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:14.594036 21744 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:14.579758 25172 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:14.598531 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:14.599061 25172 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.116864 25229 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:14.582074 25128 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:14.613740 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 375397us
I20260709 12:18:14.615722 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2024) took 1335 ms. Trace:
I20260709 12:18:14.627467 21185 rpcz_store.cc:276] 0709 12:18:13.280165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.280305 (+   140us) service_pool.cc:224] Handling call
0709 12:18:13.280594 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.862270 (+581676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.615485 (+753215us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54003fd254. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:14.615653 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322246016}
W20260709 12:18:14.562172 24939 consensus_meta.cc:287] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.772s	user 0.007s	sys 0.001s
W20260709 12:18:14.566602 25192 consensus_meta.cc:287] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.000s
I20260709 12:18:14.224941 25001 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:14.221942 25006 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:14.629829 21034 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:14.630734 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:14.291429 25027 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:14.575611 25103 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:14.638094 21028 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:14.638192 21184 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:18:14.598589 25078 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:14.639809 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 629160us
W20260709 12:18:14.636075 25067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.008s	sys 0.012s
I20260709 12:18:14.651033 21077 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:14.652034 21709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.011s	sys 0.020s
W20260709 12:18:14.653641 21709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.011s	sys 0.020s
W20260709 12:18:14.653939 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 654505us
I20260709 12:18:14.629390 24896 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:14.659233 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.629848 25224 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:14.661114 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:14.665076 25143 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:14.665630 25143 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.635289 25154 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:14.667896 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:14.669052 21105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1848) took 2305 ms (client timeout 1688 ms). Trace:
I20260709 12:18:14.650092 25128 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:14.652979 25071 consensus_meta.cc:287] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.001s
W20260709 12:18:14.653435 25067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.013s
W20260709 12:18:14.659909 24859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.004s	sys 0.008s
I20260709 12:18:14.667218 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:14.661782 24896 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:14.672438 25023 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:14.670337 25001 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:14.671137 25231 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.648315 25006 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.678476 25071 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:14.671731 25154 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.679978 25143 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:14.678042 25128 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:14.743997 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 115820us
I20260709 12:18:14.849892 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:14.745451 21027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.021s
W20260709 12:18:14.745926 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.662461 21033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1727) took 1776 ms (client timeout 2042 ms). Trace:
W20260709 12:18:14.752866 21035 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.008s
W20260709 12:18:14.755300 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 87394.1us
W20260709 12:18:14.669432 21105 rpcz_store.cc:269] 0709 12:18:12.357148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.357251 (+   103us) service_pool.cc:224] Handling call
0709 12:18:14.661946 (+2304695us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400252bd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:14.662060 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246739200}
I20260709 12:18:14.760331 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:14.685876 24896 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:14.763391 21103 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:14.763492 24965 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:18:14.676774 24859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.004s	sys 0.009s
I20260709 12:18:14.676693 24902 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:14.767822 25006 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:14.692710 25231 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:14.708127 25232 log.cc:927] Time spent T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:18:14.704653 25236 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.246s	user 0.006s	sys 0.003s
W20260709 12:18:14.892058 21033 rpcz_store.cc:269] 0709 12:18:12.886192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.888843 (+  2651us) service_pool.cc:224] Handling call
0709 12:18:14.662301 (+1773458us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540004ae54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:14.662409 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718863744}
I20260709 12:18:14.903968 25231 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:14.904516 21712 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.005s	sys 0.014s
W20260709 12:18:14.904944 21712 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.006s	sys 0.014s
I20260709 12:18:14.905479 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:14.815415 25239 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:14.906445 25239 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.908774 25239 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.819312 25168 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:14.820081 25240 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:14.910251 25240 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.912806 25240 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:14.825239 21180 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:14.688979 25023 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:14.837824 25154 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:14.839569 25078 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:14.827241 25241 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:14.914129 25078 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.913753 25023 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:14.915406 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 65751.1us
I20260709 12:18:14.840161 25229 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.917536 25229 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.920329 25229 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.685408 25067 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:18:14.851052 21027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.013s	sys 0.021s
I20260709 12:18:14.849831 25128 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.894783 25225 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.897868 24965 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.899446 25192 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:14.901085 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:14.903107 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.905640 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 565348us
W20260709 12:18:14.871955 21035 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.004s	sys 0.008s
I20260709 12:18:14.927381 24965 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.931123 25225 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.932778 25023 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.933282 25225 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.924258 25006 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:14.939970 25168 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:14.943284 25168 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.945376 24939 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:14.935956 25239 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:14.947489 25239 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:14.949469 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 48545.8us
I20260709 12:18:14.914299 25241 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.950937 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2491) took 1027 ms. Trace:
I20260709 12:18:14.951385 21179 rpcz_store.cc:276] 0709 12:18:13.923649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.926770 (+  3121us) service_pool.cc:224] Handling call
0709 12:18:14.950580 (+1023810us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400386154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:14.950739 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409721088}
I20260709 12:18:14.952913 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:14.953745 21179 raft_consensus.cc:2376] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10. Re-sending same reply.
I20260709 12:18:14.928308 25192 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:14.955478 25023 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:14.951093 25240 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:14.956557 25240 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:14.957052 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:14.957919 21109 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.958163 25240 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.959648 25241 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.960533 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:14.961143 25023 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.961354 21102 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.961987 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:14.961889 25023 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.962711 21105 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:14.961395 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:14.964268 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:14.964625 21103 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:14.964970 21181 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:14.965888 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:14.966329 21181 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:14.955557 25192 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.968462 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:14.969053 21111 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:14.970963 21744 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:14.977108 25023 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.977355 25027 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:14.977782 25006 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.978022 25027 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.979924 25006 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.980046 25027 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:14.980481 21109 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:14.977123 25149 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.981560 25149 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.983212 21102 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:14.983582 25149 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.983922 25225 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:14.984269 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:14.949782 25239 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.940413 25078 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.987622 21741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53712 (request call id 9) took 1476 ms. Trace:
I20260709 12:18:14.987973 21741 rpcz_store.cc:276] 0709 12:18:13.511538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.513981 (+  2443us) service_pool.cc:224] Handling call
0709 12:18:14.987178 (+1473197us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54004bc654. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f99a735 00007fcb9f9929fa 00007fcba495a4c9 00007fcb9ded6c54 00007fcb9ded6be2 00007fcb9ded6b11 00007fcb9ded6a8c 00007fcb9ded5d42 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:14.987427 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641980160}
W20260709 12:18:14.991551 20919 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 40fd334874764b26ba28ac382c4199f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a1b891e53adc40a6a1ae813238321e93 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:14.992432 25183 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:14.993060 25183 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.995563 24939 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.996277 24939 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:14.996763 25018 raft_consensus.cc:3055] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:14.997390 25141 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.998029 25141 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:14.999086 24939 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:15.000126 25141 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:14.997041 25229 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:15.001169 25229 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.001420 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:15.002624 25225 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.003253 25229 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.003546 24939 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:15.004427 24939 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.005450 25098 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.003186 25225 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.007843 25225 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:15.011052 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 75324.8us
W20260709 12:18:15.012419 20999 connection.cc:256] RPC call timeout handler was delayed by -1.5928987170000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 12:18:15.013203 20999 connection.cc:256] RPC call timeout handler was delayed by -1.0590482569998585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 12:18:14.974617 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:15.007555 25192 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:15.008244 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 304456us
W20260709 12:18:15.008625 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 59648.3us
I20260709 12:18:15.009313 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:15.004460 21111 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:15.029115 21184 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:15.030174 25001 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:15.031417 25001 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.043972 25102 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.044759 25102 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.044031 21741 raft_consensus.cc:2410] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:18:15.015789 24939 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:15.013362 25018 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:15.047073 21105 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:15.048719 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:15.049305 21103 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:15.051573 25104 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:15.052201 25104 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.053598 25018 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.055984 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:15.056879 21747 raft_consensus.cc:2393] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:15.060130 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.060936 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.061877 21032 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:15.123064 21029 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:18:15.118803 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.069056 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.050922 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:15.363799 21032 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:15.256043 21149 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:15.074357 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.064606 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.362762 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:15.121253 21110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 1967) took 2372 ms (client timeout 2042 ms). Trace:
I20260709 12:18:15.145099 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 1960) took 2398 ms. Trace:
I20260709 12:18:15.065518 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.070227 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:15.143445 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:15.367050 21110 rpcz_store.cc:269] 0709 12:18:12.748752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.766099 (+ 17347us) service_pool.cc:224] Handling call
0709 12:18:15.120886 (+2354787us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54000a7b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:15.121056 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2248272896}
I20260709 12:18:15.354887 25018 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:15.374517 25027 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.375113 25027 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.123375 25104 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:15.063562 25183 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.144078 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:15.068488 25192 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:15.382474 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 369252us
I20260709 12:18:15.340229 25144 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.251883 25111 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:15.383184 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 313072us
I20260709 12:18:15.068898 24896 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.391089 25177 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:15.391805 25177 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.392271 21186 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:15.392503 24896 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.340004 25045 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:15.393543 25045 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:15.387353 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 131604us
I20260709 12:18:15.388986 25047 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:15.389286 25141 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:15.395224 25141 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.397372 25141 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.389667 24960 consensus_queue.cc:1059] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:15.394650 25047 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.398358 25233 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:15.398973 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:15.398432 24960 raft_consensus.cc:3055] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:15.399709 24960 raft_consensus.cc:740] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:15.399955 21186 raft_consensus.cc:2393] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:15.400288 25047 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.401453 25047 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.402024 25047 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.402809 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:15.073629 25260 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.391427 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:15.370759 25225 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.050733 25241 consensus_queue.cc:1059] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.329s
I20260709 12:18:15.394039 25177 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.403405 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:15.406030 21032 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
W20260709 12:18:15.402521 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.406507 25104 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:15.407320 24965 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:15.407745 25045 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:15.407800 25095 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:15.431473 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.422938 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:15.432125 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.253737 25145 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 12:18:15.438205 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1752) took 1311 ms. Trace:
I20260709 12:18:15.443256 21742 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:15.400660 24960 consensus_queue.cc:260] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.445102 21741 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:15.439668 25141 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:15.433025 25104 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:15.446007 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:15.450814 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 56906us
I20260709 12:18:15.450345 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.367926 21106 rpcz_store.cc:276] 0709 12:18:12.747018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.181378 (+434360us) service_pool.cc:224] Handling call
0709 12:18:13.181663 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.267389 (+ 85726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.267423 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.267902 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:18:13.526454 (+258552us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:13.526494 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.144440 (+1617946us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b54003688d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:15.144509 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.144573 (+    64us) raft_consensus.cc:1685] finished
0709 12:18:15.144586 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.144893 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5047,"raft.queue_time_us":5155,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4184,"spinlock_wait_cycles":176234240,"thread_start_us":223987,"threads_started":1,"wal-append.queue_time_us":275269,"wal-append.run_cpu_time_us":2423,"wal-append.run_wall_time_us":1243861}
I20260709 12:18:15.395270 25111 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.451777 24965 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.446568 25144 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:15.463907 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1738) took 2159 ms. Trace:
I20260709 12:18:15.463932 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2027) took 1931 ms. Trace:
I20260709 12:18:15.452075 25104 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:15.466456 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:15.497584 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.465708 21029 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:15.455149 25095 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:15.442983 21035 rpcz_store.cc:276] 0709 12:18:14.123445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.125377 (+  1932us) service_pool.cc:224] Handling call
0709 12:18:14.125626 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.125810 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:14.929369 (+803559us) log.cc:844] Serialized 14 byte log entry
0709 12:18:15.375932 (+446563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:15.378954 (+  3022us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:15.387312 (+  8358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.408744 (+ 21432us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.434433 (+ 25689us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223888,"prepare.queue_time_us":112702,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":150278,"spinlock_wait_cycles":17690496,"thread_start_us":981329,"threads_started":2}
I20260709 12:18:15.469343 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.446758 25225 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.534085 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.468335 21031 rpcz_store.cc:276] 0709 12:18:13.289916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.290037 (+   121us) service_pool.cc:224] Handling call
0709 12:18:13.290277 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.290453 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:13.498090 (+207637us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.499199 (+  1109us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.749620 (+250421us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b18003b6da0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:18:15.118731 (+1369111us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b18003b6da0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a4455 00007fcb9f98c060 00007fcb9f99e716 00007fcb9f9af287 00007fcb9f9af208
0709 12:18:15.381407 (+262676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:15.388562 (+  7155us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:15.423466 (+ 34904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.435654 (+ 12188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.449349 (+ 13695us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3838,"prepare.queue_time_us":175809,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2343,"raft.queue_time_us":43482,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":20314,"spinlock_wait_cycles":45546752,"thread_start_us":433451,"threads_started":2}
I20260709 12:18:15.534783 24896 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.535270 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.535475 24896 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.535751 25095 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.536502 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.537563 24896 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:15.538291 21036 raft_consensus.cc:2393] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:15.539469 21036 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:18:15.534350 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.468520 24965 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:15.534799 21029 raft_consensus.cc:2368] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13.
W20260709 12:18:15.539551 25264 log.cc:927] Time spent T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:18:15.587749 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 116800us
I20260709 12:18:15.468066 25047 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:15.593223 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.463615 25208 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 12:18:15.468537 21183 rpcz_store.cc:276] 0709 12:18:13.504190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.504332 (+   142us) service_pool.cc:224] Handling call
0709 12:18:13.504645 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:13.505000 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.505027 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:14.972141 (+1467114us) spinlock_profiling.cc:243] Waited 9.26 ms on lock 0x7b2c00061b88. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:18:14.972977 (+   836us) log.cc:844] Serialized 52 byte log entry
0709 12:18:15.048237 (+ 75260us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:15.350678 (+302441us) log.cc:844] Serialized 14 byte log entry
0709 12:18:15.356959 (+  6281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.369360 (+ 12401us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.410028 (+ 40668us) raft_consensus.cc:1685] finished
0709 12:18:15.431775 (+ 21747us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.435569 (+  3794us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141,"raft.queue_time_us":15285,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":7430,"spinlock_wait_cycles":21306624,"thread_start_us":372694,"threads_started":2,"wal-append.queue_time_us":281237}
I20260709 12:18:15.620251 21036 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:15.461503 25260 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.677381 25001 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.678117 25001 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.700387 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.701328 21029 raft_consensus.cc:2410] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:18:15.702041 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 95617.1us
I20260709 12:18:15.706275 25207 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:15.706430 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:15.533124 25141 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.686220 25001 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.619051 25144 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.723877 24960 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:15.726629 25150 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:15.727505 25260 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.730338 25141 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.739936 25111 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.707381 24896 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:15.709129 25027 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.746934 25269 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:15.758045 25270 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:18:15.764489 25225 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.711362 25192 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:15.812719 21029 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:18:15.822285 21028 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
W20260709 12:18:15.786376 25139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.010s	sys 0.014s
I20260709 12:18:15.823982 24931 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.887887 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 595) took 1257 ms. Trace:
I20260709 12:18:15.889508 25177 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:18:15.893682 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 428978us
W20260709 12:18:15.894240 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 429206us
I20260709 12:18:15.895726 25145 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:15.909008 25177 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:15.911363 25145 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.911783 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.912472 21030 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:15.913605 25145 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:15.896291 24859 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.914351 24859 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.906934 21185 rpcz_store.cc:276] 0709 12:18:14.630113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.631271 (+  1158us) service_pool.cc:224] Handling call
0709 12:18:14.974156 (+342885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.976307 (+  2151us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:15.221278 (+244971us) log.cc:844] Serialized 14 byte log entry
0709 12:18:15.440033 (+218755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:15.440080 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:15.440122 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.444356 (+  4234us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.887553 (+443197us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400386150. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:15.887707 (+   154us) inbound_call.cc:177] Queueing success response
0709 12:18:15.893365 (+  5658us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b1800331900. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c821c0a 00007fcba5f61219 00007fcba386858f 00007fcb9c8a7571 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd
Metrics: {"mutex_wait_us":17488,"prepare.queue_time_us":468223,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":8059,"raft.queue_time_us":17690,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":16874,"spinlock_wait_cycles":793513088,"thread_start_us":400080,"threads_started":2,"wal-append.queue_time_us":195784}
I20260709 12:18:15.916299 24859 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:15.896814 25150 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:15.916587 25177 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:15.911489 21149 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:15.917608 25150 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.920017 21149 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:15.921008 25145 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:15.921500 24896 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.922163 24859 consensus_queue.cc:1059] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:15.908424 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.927327 21028 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:15.927273 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.921314 25269 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:15.928085 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.922600 25103 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:15.922941 25145 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:15.923583 24896 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:15.907266 25139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.010s	sys 0.014s
I20260709 12:18:15.928231 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.922259 25192 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.921002 21149 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:15.911510 24931 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:15.929709 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:15.930179 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 50518.3us
W20260709 12:18:15.930898 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.928540 25103 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:15.898061 21180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 596) took 1267 ms. Trace:
I20260709 12:18:15.931771 24859 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:15.932116 24859 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:15.926314 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:15.937417 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:15.931308 25103 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:15.932813 25045 raft_consensus.cc:2764] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:18:15.932901 25269 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.920884 25144 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:15.930653 25192 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:15.924917 25098 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:15.933826 21180 rpcz_store.cc:276] 0709 12:18:14.630383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.630489 (+   106us) service_pool.cc:224] Handling call
0709 12:18:15.897854 (+1267365us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540038ac54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:15.897985 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276058368}
I20260709 12:18:15.929720 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.935607 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:15.936870 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:15.927975 21033 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
W20260709 12:18:15.936472 21151 connection.cc:256] RPC call timeout handler was delayed by -1.4766141669999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 12:18:15.930753 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.939756 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:15.945119 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:15.945348 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:15.951546 21111 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:15.950963 21036 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:15.957191 21106 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:15.911283 25111 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.965052 21102 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:15.982285 25102 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:15.988303 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2036) took 1994 ms. Trace:
I20260709 12:18:15.988684 21178 rpcz_store.cc:276] 0709 12:18:13.994104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.214642 (+220538us) service_pool.cc:224] Handling call
0709 12:18:14.224363 (+  9721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.585986 (+361623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:14.586016 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:14.586058 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:14.586096 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.987899 (+1401803us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400387054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:15.987959 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.988138 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831190400}
W20260709 12:18:15.990302 21104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1867) took 3363 ms (client timeout 1730 ms). Trace:
I20260709 12:18:15.991106 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:15.990675 21104 rpcz_store.cc:269] 0709 12:18:12.627255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.627656 (+   401us) service_pool.cc:224] Handling call
0709 12:18:15.989971 (+3362315us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b540022d8d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:15.990115 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166098688}
I20260709 12:18:15.956730 24896 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.002861 25111 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.004618 21110 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:16.005152 24859 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:16.011121 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:16.012785 21178 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:16.014930 25127 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:16.015172 25145 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:15.995867 25241 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.018965 25080 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:16.039726 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.028626 21030 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:16.018335 21738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 550) took 3015 ms. Trace:
I20260709 12:18:16.042448 25111 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:16.042954 25127 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:16.045147 25127 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:16.045290 24859 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:16.045835 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.041581 21738 rpcz_store.cc:276] 0709 12:18:13.003231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.004074 (+   843us) service_pool.cc:224] Handling call
0709 12:18:13.013951 (+  9877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.280870 (+1266919us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:14.761767 (+480897us) log.cc:844] Serialized 14 byte log entry
0709 12:18:14.887037 (+125270us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:14.893337 (+  6300us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:14.927571 (+ 34234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.017934 (+1090363us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54004bc654. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:16.017983 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.018151 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128344,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4505,"raft.queue_time_us":12201,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":16190,"spinlock_wait_cycles":2913079680,"thread_start_us":557639,"threads_started":2,"wal-append.queue_time_us":166025,"wal-append.run_cpu_time_us":1251,"wal-append.run_wall_time_us":1001236}
I20260709 12:18:16.033056 24896 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:16.059226 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.051115 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:16.060262 21183 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:18:16.060714 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.061748 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:16.059820 21179 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:16.063127 21104 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.058765 24896 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:16.067667 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.069650 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.068214 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.087056 21030 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:16.090394 21185 raft_consensus.cc:2368] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:16.088488 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.091230 21186 raft_consensus.cc:2410] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:16.089880 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.093351 24948 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.094691 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.094241 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.094197 24948 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.049978 25241 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:16.122460 21184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 599) took 1474 ms (client timeout 1845 ms). Trace:
I20260709 12:18:16.053776 25080 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:16.123590 21184 rpcz_store.cc:269] 0709 12:18:14.647732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.648590 (+   858us) service_pool.cc:224] Handling call
0709 12:18:16.096639 (+1448049us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540015e354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:16.122401 (+ 25762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718528896}
I20260709 12:18:16.124855 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:16.129456 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:16.131516 20930 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 6, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.132562 25187 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:16.133306 25277 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:18:16.133940 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.134071 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:16.134974 21109 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:18:16.135342 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.136693 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.144187 21034 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:16.145416 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.171026 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:16.162638 21030 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:16.172766 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.173405 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.177821 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.127086 25127 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:16.122730 24965 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.181494 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 535) took 3010 ms. Trace:
W20260709 12:18:16.185667 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 71172.7us
I20260709 12:18:16.182947 21107 rpcz_store.cc:276] 0709 12:18:13.026463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.623932 (+597469us) service_pool.cc:224] Handling call
0709 12:18:13.624210 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.696783 (+ 72573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.961814 (+2265031us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b5400229054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:16.036628 (+ 74814us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165392768}
I20260709 12:18:16.188578 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.144680 25149 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.170692 25098 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:16.158983 25282 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:16.175374 25233 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:16.177054 25187 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.197377 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:16.223913 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.224150 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.224835 21030 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:16.159401 25104 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:16.223181 25178 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:16.230324 24948 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:16.231861 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.241907 21107 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:16.247404 21030 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:16.246112 21108 raft_consensus.cc:2410] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:18:16.248904 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.249506 21183 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:18:16.254354 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.255017 21032 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:16.248101 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:16.257699 21149 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:16.260463 21178 raft_consensus.cc:2393] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:16.254516 21002 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:16.213694 25098 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:16.264220 25018 consensus_meta.cc:287] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.886s	user 0.009s	sys 0.002s
I20260709 12:18:16.272003 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.281265 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.282387 21179 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:16.282651 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.283483 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.238131 25187 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.284430 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.285166 21027 raft_consensus.cc:2393] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:16.285319 25276 log.cc:927] Time spent T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:18:16.285951 25187 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:16.237957 25127 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.288719 25127 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:16.289966 21186 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:16.290776 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.225868 25282 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:16.293110 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 46046.2us
I20260709 12:18:16.294055 21032 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:16.297160 21103 raft_consensus.cc:2410] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 12:18:16.331473 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.196705 25149 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:16.340564 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.343911 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.296347 24896 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:16.345986 25067 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:16.349220 25104 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:16.350278 25285 log.cc:927] Time spent T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:16.263833 25178 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.356288 25282 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:16.363466 25241 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:16.365152 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.366744 25098 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:16.271296 25284 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:16.245428 25233 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.397441 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.449282 21185 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
W20260709 12:18:16.449931 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 153355us
W20260709 12:18:16.465348 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.478775 21107 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:16.691990 24896 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:16.457404 21186 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:16.694978 21032 raft_consensus.cc:2410] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:18:16.695955 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.696563 21032 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
W20260709 12:18:16.697359 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 403612us
W20260709 12:18:16.698973 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 58111.1us
I20260709 12:18:16.699587 25178 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:16.701547 21182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2469) took 4094 ms (client timeout 1927 ms). Trace:
I20260709 12:18:16.702073 25233 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:16.687345 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.701977 21182 rpcz_store.cc:269] 0709 12:18:12.606633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.606748 (+   115us) service_pool.cc:224] Handling call
0709 12:18:16.701201 (+4094453us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54003fbe54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:16.701351 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6023586176}
I20260709 12:18:16.550927 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2602) took 1402 ms. Trace:
I20260709 12:18:16.704622 21035 rpcz_store.cc:276] 0709 12:18:15.153965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.620008 (+466043us) service_pool.cc:224] Handling call
0709 12:18:15.686004 (+ 65996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:15.825257 (+139253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.825286 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.955363 (+130077us) log.cc:844] Serialized 26 byte log entry
0709 12:18:16.250972 (+295609us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:16.263784 (+ 12812us) log.cc:844] Serialized 14 byte log entry
0709 12:18:16.263974 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.264038 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.550690 (+286652us) raft_consensus.cc:1685] finished
0709 12:18:16.550711 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.550861 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12283,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":14474,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":17315,"thread_start_us":375131,"threads_started":2,"wal-append.queue_time_us":320750}
I20260709 12:18:16.706627 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:16.707463 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.707914 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.537572 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:16.709906 21029 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:16.499462 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.600647 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.711987 21030 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:16.712921 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:16.712998 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.713615 21030 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:16.714349 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.714749 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.718101 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.715309 25284 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:16.499819 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.478611 21104 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
W20260709 12:18:16.686820 25298 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.314s	user 0.003s	sys 0.015s
I20260709 12:18:16.477357 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.716792 25233 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:16.560801 24960 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:16.721132 25098 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:16.722028 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:16.724038 21031 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:16.724419 21183 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:16.708992 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.589654 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.731441 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:16.749336 21035 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
W20260709 12:18:16.500801 25287 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:16.754351 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.757496 21032 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
W20260709 12:18:16.503027 25103 consensus_meta.cc:287] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.006s
I20260709 12:18:16.758082 25103 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:16.758764 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.760272 25103 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:16.760094 24896 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:16.715082 21033 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:16.761924 21181 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:16.766266 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:16.758359 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:16.756129 21027 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:16.772369 21029 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:16.773569 21029 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:16.754174 25098 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.776464 25018 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.726442 25284 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.777659 25260 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.787057 25260 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.787406 25177 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:16.788694 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.789821 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.791527 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.792425 21180 raft_consensus.cc:2410] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:18:16.793097 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.794045 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.794160 25018 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:16.795904 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.796376 25018 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:16.797412 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.798434 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.799362 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:16.800239 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.779068 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:16.781653 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.498605 25080 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:16.777539 25149 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:16.750993 25067 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.785439 21030 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:16.806270 21104 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:16.770999 25139 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.785861 21032 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:16.753824 24960 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.796571 21177 raft_consensus.cc:2393] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:16.776499 21029 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:16.790809 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.807523 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:16.808660 21035 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:16.803871 21031 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:16.805081 21738 raft_consensus.cc:2410] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:18:16.805356 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:16.811370 21028 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:16.804065 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.813253 21180 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:16.812282 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:16.821980 21034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35652 (request call id 516) took 1762 ms (client timeout 2033 ms). Trace:
I20260709 12:18:16.824156 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.825289 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.826237 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.827124 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:16.828167 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:16.822356 21034 rpcz_store.cc:269] 0709 12:18:15.059555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.059726 (+   171us) service_pool.cc:224] Handling call
0709 12:18:16.821816 (+1762090us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002b89d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:16.821903 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300821760}
I20260709 12:18:16.831480 21109 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:16.830658 21741 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:16.835661 21179 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:16.844743 21711 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:16.844839 21742 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:16.814910 21744 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:16.755623 25233 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:16.847119 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:16.847846 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.808270 25067 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:16.850835 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.852636 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:16.850651 21182 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 4.
I20260709 12:18:16.835539 25149 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.862510 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.863339 21149 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:16.850885 25178 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:16.869843 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:16.848124 25080 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.872304 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.878925 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:16.883349 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:16.888463 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.889705 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.861312 25018 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:16.864569 25241 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:16.896867 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.903746 21111 raft_consensus.cc:2393] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:16.904603 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.905324 21111 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:16.906693 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:16.845090 25139 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:16.910588 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.947403 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:16.948087 21741 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:16.974390 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:16.975092 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 61001.8us
W20260709 12:18:16.981977 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 131797us
I20260709 12:18:16.983021 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:16.901885 25241 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:16.984097 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.908743 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.987346 21032 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:16.995965 21105 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:16.996236 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 149185us
I20260709 12:18:16.925977 25187 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:16.875053 25149 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:16.994866 21104 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:18:16.900830 25144 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:18:17.005263 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:17.002976 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 139711us
I20260709 12:18:16.912763 25018 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:17.010999 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 159130us
W20260709 12:18:17.004369 21077 leader_election.cc:336] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.927s (SENT)
I20260709 12:18:17.010107 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:16.998556 25241 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.911547 25080 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.008143 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.015961 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.016968 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:17.037081 21077 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:17.037348 21104 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:17.047176 21741 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:17.000355 25187 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:17.048399 21150 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:17.049647 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 47031.2us
I20260709 12:18:17.051748 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.009938 24965 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:16.995155 25240 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:18:17.061748 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:17.076467 21102 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:17.102926 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.054975 25187 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.103906 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:17.104534 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.109577 21111 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
W20260709 12:18:17.104935 25297 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 12:18:17.106017 25233 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.114725 25313 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.114980 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.054116 25307 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:17.123068 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.061061 25098 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:17.127071 25098 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.125883 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:17.127907 21178 raft_consensus.cc:2376] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10. Re-sending same reply.
W20260709 12:18:17.129164 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 273891us
W20260709 12:18:17.129827 20999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.2:37643 timed out after 1.730s (SENT) [suppressed 36 similar messages]
I20260709 12:18:17.134418 21742 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:18:17.134769 21742 pending_rounds.cc:85] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Aborting all ops after (but not including) 7
I20260709 12:18:17.135005 21742 pending_rounds.cc:107] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:18:17.135254 21742 raft_consensus.cc:2889] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:17.135964 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 131611us
I20260709 12:18:17.115701 24859 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.140134 24859 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.078003 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 2016) took 1042 ms. Trace:
I20260709 12:18:17.082724 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.155179 21105 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:17.156306 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.146962 25313 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.142652 24859 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:17.154872 21103 rpcz_store.cc:276] 0709 12:18:16.036036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.041681 (+  5645us) service_pool.cc:224] Handling call
0709 12:18:17.074256 (+1032575us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54002a2954. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:17.077941 (+  3685us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537960192}
I20260709 12:18:17.164834 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.124831 25307 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.126104 25260 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:17.059072 25141 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:17.175207 21110 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:17.077555 24960 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.176883 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.180874 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:17.181404 21178 raft_consensus.cc:2376] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11. Re-sending same reply.
I20260709 12:18:17.178630 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.182127 21105 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:17.179559 21103 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:17.183637 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:17.184109 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 124562us
W20260709 12:18:17.186339 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 63615.5us
W20260709 12:18:17.177179 25303 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:18:17.187139 21105 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:17.192032 21075 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:17.193513 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 179153us
I20260709 12:18:17.196478 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:17.197520 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.174024 25307 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.199311 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.199930 21182 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
W20260709 12:18:17.200553 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.203224 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.204012 21184 raft_consensus.cc:2410] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:18:17.204865 24960 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:17.206494 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.210312 21180 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:18:17.213675 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:17.214243 21178 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:17.176954 24931 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:17.221242 25313 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:17.223132 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.225430 21712 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:17.222991 25168 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:17.226054 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:17.231343 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 100912us
I20260709 12:18:17.232306 21709 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.232365 21109 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:17.237483 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.238036 21102 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:18:17.238440 21109 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:18:17.239784 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:17.240342 21103 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:17.206418 25141 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:17.246349 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.246948 21184 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:17.247552 21109 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:17.249269 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.219323 25316 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:17.252646 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.236603 25168 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:17.243441 25260 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:17.258299 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 406245us
I20260709 12:18:17.243723 25141 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:17.259632 21712 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:17.263788 25149 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.269244 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1880) took 1025 ms. Trace:
I20260709 12:18:17.269599 21107 rpcz_store.cc:276] 0709 12:18:16.244699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.847441 (+602742us) service_pool.cc:224] Handling call
0709 12:18:16.847747 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.848122 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:17.005500 (+157378us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.120744 (+115244us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.121178 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.121312 (+   134us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:17.122053 (+   741us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.122258 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.122324 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:17.269066 (+146742us) raft_consensus.cc:1685] finished
0709 12:18:17.269084 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.269194 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7437,"prepare.queue_time_us":28934,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":4784,"raft.queue_time_us":4700,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":58648,"thread_start_us":211192,"threads_started":2,"wal-append.queue_time_us":170290}
I20260709 12:18:17.271505 25324 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:17.272028 25324 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:17.272923 25324 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.274044 21000 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:17.259407 25168 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:17.276134 21709 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:17.278785 25306 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:17.278934 25141 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.260084 25316 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.280445 25301 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:17.280825 25301 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.281148 25301 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:17.281754 25187 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.282495 21712 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:17.283360 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.284808 21712 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.227777 24931 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.288965 21103 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:17.294139 25321 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:18:17.296331 25241 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:17.297257 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 114113us
I20260709 12:18:17.283378 25320 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:17.256992 25282 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.299043 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.299093 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:17.310178 21178 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:17.279420 25177 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.279179 25306 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.281771 25316 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:17.293833 24960 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:17.294040 24965 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.315124 21184 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:17.294301 25233 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:17.293704 25325 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:17.304872 21150 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.308346 25080 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:17.328550 25328 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:17.433197 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.435133 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.435496 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.448329 21178 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:17.449186 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.448966 20930 catalog_manager.cc:5697] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:17.450304 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.329095 24931 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:17.451550 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.451979 21180 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:17.452584 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.452750 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:17.448978 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:17.454120 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 120680us
I20260709 12:18:17.435817 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.453469 20930 catalog_manager.cc:5697] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:17.433566 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.431671 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.455650 21181 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:17.453534 21185 raft_consensus.cc:2368] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14.
W20260709 12:18:17.456489 21711 leader_election.cc:336] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.845s (SENT)
I20260709 12:18:17.456928 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:17.456401 21709 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:17.331400 21035 consensus_meta.cc:287] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
W20260709 12:18:17.429349 25067 consensus_meta.cc:287] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.567s	user 0.003s	sys 0.003s
W20260709 12:18:17.490149 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55464.1us
I20260709 12:18:17.488124 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:17.489189 21035 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:17.368587 25316 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:17.462939 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 210179us
W20260709 12:18:17.457769 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 152983us
W20260709 12:18:17.489883 21711 leader_election.cc:336] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.042s (SENT)
I20260709 12:18:17.494105 21076 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:17.494412 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:17.369211 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 49039.8us
I20260709 12:18:17.405309 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:17.440435 25284 consensus_meta.cc:287] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.003s
I20260709 12:18:17.496622 21150 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.497886 21076 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:17.495090 25321 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:18:17.503427 21738 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:18:17.502866 25176 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.504314 25284 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.505019 25176 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.506392 25284 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:17.507169 20923 maintenance_manager.cc:419] P d43fece763204ac08240a85f3921173b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033372
I20260709 12:18:17.507755 25176 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.509374 21002 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:17.510179 25328 raft_consensus.cc:2764] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:18:17.511085 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:17.389034 25139 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.511569 25309 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:18:17.422672 25168 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.495440 25260 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:18:17.513300 25309 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:17.513760 25309 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:17.513914 25168 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.514523 21109 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:17.430052 25187 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:17.514635 25309 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.316936 25177 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.518540 25177 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.519574 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.520220 21178 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
W20260709 12:18:17.521926 25323 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.279s	user 0.003s	sys 0.000s
I20260709 12:18:17.388768 25178 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 12:18:17.511300 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:17.523348 21743 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:17.523766 25178 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:17.524158 25178 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:17.524501 25178 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.527009 25183 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:17.525275 20930 catalog_manager.cc:5697] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 6 to 7, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 7 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:17.528015 25018 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:17.514832 25233 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.529068 25241 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.529189 21739 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
W20260709 12:18:17.530684 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54729.6us
I20260709 12:18:17.533012 21075 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:17.317415 25306 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:17.535596 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:17.527944 20930 catalog_manager.cc:5697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:17.324855 25325 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:17.491519 25104 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:17.536118 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 44947us
W20260709 12:18:17.548142 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 50325us
I20260709 12:18:17.407069 25307 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.553023 21180 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:17.550570 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:17.551282 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.553875 21178 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:17.495299 25067 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.527412 25183 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:17.537892 25018 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:17.548580 25320 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:17.320305 25322 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.233s
I20260709 12:18:17.567919 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.541842 25325 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.566695 21180 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:17.563830 24931 consensus_queue.cc:1059] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:18:17.566028 25260 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:18:17.572110 24931 raft_consensus.cc:3055] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:17.572467 24931 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:17.548174 25313 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:17.573422 24931 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.543478 25149 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:17.569515 25320 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.575922 25149 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:17.565924 25311 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:18:17.564757 25183 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:17.571359 21182 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:17.581450 25104 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:17.555791 25111 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:17.583824 21178 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:18:17.542660 25139 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:17.535981 25080 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:18:17.526791 25141 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.585794 21076 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:17.574687 24931 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:17.584165 25149 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.594163 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.593796 21182 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:17.596206 25328 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:17.597615 25316 consensus_queue.cc:1059] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:17.597671 24894 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:17.598131 24896 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:17.565225 25018 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:17.603996 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 53716.4us
I20260709 12:18:17.600641 25178 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.603134 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:17.607286 21181 raft_consensus.cc:2393] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:17.608255 21150 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:17.583906 25111 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:17.606638 25168 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:17.624483 21076 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:17.626142 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:17.615703 25018 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.631336 21739 raft_consensus.cc:2393] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:17.632297 25178 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.635047 25305 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:17.635440 25305 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:17.635826 25018 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.636113 25305 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.637223 25305 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.639374 25329 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:17.623553 25311 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:17.642125 25311 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.642457 25311 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.637650 25282 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:18:17.648690 25067 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:17.623270 25176 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:18:17.649616 25144 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.650130 25307 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.623445 25260 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:17.650782 25260 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:17.619652 25111 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:17.651172 25260 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.646736 20930 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 9, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 9 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:17.619591 25103 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:17.605403 25139 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.613826 25284 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:18:17.623317 25168 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:17.664569 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 46358us
I20260709 12:18:17.659049 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:17.659708 21076 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:17.663187 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:17.665256 21077 leader_election.cc:336] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.914s (SENT)
I20260709 12:18:17.665673 21077 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:17.665676 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 44216.3us
I20260709 12:18:17.664114 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:17.683562 21182 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:17.685256 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:17.676702 25168 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:17.688661 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:17.693703 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 237359us
I20260709 12:18:17.683354 25176 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:17.713464 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 48452.7us
I20260709 12:18:17.679595 25288 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 12:18:17.717099 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 89419.6us
I20260709 12:18:17.701510 25322 raft_consensus.cc:3055] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:17.718803 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.709436 25176 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.687286 25301 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.711964 25018 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:17.723592 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:17.714788 25146 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:17.723027 25176 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:17.720544 25284 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.731489 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.732359 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:17.724252 25187 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:17.719447 25322 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:17.732950 21110 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:17.730055 24859 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:17.730304 25316 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:18:17.735685 25187 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:17.760682 20999 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.747377 25067 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:17.740685 25141 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:17.736994 25344 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.744122 25338 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:17.771204 25322 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:17.773166 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 107933us
I20260709 12:18:17.765048 24859 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.777436 25325 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:17.807405 25339 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:17.807570 24859 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:17.807734 25325 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.736217 25284 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.748453 25080 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:18:17.811542 25338 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:17.813709 25282 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.814231 25282 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:17.822072 21076 leader_election.cc:336] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.557s (SENT)
I20260709 12:18:17.835726 21076 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:17.766541 25183 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:17.767880 25067 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:17.850006 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:17.879971 25282 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:17.883567 25341 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:18:17.893683 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 133071us
I20260709 12:18:17.893998 21109 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:17.912388 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 170635us
I20260709 12:18:17.914861 21747 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:18:17.777437 25149 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:17.915871 21103 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:17.917305 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.919504 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:17.923579 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 156590us
W20260709 12:18:17.924979 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 102926us
W20260709 12:18:17.939255 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.905943 25067 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:17.894765 25322 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.943585 21151 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:17.954305 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:17.954908 21181 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:17.952131 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:17.916725 25344 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:17.945717 21109 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:17.946343 25328 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:18:17.947067 25332 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
I20260709 12:18:17.894666 25139 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:17.965939 21109 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:17.969120 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:17.969532 25103 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:17.969838 21742 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:17.961509 25328 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:18.003767 21744 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:17.960606 25282 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:18.004784 25328 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:18.011703 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 94495.3us
I20260709 12:18:18.024067 21181 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
W20260709 12:18:18.012198 21076 leader_election.cc:336] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.775s (SENT)
I20260709 12:18:18.027252 21076 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:17.992143 25103 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:17.894798 25187 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.047925 25176 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:18.052618 25332 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:17.995057 25144 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:18.003924 25301 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:18.084686 21106 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:18.062855 25344 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.053539 25311 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:18.103926 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 160413us
I20260709 12:18:18.108033 21709 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:18.110324 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 98147.2us
W20260709 12:18:18.111020 21076 leader_election.cc:336] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.807s (SENT)
I20260709 12:18:18.111672 21076 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:18.106514 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:18.044438 25282 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.117688 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.120029 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:18.115159 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.120625 21744 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.119261 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:18.095265 25301 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.113444 25144 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:18.116925 24859 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:18:18.121407 25344 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.114050 25187 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:18.130776 25183 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:18.131656 25311 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:18.132472 25347 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:18:18.113531 25306 consensus_meta.cc:287] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.001s
I20260709 12:18:18.136857 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:18.136977 21182 raft_consensus.cc:2410] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:18.138228 25168 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.152494 21104 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
W20260709 12:18:18.153069 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 108842us
I20260709 12:18:18.153515 25168 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:18.134766 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:18.117061 25340 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:18.154673 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.155661 21035 raft_consensus.cc:2393] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 5: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:18.157809 21034 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:18.155435 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 44449.5us
W20260709 12:18:18.159475 21076 leader_election.cc:336] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.032s (SENT)
I20260709 12:18:18.159852 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:18.129829 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:18.147354 25301 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.161492 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:18.139459 25354 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:18.191442 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 43964us
I20260709 12:18:18.191104 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:18.191022 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.193120 21029 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:18.194892 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:18.199615 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 69850.2us
W20260709 12:18:18.194501 21076 leader_election.cc:336] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.685s (SENT)
I20260709 12:18:18.198585 21077 leader_election.cc:400] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
W20260709 12:18:18.202216 21076 leader_election.cc:336] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.128s (SENT)
I20260709 12:18:18.202627 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:18.202284 21077 leader_election.cc:403] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:18.158372 25340 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.156387 25149 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:18.158205 25351 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:18.161190 25183 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.156940 25306 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.207414 21031 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:18.161851 25322 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:18.139047 25260 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.205952 25355 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.210058 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.211805 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.191346 25354 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:18.210376 25344 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:18.228663 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.139117 25144 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.151332 25343 consensus_queue.cc:1059] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:18:18.221181 21028 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:18.223189 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.224299 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.224560 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.210232 25351 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.231103 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.223389 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:18.204804 25321 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:18.230014 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.207697 25282 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:18.207980 25340 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.208246 25176 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:18.234108 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 113756us
I20260709 12:18:18.235160 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:18.236115 21107 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:18:18.247325 25328 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.248088 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:18.249235 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:18.261559 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 77366.6us
I20260709 12:18:18.249840 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.260991 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.251188 21027 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:18.251827 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.218385 25168 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:18.265193 21031 raft_consensus.cc:2410] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:18.253439 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.253793 21179 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:18:18.254457 21711 leader_election.cc:336] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.118s (SENT)
I20260709 12:18:18.266085 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:18.256141 21108 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.256186 20999 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:18.260540 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 58353.6us
I20260709 12:18:18.229516 25354 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:18.257581 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:18.261751 21102 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.260493 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.210922 25288 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:18:18.221446 25322 raft_consensus.cc:697] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:18:18.267167 21076 leader_election.cc:336] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.192s (SENT)
I20260709 12:18:18.273202 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.281320 21076 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:18.275357 21028 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:18.255259 25351 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:18.281857 21035 raft_consensus.cc:2410] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:18:18.284273 20999 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.285485 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.285940 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:18.286543 21186 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.281968 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.287796 20999 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.307852 21027 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:18.306735 24896 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:18.263686 25343 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:18.310009 20999 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:18.264886 25301 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:18.332396 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.232865 25149 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:18:18.264493 25342 raft_consensus.cc:3055] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:18.344995 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.348068 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.352151 25260 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:18.354332 25144 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:18.290271 25282 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:18.336658 25341 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:18:18.290402 25355 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:18.358225 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 48288.7us
I20260709 12:18:18.331988 25343 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.364501 20999 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.335098 25183 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:18.368427 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.370604 21029 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:18.365155 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 100781us
I20260709 12:18:18.372561 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.375890 21102 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:18.369930 21712 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.346462 25342 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:18.359107 25111 consensus_meta.cc:287] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.000s
W20260709 12:18:18.387275 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 120131us
W20260709 12:18:18.391129 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 167796us
I20260709 12:18:18.391368 21035 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:18.392320 21077 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:18.361421 25282 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:18.398272 20999 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.358922 25356 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:18.357256 25371 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:18.370097 25343 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.404196 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:18.405265 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:18.405303 20999 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:18.406028 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 151587us
I20260709 12:18:18.416368 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.397291 25282 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.422367 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.423231 21035 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:18.423808 25344 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:18.382144 25103 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.427126 25306 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:18.403185 25301 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:18.421669 21077 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:18.406989 25355 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.446386 21077 leader_election.cc:400] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14.
I20260709 12:18:18.446708 21077 leader_election.cc:403] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:18:18.431560 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:18.368019 25340 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.404557 25321 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:18.443953 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.445658 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.447428 21185 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.449645 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:18.419667 25260 raft_consensus.cc:2764] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:18:18.419832 25338 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:18.395654 25111 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.442909 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.485052 21032 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:18.429026 25282 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.475304 21036 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:18.475677 21029 raft_consensus.cc:2376] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10. Re-sending same reply.
I20260709 12:18:18.412101 25363 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:18.423840 24894 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:18.477026 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.477682 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.407474 25067 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.486312 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.430433 25144 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:18:18.491674 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.491876 21180 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:18.492143 21744 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:18.492094 21747 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:18.495910 21180 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:18.479206 25139 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:18.498378 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:18.503177 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.502322 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.503710 21035 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:18.501855 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.504371 21032 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:18.502941 21030 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:18.503660 21029 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:18.477409 25371 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:18.498817 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:18.427776 25322 consensus_queue.cc:237] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.487120 24894 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:18.487298 25363 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:18.515936 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:18.516390 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.526821 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.515791 25371 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.546259 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.564924 21035 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.565124 25284 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:18.558512 21029 raft_consensus.cc:1240] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:18.558071 25111 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:18.545296 25321 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.558244 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:18.571753 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:18.564392 21032 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:18.518801 21185 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:18.567800 21186 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:18.575907 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.576444 21186 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
W20260709 12:18:18.577776 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.583039 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 136770us
I20260709 12:18:18.583280 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:18.584772 21109 raft_consensus.cc:2376] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13. Re-sending same reply.
I20260709 12:18:18.585261 21032 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:18.586203 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:18.591843 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:18.564392 25371 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:18.596180 21035 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:18.598474 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.521613 25355 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:18.603946 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.601898 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.565718 25363 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:18.608367 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.609042 21186 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:18.610126 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.610580 21032 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:18.611151 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.613152 25358 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:18.613577 25358 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:18.615641 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.615846 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.616421 21027 raft_consensus.cc:2410] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:18:18.617446 21027 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:18:18.625270 21076 leader_election.cc:336] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.283s (SENT)
I20260709 12:18:18.625146 25351 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.625744 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:18.627326 24894 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.631659 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.632202 21029 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:18.632565 21185 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:18.639971 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.629957 25340 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:18.640885 25362 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:18:18.641294 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:18.641856 25387 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:18:18.643371 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:18.643869 25103 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:18.644083 21105 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:18.644888 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:18.481668 25342 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.638283 25355 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:18.648597 21183 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:18.603726 25338 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.653851 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.606324 25316 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.602890 25067 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:18.638921 24931 consensus_meta.cc:287] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 1.033s	user 0.008s	sys 0.003s
I20260709 12:18:18.654788 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:18.656549 21034 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:18.657178 21030 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:18.661665 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.662299 21030 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
W20260709 12:18:18.662778 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.659425 21106 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:18.680051 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:18.681182 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:18.681841 21107 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:18.683466 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 2041) took 1015 ms. Trace:
I20260709 12:18:18.683832 21104 rpcz_store.cc:276] 0709 12:18:17.668094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.668190 (+    96us) service_pool.cc:224] Handling call
0709 12:18:17.668431 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.152834 (+484403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.683242 (+530408us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b5400253fd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:18.683407 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112779648}
I20260709 12:18:18.686149 21104 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 12:18:18.687327 25378 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:18:18.686169 25311 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:18.690671 25311 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:18.691511 25311 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.694265 21033 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:18.614432 25358 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.696475 25358 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:18.711273 21107 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:18.713304 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:18.717690 21028 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:18.671518 25342 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:18.723591 21108 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:18.660975 25316 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.729683 21104 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:18.753072 21002 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:18.739069 21029 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:18.736150 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 2044) took 1055 ms. Trace:
I20260709 12:18:18.658910 25338 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.761745 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:18.760331 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:18.765744 25364 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.758639 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.758695 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.758255 21108 rpcz_store.cc:276] 0709 12:18:17.668925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.669369 (+   444us) service_pool.cc:224] Handling call
0709 12:18:18.235030 (+565661us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b5800187b98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fe9c 00007fcb9c86fa5b 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:18:18.724040 (+489010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5147648}
I20260709 12:18:18.762699 25187 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.772758 25320 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.772694 25187 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.773954 24896 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:18.774307 24896 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:18.776057 21744 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:18.774710 25187 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:18.778707 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:18.781708 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 411815us
I20260709 12:18:18.783900 21035 raft_consensus.cc:2410] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:18:18.784541 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:18.795265 25346 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:18.794914 25397 consensus_queue.cc:1059] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:18.761915 25338 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:18.820854 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.821620 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.823954 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.752548 25354 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.831635 25401 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:18.832376 25324 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:18.832801 25388 consensus_queue.cc:1059] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
W20260709 12:18:18.853145 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 75027.1us
I20260709 12:18:18.783744 25328 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:18:18.855533 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:18.822929 25380 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:18.860955 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 63990.4us
I20260709 12:18:18.827533 25399 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.823838 25340 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:18:18.855793 25351 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:18.754297 25355 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.864255 25397 raft_consensus.cc:3055] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:18.852306 25320 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:18:18.863162 25371 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:18.887084 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 103814us
W20260709 12:18:18.887161 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 63271.8us
I20260709 12:18:18.876875 25187 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:18.888248 25393 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:18:18.891860 25282 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.894255 25364 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:18.855738 25324 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.875577 25397 raft_consensus.cc:740] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:18.900641 25139 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.901054 25141 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14.
I20260709 12:18:18.901839 25354 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:18.903000 25111 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:18.903911 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 278645us
I20260709 12:18:18.931941 21032 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:18.932365 21076 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.664s (SENT)
I20260709 12:18:18.932830 21076 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:18.904361 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 273062us
I20260709 12:18:18.933743 21075 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:18.905586 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 319427us
W20260709 12:18:18.934711 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 69512.8us
I20260709 12:18:18.907634 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:18.922825 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.921507 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 564) took 1226 ms. Trace:
I20260709 12:18:18.906735 21712 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:18.904567 25396 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:18.928649 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 63257us
I20260709 12:18:18.900103 25343 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:18.932708 25398 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:18:18.936322 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.936475 21110 rpcz_store.cc:276] 0709 12:18:17.695514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.260832 (+565318us) service_pool.cc:224] Handling call
0709 12:18:18.280562 (+ 19730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.283108 (+  2546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.283137 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.283529 (+   392us) log.cc:844] Serialized 26 byte log entry
0709 12:18:18.630010 (+346481us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b180021c160. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a6c02 00007fcb9f52e20b 00007fcb9f533d23 00007fcb9f5340d1 00007fcb9f94fa0f
0709 12:18:18.659056 (+ 29046us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:18.659090 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.659147 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.905672 (+246525us) raft_consensus.cc:1685] finished
0709 12:18:18.905690 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.921441 (+ 15751us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9752,"raft.queue_time_us":26352,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3267,"spinlock_wait_cycles":7330560,"thread_start_us":28867,"threads_started":1,"wal-append.queue_time_us":492158}
I20260709 12:18:18.937867 25288 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.959830 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:18.961200 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:18.963376 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:18.934386 25320 raft_consensus.cc:3055] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:18.967090 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:18.939006 25187 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:18.968456 25316 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:18.968818 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 62152.4us
I20260709 12:18:18.971012 21105 raft_consensus.cc:2368] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10.
I20260709 12:18:18.986698 25320 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:18.992277 25320 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.993425 25320 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:18.995659 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:18.962517 25139 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:18.997110 25139 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:18.997484 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:18.998193 21180 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:18.997958 25139 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.960184 25388 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.971276 25141 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:18.973073 25340 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:18.973784 25382 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:19.004570 25382 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:19.005426 25382 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:18.973707 25343 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:18.963505 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:18.974181 25400 log.cc:927] Time spent T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:18:18.974565 25396 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:19.007539 25388 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.989039 25407 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:18.975291 25397 consensus_queue.cc:260] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:18.976511 25324 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:19.008263 25407 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:18.940609 25344 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.008667 25407 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:18.977806 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.985558 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:18.981010 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:21.515615 21027 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
W20260709 12:18:21.516122 21027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2663) took 2840 ms (client timeout 1736 ms). Trace:
W20260709 12:18:21.516469 21027 rpcz_store.cc:269] 0709 12:18:18.675693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.980741 (+305048us) service_pool.cc:224] Handling call
0709 12:18:21.516060 (+2535319us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:21.517462 21027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2667) took 2770 ms (client timeout 2071 ms). Trace:
W20260709 12:18:21.517799 21027 rpcz_store.cc:269] 0709 12:18:18.746632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.517297 (+2770665us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:21.517395 (+    98us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:18:21.518509 21027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2668) took 2771 ms (client timeout 2095 ms). Trace:
I20260709 12:18:19.098714 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:18.974237 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:19.091334 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.007709 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 44268us
I20260709 12:18:18.999339 21178 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:21.632943 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 629) took 2638 ms. Trace:
I20260709 12:18:21.633293 21178 rpcz_store.cc:276] 0709 12:18:18.994264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.998763 (+  4499us) service_pool.cc:224] Handling call
0709 12:18:18.999037 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:21.632657 (+2633620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.632863 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:21.634980 21032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2656) took 3037 ms (client timeout 3004 ms). Trace:
W20260709 12:18:21.635370 21032 rpcz_store.cc:269] 0709 12:18:18.597762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.639754 (+ 41992us) service_pool.cc:224] Handling call
0709 12:18:21.634781 (+2995027us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54001c0554. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:21.634919 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669776768}
W20260709 12:18:21.636319 21032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2664) took 2915 ms (client timeout 2127 ms). Trace:
W20260709 12:18:21.636618 21032 rpcz_store.cc:269] 0709 12:18:18.721159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.636147 (+2914988us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:21.636251 (+   104us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:18:21.637313 21032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2670) took 2889 ms (client timeout 2211 ms). Trace:
W20260709 12:18:21.637590 21032 rpcz_store.cc:269] 0709 12:18:18.748110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.637171 (+2889061us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:21.637258 (+    87us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:18:21.638245 21032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2671) took 2889 ms (client timeout 2212 ms). Trace:
I20260709 12:18:18.988735 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:20.730424 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1791) took 2390 ms. Trace:
I20260709 12:18:21.244810 25430 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.245549 25431 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.246470 25432 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:19.123878 24896 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:21.467382 21000 connection.cc:256] RPC call timeout handler was delayed by -1.7816424269999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 12:18:21.518821 21027 rpcz_store.cc:269] 0709 12:18:18.747606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.518359 (+2770753us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:21.518457 (+    98us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:18:22.097546 21027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2665) took 3351 ms (client timeout 2959 ms). Trace:
W20260709 12:18:22.097893 21027 rpcz_store.cc:269] 0709 12:18:18.746074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.097397 (+3351323us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:22.097484 (+    87us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:18:21.514393 21030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2669) took 2766 ms (client timeout 1743 ms). Trace:
W20260709 12:18:22.100135 21030 rpcz_store.cc:269] 0709 12:18:18.747883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.985318 (+237435us) service_pool.cc:224] Handling call
0709 12:18:21.514327 (+2529009us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:21.638535 21032 rpcz_store.cc:269] 0709 12:18:18.748339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.638092 (+2889753us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:21.638177 (+    85us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:18:21.505451 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1793) took 3137 ms. Trace:
I20260709 12:18:22.102442 21034 rpcz_store.cc:276] 0709 12:18:18.367746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.367873 (+   127us) service_pool.cc:224] Handling call
0709 12:18:18.394870 (+ 26997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.659410 (+264540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.505210 (+2845800us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000c4ed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:21.505396 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601385216}
I20260709 12:18:21.697821 21031 rpcz_store.cc:276] 0709 12:18:18.339565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.339671 (+   106us) service_pool.cc:224] Handling call
0709 12:18:18.355896 (+ 16225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.356089 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:18.964519 (+608430us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b1800316240. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9f53c4bc 00007fcb9c88a48b 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a4455 00007fcba338c3c7 00007fcb9f99e9a7 00007fcb9f9ae0bf
0709 12:18:18.964659 (+   140us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.730015 (+1765356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:20.730078 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:20.730133 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.730200 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.730356 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":119399,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":138181,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":13762816,"thread_start_us":406789,"threads_started":3,"wal-append.queue_time_us":130244,"wal-append.run_cpu_time_us":1166,"wal-append.run_wall_time_us":1001183}
I20260709 12:18:21.520628 21035 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:18:22.186383 21035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35652 (request call id 542) took 3247 ms (client timeout 1767 ms). Trace:
W20260709 12:18:21.708352 21036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.951s	user 0.002s	sys 0.028s
W20260709 12:18:21.473385 21028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1790) took 3137 ms (client timeout 1644 ms). Trace:
W20260709 12:18:22.198184 21028 rpcz_store.cc:269] 0709 12:18:18.336378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.336517 (+   139us) service_pool.cc:224] Handling call
0709 12:18:21.473171 (+3136654us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540042ead4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:21.473291 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592131968}
W20260709 12:18:21.583845 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 2.6094e+06us
I20260709 12:18:22.207114 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.211618 20933 catalog_manager.cc:5697] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 6, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 6 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:22.213086 20933 catalog_manager.cc:5697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 10, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 10 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:21.479817 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 54153.8us
I20260709 12:18:21.507056 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1905) took 3007 ms. Trace:
I20260709 12:18:22.217494 21104 rpcz_store.cc:276] 0709 12:18:18.499403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.686779 (+187376us) service_pool.cc:224] Handling call
0709 12:18:18.724066 (+ 37287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.757548 (+ 33482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.506880 (+2749332us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5400252bd0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:21.507003 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27836672}
I20260709 12:18:21.747277 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:22.220400 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:21.616406 21105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 2066) took 2973 ms (client timeout 1903 ms). Trace:
W20260709 12:18:22.221417 21105 rpcz_store.cc:269] 0709 12:18:18.643119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.644662 (+  1543us) service_pool.cc:224] Handling call
0709 12:18:21.616191 (+2971529us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54003692d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:21.616331 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748385664}
I20260709 12:18:22.222427 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:21.732579 21106 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:22.225200 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.225950 21106 raft_consensus.cc:2410] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:21.729586 21108 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:22.228094 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.229419 21108 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:21.731766 21109 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:22.232918 21109 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:21.725679 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:21.527271 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.237628 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.238091 21150 connection.cc:256] RPC call timeout handler was delayed by -1.7556709300001785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 12:18:21.463543 21181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.462s	user 0.015s	sys 0.050s
W20260709 12:18:22.240316 21181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.239s	user 0.016s	sys 0.050s
I20260709 12:18:22.240955 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 630) took 3246 ms. Trace:
I20260709 12:18:22.241263 21181 rpcz_store.cc:276] 0709 12:18:18.994563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.999653 (+  5090us) service_pool.cc:224] Handling call
0709 12:18:18.999958 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:19.000304 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.000331 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.000747 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:18:22.240660 (+3239913us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:22.240697 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.240758 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:22.240798 (+    40us) raft_consensus.cc:1685] finished
0709 12:18:22.240809 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.240907 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6787,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":3239590,"threads_started":1,"wal-append.queue_time_us":117971,"wal-append.run_cpu_time_us":19992,"wal-append.run_wall_time_us":2267066}
I20260709 12:18:22.242802 25386 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:22.243338 25386 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.245855 25386 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.246271 25386 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:21.877545 25460 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:22.247092 25460 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.249115 25460 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:21.878614 25461 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.885265 25462 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:21.887303 20999 connection.cc:256] RPC call timeout handler was delayed by -1.5687445569999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 12:18:21.887513 25463 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:22.250540 20999 connection.cc:256] RPC call timeout handler was delayed by -1.4740731049998885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 12:18:22.249840 25462 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.250880 25463 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.252662 25462 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.252940 25463 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:22.253543 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08002fda40 after lost signal to thread 19891
W20260709 12:18:22.254526 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0cc0 after lost signal to thread 20968
W20260709 12:18:21.645058 21709 connection.cc:256] RPC call timeout handler was delayed by -1.2385978279999108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:18:22.255964 21709 connection.cc:256] RPC call timeout handler was delayed by -1.1179978279999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 12:18:21.571595 21710 connection.cc:256] RPC call timeout handler was delayed by -2.2415271879999636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:18:21.639652 25309 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:22.260087 25309 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:21.475179 25311 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:21.694972 25329 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.267505 25329 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.269685 25329 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:21.548667 25344 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:21.696300 25356 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.272789 25356 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:21.477759 25371 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:22.275636 25371 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:21.687860 25282 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:21.835768 25322 raft_consensus.cc:3055] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:22.280740 25322 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.281600 25322 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:21.682410 25352 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.283519 25352 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.285415 25352 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:21.703624 25430 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.288153 25430 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:21.705222 25431 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:21.706274 25432 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.292896 25432 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:21.658836 24894 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:19.017663 25141 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:21.621685 25403 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:22.300283 25403 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.302490 25403 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.303020 21111 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:21.696118 25429 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:21.251247 25435 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.306933 25429 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.307566 25435 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.308878 25429 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.309540 25435 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:21.678079 25441 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.248450 25434 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:21.724282 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 2.73532e+06us
I20260709 12:18:22.311712 25434 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.312894 21711 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:21.629558 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.460862 25436 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.343888 25436 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:21.463668 25438 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.345854 25436 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.345634 25438 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.310792 25441 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.347651 25438 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:21.467509 25440 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.322770 25309 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.349112 25309 raft_consensus.cc:2804] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:22.348932 25440 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.349572 25309 raft_consensus.cc:697] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:21.607447 25442 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:22.351809 25442 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.353803 25442 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:21.703112 21747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32986 (request call id 584) took 3569 ms (client timeout 1820 ms). Trace:
W20260709 12:18:21.711966 21768 debug-util.cc:398] Leaking SignalData structure 0x7b0800329c80 after lost signal to thread 19891
I20260709 12:18:21.696497 25305 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.360090 25305 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.362126 25305 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:21.595803 25313 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:22.363226 25313 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.365141 25313 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:21.569921 25321 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:21.697446 25359 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:18.982143 25363 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.388018 21029 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:22.388958 25363 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:19.018525 25399 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.746373 25402 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:22.391957 25402 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.394111 25402 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:22.379896 25371 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:19.008038 25406 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:18:19.038700 25407 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:21.609041 25408 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:22.399612 25408 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.401849 25408 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:22.402150 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 89314.3us
I20260709 12:18:22.402563 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:22.403285 21741 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:21.695325 25439 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:21.645838 25445 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.622031 25446 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.668004 25447 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.407743 25446 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.408334 25447 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.409826 25446 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.410202 25447 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:21.679119 25448 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:22.411432 25448 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.413431 25448 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:21.702988 25450 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.724277 25455 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:21.724849 25456 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:22.438786 25456 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.440894 25456 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:21.696902 25453 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:22.442087 25453 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.444048 25453 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:21.982017 21033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1782) took 3763 ms (client timeout 1878 ms). Trace:
I20260709 12:18:21.985466 25464 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:21.985494 25397 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:21.988121 25465 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:22.445793 21033 rpcz_store.cc:269] 0709 12:18:18.218817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.218946 (+   129us) service_pool.cc:224] Handling call
0709 12:18:21.981830 (+3762884us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400080cd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:21.981949 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990754560}
I20260709 12:18:22.446164 25465 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.446920 25486 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:22.448222 25465 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:21.991087 25466 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.448899 25466 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.450922 25466 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:21.995369 21075 connection.cc:256] RPC call timeout handler was delayed by -2.3877643889998126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:18:22.452833 21711 connection.cc:256] RPC call timeout handler was delayed by -1.920490233999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
I20260709 12:18:21.995503 25467 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.455324 21739 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:22.455148 25467 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.455310 25480 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:22.457072 25480 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.457959 25467 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.458444 25467 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:22.459106 25480 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.460513 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:22.461192 21740 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:18:22.461508 21740 pending_rounds.cc:85] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Aborting all ops after (but not including) 10
I20260709 12:18:22.461656 21740 pending_rounds.cc:107] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:18:22.461800 21740 raft_consensus.cc:2889] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:22.000582 21149 connection.cc:256] RPC call timeout handler was delayed by -2.0883537759998489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 12:18:22.463371 21149 connection.cc:256] RPC call timeout handler was delayed by -2.0649537759998111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 12:18:22.463617 21149 connection.cc:256] RPC call timeout handler was delayed by -1.7702738039999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 12:18:22.463785 21149 connection.cc:256] RPC call timeout handler was delayed by -1.4357252709999102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 12:18:22.463929 21149 connection.cc:256] RPC call timeout handler was delayed by -1.2937179259999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 12:18:22.464450 25448 consensus_queue.cc:1059] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:22.465391 25448 raft_consensus.cc:3055] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:22.465700 25448 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.466564 21102 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:22.466450 25448 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.467872 25448 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:22.468039 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:22.001681 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.069528 25401 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.469436 25401 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.098760 21027 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:22.112869 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:22.115549 25470 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:22.124049 25473 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.137435 25471 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:22.137995 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.139274 21103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.234s	user 0.004s	sys 0.040s
W20260709 12:18:22.471863 21103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.566s	user 0.005s	sys 0.040s
I20260709 12:18:22.471506 25473 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.472533 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 1907) took 3970 ms. Trace:
I20260709 12:18:22.473537 25473 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.472856 21103 rpcz_store.cc:276] 0709 12:18:18.501874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.700856 (+198982us) service_pool.cc:224] Handling call
0709 12:18:18.722826 (+ 21970us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.904880 (+182054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.904908 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.905327 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 12:18:22.472243 (+3566916us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:22.472280 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.472342 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:22.472379 (+    37us) raft_consensus.cc:1685] finished
0709 12:18:22.472389 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.472486 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181595,"raft.queue_time_us":181997,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"thread_start_us":3566579,"threads_started":1,"wal-append.queue_time_us":145168,"wal-append.run_cpu_time_us":1754,"wal-append.run_wall_time_us":1003631}
I20260709 12:18:21.528743 21151 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:22.145387 21000 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.4:35157 timed out after 1.573s (SENT) [suppressed 20 similar messages]
I20260709 12:18:22.179459 24896 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.476094 25321 consensus_queue.cc:1059] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:22.187776 20922 maintenance_manager.cc:643] P d43fece763204ac08240a85f3921173b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.679s	user 0.138s	sys 0.058s Metrics: {"bytes_written":29982,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":7238,"dirs.run_cpu_time_us":318,"dirs.run_wall_time_us":6796,"drs_written":1,"lbm_read_time_us":343,"lbm_reads_lt_1ms":4,"lbm_write_time_us":10192,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":15102,"threads_started":2,"update_count":11,"wal-append.queue_time_us":7888}
I20260709 12:18:22.478979 25444 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:22.479344 25444 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.480222 25444 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.481320 25444 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:22.190479 21036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.440s	user 0.003s	sys 0.028s
I20260709 12:18:22.483578 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2655) took 3885 ms. Trace:
I20260709 12:18:22.483932 21036 rpcz_store.cc:276] 0709 12:18:18.597612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.661698 (+ 64086us) service_pool.cc:224] Handling call
0709 12:18:18.673182 (+ 11484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.673808 (+   626us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:18.673837 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.674456 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 12:18:22.483181 (+3808725us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:22.483261 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.483346 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:22.483383 (+    37us) raft_consensus.cc:1685] finished
0709 12:18:22.483397 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.483520 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182,"raft.queue_time_us":368,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":24510,"thread_start_us":3732430,"threads_started":1,"wal-append.queue_time_us":333699,"wal-append.run_cpu_time_us":1464,"wal-append.run_wall_time_us":1001486}
W20260709 12:18:22.186781 21035 rpcz_store.cc:269] 0709 12:18:18.939366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.054605 (+115239us) service_pool.cc:224] Handling call
0709 12:18:22.186313 (+3131708us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:22.194934 20930 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 116) took 16404 ms (client timeout 15000 ms). Trace:
I20260709 12:18:22.485975 25433 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.249765 25461 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:22.250890 20999 connection.cc:256] RPC call timeout handler was delayed by -1.3519733570001335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 12:18:22.486016 25474 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:22.309468 25458 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:22.313141 21105 raft_consensus.cc:3060] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.486888 25474 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.488108 20923 maintenance_manager.cc:419] P d43fece763204ac08240a85f3921173b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8377 bytes on disk
I20260709 12:18:22.490003 25474 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.313656 25434 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:22.312218 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08002b6420 after lost signal to thread 21060
W20260709 12:18:22.315091 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 108052us
I20260709 12:18:22.226660 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:22.491883 21106 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:22.486141 20930 rpcz_store.cc:269] 0709 12:18:05.807020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.808188 (+  1168us) service_pool.cc:224] Handling call
0709 12:18:22.194820 (+16386632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:17.805181 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:17.813781 (+  8600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:17.813836 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:18:17.813867 (+    31us) tablet.cc:662] Decoding operations
0709 12:18:17.815009 (+  1142us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:17.815097 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:17.815123 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:18:17.875365 (+ 60242us) tablet.cc:701] Row locks acquired
0709 12:18:17.875411 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:18:17.875565 (+   154us) write_op.cc:270] Start()
0709 12:18:17.875701 (+   136us) write_op.cc:276] Timestamp: P: 1783599497875504 usec, L: 0
0709 12:18:17.875730 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:18:17.973446 (+ 97716us) log.cc:844] Serialized 4334 byte log entry
0709 12:18:18.876103 (+902657us) op_driver.cc:464] REPLICATION: finished
0709 12:18:19.052039 (+175936us) write_op.cc:301] APPLY: starting
0709 12:18:19.052133 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:19.053080 (+   947us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:19.053196 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:19.054216 (+  1020us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:19.054511 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:18:19.054551 (+    40us) write_op.cc:312] APPLY: finished
0709 12:18:19.054945 (+   394us) log.cc:844] Serialized 83 byte log entry
0709 12:18:19.057634 (+  2689us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:19.057776 (+   142us) write_op.cc:454] Released schema lock
0709 12:18:19.057840 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:19.099404 (+ 41564us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:19.099435 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11200472,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":164873,"apply.run_cpu_time_us":3662,"apply.run_wall_time_us":6156,"num_ops":11,"prepare.queue_time_us":32740,"prepare.run_cpu_time_us":18885,"prepare.run_wall_time_us":478118,"raft.queue_time_us":153212,"raft.run_cpu_time_us":7338,"raft.run_wall_time_us":245321,"replication_time_us":986965,"thread_start_us":512367,"threads_started":4,"wal-append.queue_time_us":508886,"wal-append.run_cpu_time_us":4015,"wal-append.run_wall_time_us":1571188}]]}
I20260709 12:18:22.214525 20933 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 7 to 9, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 9 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.218668 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.495178 21104 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:22.494668 20933 catalog_manager.cc:5697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 7 to 8, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 8 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:22.290628 25431 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.282761 25322 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.246655 25386 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.496332 20933 catalog_manager.cc:5697] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 7 to 8, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 8 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:22.497381 25386 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:18:22.341774 25469 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:22.348392 25441 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.498128 25441 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.497833 20933 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 10, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 10 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:22.498554 25441 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:22.350996 20919 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 40fd334874764b26ba28ac382c4199f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a1b891e53adc40a6a1ae813238321e93 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:18:22.354694 20932 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49682 (request call id 220) took 42658 ms (client timeout 15000 ms). Trace:
I20260709 12:18:22.355039 25309 consensus_queue.cc:237] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.499023 25433 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.502046 25433 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.274744 25356 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.358086 25426 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.503276 25426 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.503089 20933 catalog_manager.cc:5697] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 6, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 6 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.504573 20933 catalog_manager.cc:5697] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
W20260709 12:18:22.502300 20919 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 151355us
I20260709 12:18:22.505607 25426 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.358533 25440 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:22.366135 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6f20 after lost signal to thread 20968
I20260709 12:18:22.486996 25458 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.506621 20933 catalog_manager.cc:5697] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
W20260709 12:18:22.367571 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 151380us
I20260709 12:18:22.370095 21744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:22.378470 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:22.381301 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.383109 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.383812 25442 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:18:22.385514 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 128269us
I20260709 12:18:22.386654 25359 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:22.389410 21029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2666) took 3643 ms (client timeout 1661 ms). Trace:
I20260709 12:18:22.342713 25479 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.508481 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.515600 25479 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.391135 21183 raft_consensus.cc:1240] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:22.395913 25371 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.516459 20922 maintenance_manager.cc:643] P d43fece763204ac08240a85f3921173b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":288,"lbm_reads_lt_1ms":4}
I20260709 12:18:22.516649 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.405747 25439 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.515336 25487 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:18:22.517882 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 633) took 3502 ms. Trace:
I20260709 12:18:22.516348 25359 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.518210 21183 rpcz_store.cc:276] 0709 12:18:19.015470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.015642 (+   172us) service_pool.cc:224] Handling call
0709 12:18:19.015944 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.517197 (+3501253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.517681 (+   484us) spinlock_profiling.cc:243] Waited 3.37 s on lock 0x7b5400386654. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:22.517831 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7761664768}
I20260709 12:18:22.508304 25469 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.519063 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.511755 21184 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:22.512867 25464 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.520946 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.521109 25479 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.521555 21184 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:22.522173 25464 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.522426 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.507169 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.512013 21178 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:22.513010 25471 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.410720 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:22.506824 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.519428 25469 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:22.515081 21029 rpcz_store.cc:269] 0709 12:18:18.746392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.787397 (+ 41005us) service_pool.cc:224] Handling call
0709 12:18:22.389221 (+3601824us) spinlock_profiling.cc:243] Waited 3.56 s on lock 0x7b54000c53d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:22.389346 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8181192064}
I20260709 12:18:22.471277 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 543) took 3531 ms. Trace:
I20260709 12:18:21.774533 25454 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:22.423511 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:22.529695 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 1.00093e+06us
I20260709 12:18:22.529518 25454 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.430066 25484 consensus_queue.cc:1059] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:22.531421 25454 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.436990 25450 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.471201 21107 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:22.498935 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08002b6480 after lost signal to thread 21061
W20260709 12:18:22.532109 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.533020 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800292180 after lost signal to thread 21136
W20260709 12:18:22.533329 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800291b00 after lost signal to thread 21137
I20260709 12:18:22.533499 25482 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:22.534322 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800390280 after lost signal to thread 21211
W20260709 12:18:22.534580 21057 debug-util.cc:398] Leaking SignalData structure 0x7b080021ff20 after lost signal to thread 21212
W20260709 12:18:22.486619 20999 connection.cc:256] RPC call timeout handler was delayed by -1.2517731049999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
W20260709 12:18:22.534978 20999 connection.cc:256] RPC call timeout handler was delayed by -1.2166731049999271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
I20260709 12:18:22.411773 25407 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:22.356860 21747 rpcz_store.cc:269] 0709 12:18:18.133912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.134521 (+   609us) service_pool.cc:224] Handling call
0709 12:18:21.702875 (+3568354us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54006a77d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:21.703027 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761638272}
I20260709 12:18:22.404109 21742 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:22.539129 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:22.540241 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:22.540971 21738 raft_consensus.cc:2410] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 11 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:18:22.491560 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:22.541533 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 75275.6us
I20260709 12:18:22.533329 25450 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.509616 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:22.506444 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2e20 after lost signal to thread 20989
W20260709 12:18:22.543200 21768 debug-util.cc:398] Leaking SignalData structure 0x7b080026fc20 after lost signal to thread 21027
W20260709 12:18:22.543462 21768 debug-util.cc:398] Leaking SignalData structure 0x7b0800342a40 after lost signal to thread 21028
W20260709 12:18:22.544090 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f48a0 after lost signal to thread 21060
W20260709 12:18:22.544334 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffb60 after lost signal to thread 21061
W20260709 12:18:22.544607 21768 debug-util.cc:398] Leaking SignalData structure 0x7b0800060f40 after lost signal to thread 21076
I20260709 12:18:22.510705 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:22.545190 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002cc9c0 after lost signal to thread 21105
I20260709 12:18:22.405627 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.545394 21179 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
W20260709 12:18:22.541759 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 50277.1us
I20260709 12:18:22.546797 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.547832 25402 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:22.548267 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.549321 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:22.550132 25456 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:22.550341 25402 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:22.533362 25401 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.525138 25471 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.525879 21027 rpcz_store.cc:276] 0709 12:18:18.939617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.098405 (+3158788us) service_pool.cc:224] Handling call
0709 12:18:22.098642 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.471047 (+372405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.471211 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.551134 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:22.471273 25470 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.523154 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:22.526798 25469 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.551939 25465 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:22.552325 25469 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:22.552584 25465 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:22.553079 25465 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:22.553306 25482 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:22.550729 25456 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.512708 25461 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.553959 25482 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:22.507961 25441 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.554397 25469 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:22.555312 25469 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.550781 25402 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.557351 25402 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:22.557962 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08003c20c0 after lost signal to thread 21771
W20260709 12:18:22.558285 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbe80 after lost signal to thread 21772
W20260709 12:18:22.558517 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08003389e0 after lost signal to thread 24896
W20260709 12:18:22.511204 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.545503 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f93c0 after lost signal to thread 21110
I20260709 12:18:22.554388 25456 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:22.560016 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:22.560618 21738 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:22.554078 25470 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.509294 25458 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.406669 25445 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.563531 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.564083 21102 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:22.564378 25445 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.518640 25439 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.542560 21107 raft_consensus.cc:2410] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:22.564990 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.566196 25467 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:22.499372 20932 rpcz_store.cc:269] 0709 12:17:39.544725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.559681 (+ 14956us) service_pool.cc:224] Handling call
0709 12:18:22.203010 (+42643329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:06.508383 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:06.577112 (+ 68729us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:06.589920 (+ 12808us) write_op.cc:435] Acquired schema lock
0709 12:18:06.589963 (+    43us) tablet.cc:662] Decoding operations
0709 12:18:06.886511 (+296548us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:06.886600 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:06.886630 (+    30us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:18:07.030556 (+143926us) tablet.cc:701] Row locks acquired
0709 12:18:07.030608 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:18:07.030818 (+   210us) write_op.cc:270] Start()
0709 12:18:07.031002 (+   184us) write_op.cc:276] Timestamp: P: 1783599487030746 usec, L: 0
0709 12:18:07.031024 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:07.097498 (+ 66474us) log.cc:844] Serialized 10146 byte log entry
0709 12:18:07.788749 (+691251us) op_driver.cc:464] REPLICATION: finished
0709 12:18:08.489319 (+700570us) write_op.cc:301] APPLY: starting
0709 12:18:08.489417 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:08.489861 (+   444us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:08.489984 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:08.510260 (+ 20276us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:08.510721 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 12:18:08.510775 (+    54us) write_op.cc:312] APPLY: finished
0709 12:18:08.511383 (+   608us) log.cc:844] Serialized 176 byte log entry
0709 12:18:08.511605 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:08.520411 (+  8806us) write_op.cc:454] Released schema lock
0709 12:18:08.548983 (+ 28572us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:08.629995 (+ 81012us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:08.631099 (+  1104us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4389561,"reported_tablets":51,"spinlock_wait_cycles":24960,"child_traces":[["op",{"apply.queue_time_us":697739,"apply.run_cpu_time_us":8666,"apply.run_wall_time_us":108417,"num_ops":26,"prepare.queue_time_us":36924,"prepare.run_cpu_time_us":52134,"prepare.run_wall_time_us":712777,"raft.queue_time_us":344980,"raft.run_cpu_time_us":82366,"raft.run_wall_time_us":807462,"replication_time_us":722437,"thread_start_us":1078774,"threads_started":4,"wal-append.queue_time_us":174986,"wal-append.run_cpu_time_us":28351,"wal-append.run_wall_time_us":2323899}]]}
W20260709 12:18:22.560382 21077 connection.cc:256] RPC call timeout handler was delayed by -2.0216773619999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 12:18:22.531436 25480 raft_consensus.cc:3055] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:18:22.570109 21077 connection.cc:256] RPC call timeout handler was delayed by -1.8082828970000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 12:18:22.570487 21077 connection.cc:256] RPC call timeout handler was delayed by -1.6740953670000636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 12:18:22.570768 21077 connection.cc:256] RPC call timeout handler was delayed by -1.6517773620000753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24820000000000003s for a response
W20260709 12:18:22.571059 21077 connection.cc:256] RPC call timeout handler was delayed by -1.6474615619999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 12:18:22.571311 21077 connection.cc:256] RPC call timeout handler was delayed by -1.6367431280000346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:18:22.571560 21077 connection.cc:256] RPC call timeout handler was delayed by -1.3819734240000798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 12:18:22.553922 25465 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:22.558745 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800328e40 after lost signal to thread 25141
I20260709 12:18:22.575064 25466 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:22.559471 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f96c0 after lost signal to thread 21136
W20260709 12:18:22.575562 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f96e0 after lost signal to thread 21137
I20260709 12:18:22.575788 25453 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.576411 21076 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.577023 21185 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:18:22.577914 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.578613 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.578750 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.579119 25447 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:22.576285 25453 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:22.575878 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9760 after lost signal to thread 21150
W20260709 12:18:22.580047 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002f97e0 after lost signal to thread 21151
I20260709 12:18:22.580286 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.575526 25466 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.570098 25480 raft_consensus.cc:740] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:22.581264 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.581826 21178 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:22.581665 25402 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:22.582291 25466 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.579882 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.553031 21151 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:22.583618 21180 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:22.583698 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:22.577124 25441 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:22.579392 21182 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:22.584254 25453 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:22.580600 21768 debug-util.cc:398] Leaking SignalData structure 0x7b0800302020 after lost signal to thread 21178
I20260709 12:18:22.579159 21185 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:22.575228 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800273e80 after lost signal to thread 25363
I20260709 12:18:22.584824 21151 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:22.585345 21057 debug-util.cc:398] Leaking SignalData structure 0x7b080036ab40 after lost signal to thread 25399
W20260709 12:18:22.585640 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08002011c0 after lost signal to thread 25406
W20260709 12:18:22.585857 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800303b20 after lost signal to thread 25407
I20260709 12:18:22.586066 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.586918 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.587554 21184 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:22.584486 25458 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:22.584798 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee700 after lost signal to thread 21184
W20260709 12:18:22.589505 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08003361a0 after lost signal to thread 21211
W20260709 12:18:22.589772 21768 debug-util.cc:398] Leaking SignalData structure 0x7b080030f360 after lost signal to thread 21212
W20260709 12:18:22.590124 21768 debug-util.cc:398] Leaking SignalData structure 0x7b0800221a80 after lost signal to thread 21711
W20260709 12:18:22.590888 21768 debug-util.cc:398] Leaking SignalData structure 0x7b080005dcc0 after lost signal to thread 21747
I20260709 12:18:22.580309 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:22.590973 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.591677 21108 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:18:22.592679 21077 leader_election.cc:336] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.934s (SENT)
I20260709 12:18:22.592914 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.593619 21108 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:22.592689 21711 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.594980 25445 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:22.594951 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.591805 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.596625 25464 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:22.596801 25467 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.598536 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.598188 25439 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.599112 21184 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:22.599545 25470 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:22.599777 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.600075 25470 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.600473 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.601037 21180 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:22.601541 25456 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.599332 25461 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:22.599210 25439 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.602653 21182 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:22.599218 25471 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:22.602568 25461 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.603992 25471 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.604562 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.605028 21105 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:22.604655 21106 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:18:22.605615 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.605661 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.605213 25461 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.596339 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:22.607836 25439 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.606400 21107 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:22.608455 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:22.608803 21077 leader_election.cc:336] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.071s (SENT)
I20260709 12:18:22.609017 21182 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:22.602056 25470 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.606280 25471 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.610159 25467 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:22.610682 25467 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:22.611119 25467 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.606560 21108 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
W20260709 12:18:22.613711 21768 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6d40 after lost signal to thread 21771
I20260709 12:18:22.616930 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.617496 21184 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
W20260709 12:18:22.617903 21076 leader_election.cc:336] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:18:22.618379 25456 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.618597 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.619797 21184 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:22.622510 21185 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:22.640710 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.623683 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:22.623659 21077 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.211s (SENT)
I20260709 12:18:22.581707 25480 consensus_queue.cc:260] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.629630 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.629711 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.642828 21102 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 12: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:22.643287 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:22.643088 25445 consensus_queue.cc:1175] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:22.630445 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.644537 21177 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:22.645164 25480 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.630601 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.631138 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.631834 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.632285 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.651535 21184 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
W20260709 12:18:22.651652 21077 leader_election.cc:336] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.482s (SENT)
I20260709 12:18:22.632426 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.633961 25447 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:22.652290 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:22.652485 21077 leader_election.cc:336] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.522s (SENT)
I20260709 12:18:22.653031 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:22.652674 25447 raft_consensus.cc:697] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.653323 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.654075 21102 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:22.655429 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:22.655761 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:22.654196 25447 consensus_queue.cc:237] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.656463 21185 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:22.656674 21102 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:22.657930 21103 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:22.652542 21108 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
W20260709 12:18:22.634580 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 49828.3us
I20260709 12:18:22.660552 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:22.635190 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.635636 25458 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.636051 21712 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:22.636482 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 56259.9us
I20260709 12:18:22.637460 25397 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:22.638981 21183 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:22.619386 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.603801 25469 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.652326 21106 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:22.663705 25458 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.664726 21186 raft_consensus.cc:2410] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:22.665161 21149 leader_election.cc:400] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10.
I20260709 12:18:22.669872 21149 leader_election.cc:403] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:22.666833 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:22.670835 21712 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:22.662782 21151 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:22.671257 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:22.673177 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:22.673413 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:22.673909 21028 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.662194 25402 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:22.687414 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.661854 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:22.687914 25402 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:22.676504 25397 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:22.688401 25402 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:22.677269 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.511966 20933 catalog_manager.cc:5697] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:22.668100 25445 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:22.689545 25445 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:22.689936 25445 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:22.680167 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 72293us
I20260709 12:18:22.690140 20933 catalog_manager.cc:5697] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:22.690646 21076 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.691016 25456 consensus_queue.cc:1059] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:22.680292 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.683460 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:22.680750 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:22.682276 21036 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:22.692270 21107 raft_consensus.cc:2410] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:18:22.682647 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:22.683168 25464 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:22.695289 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:22.683208 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.683653 25471 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:22.683159 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.684223 25442 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:22.698546 25442 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.698938 25442 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.699935 25453 raft_consensus.cc:3055] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:22.700311 25453 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:22.700479 25371 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:22.700642 25439 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:22.700924 25371 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.701330 25371 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.701594 25453 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.702747 25453 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.688567 25397 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.705350 25397 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.707353 25456 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:22.712167 25402 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.684442 21028 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:22.684783 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.713531 21105 raft_consensus.cc:2393] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:22.685320 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.714347 21102 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:22.685789 25322 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.715225 25469 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.717108 21103 raft_consensus.cc:2393] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 12: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:22.686131 25450 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:22.719484 25450 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:22.719816 25450 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.686491 21149 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:22.686695 25386 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:22.720592 25445 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.721717 25386 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:22.722072 25386 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.722927 25445 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.712235 25442 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:22.723731 25311 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:22.726763 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.727145 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.686769 25482 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:22.686985 25401 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:22.683074 25487 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:22.663688 25448 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:18:22.736166 25448 consensus_queue.cc:1243] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:22.736688 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.736331 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.691340 25441 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:22.692219 21027 raft_consensus.cc:2376] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12. Re-sending same reply.
W20260709 12:18:22.696532 21076 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:18:22.697249 25321 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:22.738081 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:22.738173 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.675644 25141 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:22.728284 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.728940 21104 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
W20260709 12:18:22.744208 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.691311 20933 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:22.730070 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.745533 21109 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:22.728636 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.731863 21711 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.747617 21105 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:22.732843 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.748528 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.732899 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.749320 21107 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
W20260709 12:18:22.723714 25497 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:18:22.723147 25386 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.675534 21712 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:22.739796 21102 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:22.743326 21108 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
W20260709 12:18:22.754375 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 78907.4us
I20260709 12:18:22.740489 21106 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:22.740068 21076 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:22.745038 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:22.757736 21149 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:22.760991 21103 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:22.761848 20999 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.794406 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.736667 25448 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:22.795372 21182 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.795415 21711 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:22.758996 25486 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:22.802814 20999 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.804153 25471 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:22.804522 25471 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:22.804868 25471 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.764328 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:22.808140 21743 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:22.808559 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 52389.2us
W20260709 12:18:22.808645 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 44398.6us
I20260709 12:18:22.763762 21738 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:22.734256 25487 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:22.743605 25469 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:22.813838 20933 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 2 to 5, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 5 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.809307 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:22.813109 21182 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:22.818819 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:22.742297 25401 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:22.757411 25321 raft_consensus.cc:697] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.827033 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.828161 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.757632 25464 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:22.831995 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:22.886992 21102 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:22.832077 20933 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 10 to 13, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 13 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:22.887743 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.888425 21102 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:22.888170 20933 catalog_manager.cc:5697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 7 to 8, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 8 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.889132 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:22.889612 21102 raft_consensus.cc:2376] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12. Re-sending same reply.
I20260709 12:18:22.890162 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:22.889993 20933 catalog_manager.cc:5697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.801891 25448 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:22.891794 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.891695 25448 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.720523 25450 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.893675 25450 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.894416 25493 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:22.815884 25397 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:22.901602 25397 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:22.902483 25397 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:22.905395 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.810024 25282 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:22.800160 25470 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:22.828922 21002 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:22.819109 25359 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:22.820744 25487 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.877532 21185 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:22.876859 21077 leader_election.cc:336] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 3.022s (SENT)
I20260709 12:18:22.961021 21077 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:22.879412 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.880338 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.961983 21110 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
W20260709 12:18:22.881340 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 77473.3us
I20260709 12:18:22.882886 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.817672 25442 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.974193 21178 raft_consensus.cc:2410] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:22.763952 25309 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:22.884716 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.827323 25321 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.885658 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:22.825440 25386 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.828814 25311 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.819314 25402 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:22.837668 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 692237us
I20260709 12:18:22.980666 21177 raft_consensus.cc:2393] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:22.890719 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.900674 20933 catalog_manager.cc:5697] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.828034 25439 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:18:22.952443 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 53151.8us
W20260709 12:18:22.952454 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.825790 25344 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.826469 25486 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:22.954170 21104 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
W20260709 12:18:22.956054 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 127187us
I20260709 12:18:22.817056 25445 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:18:22.963552 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:22.762601 25467 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.004871 25467 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:22.975539 21186 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:23.005976 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.007040 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.007409 25471 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:22.955127 25282 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:23.008268 25282 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.009323 25471 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.958223 25470 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:23.009928 25470 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:22.960121 25454 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.010903 25344 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.011323 25454 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.011705 25454 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.013073 25344 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.013742 25486 raft_consensus.cc:697] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:22.980098 25371 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.014633 25486 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.015797 25371 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:22.986554 25311 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.018134 25311 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:22.978037 25309 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.959823 25359 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.976573 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:22.977478 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 100647us
I20260709 12:18:22.883358 25403 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:22.981771 21208 debug-util.cc:398] Leaking SignalData structure 0x7b0800364a60 after lost signal to thread 19891
I20260709 12:18:22.983527 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.958307 25446 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:22.988797 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:23.031674 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.032258 21108 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:23.033037 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:22.987799 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:22.996765 21185 raft_consensus.cc:2468] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:22.985746 25464 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:23.001492 25499 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:18:23.007958 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:23.114557 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 288040us
I20260709 12:18:22.976115 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:23.028200 21208 debug-util.cc:398] Leaking SignalData structure 0x7b080008e7c0 after lost signal to thread 20930
W20260709 12:18:23.115867 21208 debug-util.cc:398] Leaking SignalData structure 0x7b0800327440 after lost signal to thread 20968
W20260709 12:18:23.116310 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08001ab140 after lost signal to thread 20989
W20260709 12:18:23.117362 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08001aaaa0 after lost signal to thread 21060
W20260709 12:18:23.117616 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa600 after lost signal to thread 21061
W20260709 12:18:23.118643 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08003f74c0 after lost signal to thread 21136
I20260709 12:18:23.034228 21177 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:23.028153 21184 raft_consensus.cc:2376] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11. Re-sending same reply.
I20260709 12:18:23.121017 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.034685 21107 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
W20260709 12:18:23.120363 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5280 after lost signal to thread 21137
I20260709 12:18:23.018792 25309 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.051199 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.122787 21110 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
I20260709 12:18:22.958575 25465 consensus_queue.cc:1059] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:18:23.028954 25359 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.062031 21709 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:23.063108 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:23.064512 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.066558 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.069392 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.085506 25454 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.035444 25403 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.091535 25487 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.097898 25397 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.067562 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.102475 21742 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:23.105154 25322 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10.
I20260709 12:18:23.106408 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:23.108398 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.110652 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.074566 25470 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:23.113252 25505 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:23.033578 21108 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:23.028630 20933 catalog_manager.cc:5697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 1 to 9, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 9 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.163553 20933 catalog_manager.cc:5697] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 9 to 11, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 11 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:23.165447 25448 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.165180 20933 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 9, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 9 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:23.119469 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.147688 25481 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:23.167699 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.167884 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.168483 21181 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:23.168653 25481 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:22.987353 25439 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.123950 21712 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:23.133371 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:23.123176 21208 debug-util.cc:398] Leaking SignalData structure 0x7b0800034c40 after lost signal to thread 21207
I20260709 12:18:23.138366 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:23.170439 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4600 after lost signal to thread 21211
W20260709 12:18:23.170703 21208 debug-util.cc:398] Leaking SignalData structure 0x7b080032b4e0 after lost signal to thread 21212
W20260709 12:18:23.139453 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 77499.4us
W20260709 12:18:23.171795 21208 debug-util.cc:398] Leaking SignalData structure 0x7b080035ff40 after lost signal to thread 21771
W20260709 12:18:23.172071 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08003d38e0 after lost signal to thread 21772
W20260709 12:18:23.172324 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3620 after lost signal to thread 25141
W20260709 12:18:23.172663 21208 debug-util.cc:398] Leaking SignalData structure 0x7b0800307c20 after lost signal to thread 25363
W20260709 12:18:23.139900 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.172891 21208 debug-util.cc:398] Leaking SignalData structure 0x7b080031e580 after lost signal to thread 25399
I20260709 12:18:23.140255 21103 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:23.173167 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9a20 after lost signal to thread 25406
I20260709 12:18:23.146070 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:23.173403 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4d00 after lost signal to thread 25407
W20260709 12:18:23.147434 19893 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2a00 after lost signal to thread 21151
I20260709 12:18:23.132469 25282 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.158192 21180 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:23.159907 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:23.176676 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 418973us
W20260709 12:18:23.176988 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 53518.3us
I20260709 12:18:23.179692 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.176406 21178 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:23.175671 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.181692 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.179879 21149 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.186448 21149 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.186575 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:23.190227 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 226758us
I20260709 12:18:23.190713 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.192093 21712 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:23.192435 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.192584 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.193604 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:23.194948 21182 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:23.196163 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.196959 21182 raft_consensus.cc:2410] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:23.203950 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.204135 21186 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:23.203606 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.203788 21149 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.204978 21184 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:23.207441 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:23.207506 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.208274 20999 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.208813 21184 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:23.175238 25481 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.212630 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.175648 25439 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.163578 25454 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.212656 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.184136 25445 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:23.225641 21149 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.226388 25401 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.226779 25401 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:23.227234 25401 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.226681 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:23.233947 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.234789 25447 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.235176 25447 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:23.235538 25447 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.237094 25401 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.223609 25356 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.240867 25356 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.241076 21179 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:18:23.242111 25397 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:23.223781 25450 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:23.243947 25450 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.244288 25450 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.220904 25311 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:18:23.247606 25311 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:23.247901 25470 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.250293 25403 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:23.224036 25433 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.250895 25401 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:18:23.255983 25282 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.202930 25322 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:23.256691 25322 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:23.257081 25322 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:23.242209 21179 raft_consensus.cc:1240] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:23.273512 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 284787us
I20260709 12:18:23.274058 21185 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 12:18:23.275326 21185 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: [6.7-9.8]
I20260709 12:18:23.276002 21178 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:23.274266 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:23.287216 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 79005.9us
I20260709 12:18:23.220202 25402 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:23.289175 21185 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:23.293118 21179 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:23.287845 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.247943 25311 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:23.297600 25311 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.298754 25311 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.302439 21177 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:23.310076 25447 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.311882 25487 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.312032 25309 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.314147 25309 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.273414 25321 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:23.319912 25322 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.278187 25454 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.320895 25454 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.321249 25454 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.273648 25356 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.279145 25480 raft_consensus.cc:2804] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:23.328784 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 54600.2us
I20260709 12:18:23.331122 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:23.278136 25445 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:23.350174 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 62397.4us
I20260709 12:18:23.290040 25402 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:23.356540 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:23.350725 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:23.352867 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:23.296140 25431 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:23.352659 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:23.357697 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:23.344324 25471 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:23.361089 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.359074 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:23.361563 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 169529us
W20260709 12:18:23.363835 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.362108 21747 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:23.358158 25402 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.367766 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:23.357563 25474 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:23.355405 25480 raft_consensus.cc:697] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:23.357868 25486 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:23.360167 25431 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.371842 21027 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:23.372300 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.372915 25359 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.374382 25480 consensus_queue.cc:237] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.403282 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.403796 21027 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.375298 25322 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:23.376186 25474 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.405459 25474 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:23.355685 25434 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:18:23.377349 21028 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:18:23.409785 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.378214 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.411024 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.411372 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:23.411543 21036 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:23.412379 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.379202 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.412662 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:23.413143 21000 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.413558 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.380209 25439 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.414256 21035 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:23.363490 25471 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.381451 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.414767 25446 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:23.415007 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.415107 21033 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:23.415271 25446 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.415681 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:23.416162 25471 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.416791 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:23.418931 25439 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.419484 25439 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:23.419193 25445 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.380311 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.415942 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.420639 21034 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:23.420787 21033 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:23.421366 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.421537 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.421865 21034 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.414273 21000 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.381743 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.382658 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.359947 25461 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.393077 25447 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:23.396113 25450 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.399518 25371 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.413369 21742 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:23.423223 21000 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:23.399065 25431 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.423192 21032 raft_consensus.cc:2393] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:23.433197 21000 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.425233 21030 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:23.434283 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.434796 21030 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:23.435535 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.426486 21035 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.429243 21027 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:23.424213 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.433398 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.440954 21000 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:23.446404 21030 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:23.447710 21030 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:23.448591 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.431937 25439 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:23.441562 25434 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:23.452577 24896 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:23.461016 25450 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:23.422523 25486 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.467108 21183 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:23.431521 25461 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.432348 25371 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.468784 25465 raft_consensus.cc:3055] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:23.440250 25433 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.450786 25282 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:23.471824 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.475965 21108 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.477229 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.477798 21109 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.475194 21076 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.479101 21102 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:23.479511 21076 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:23.480760 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:23.481472 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.468699 25486 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.487193 25453 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:23.469089 25371 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.510011 21033 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
W20260709 12:18:23.493340 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 142667us
I20260709 12:18:23.511163 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.514444 21002 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.514647 21181 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.512022 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.469203 25465 raft_consensus.cc:740] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:23.512699 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.519781 21184 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:23.519755 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.520442 21103 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:23.520962 21182 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:23.516994 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.523433 21035 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:23.525146 21034 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:23.468703 25461 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.528700 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.529444 21182 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 14: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:23.530539 21107 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:23.532172 21002 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.535284 21106 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:23.539740 21181 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:23.541265 21002 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.540881 21712 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:23.570150 21108 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:18:23.570760 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.571467 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.571321 21106 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.575273 21002 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.576925 21002 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.581432 21109 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:23.493414 25408 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:18:23.583487 21743 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 5.
I20260709 12:18:23.585819 21000 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:23.570031 25282 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:23.571627 25433 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.527578 25407 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:18:23.593300 21035 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:23.590382 21002 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.600549 21106 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:23.587438 21149 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.472798 25481 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.584518 25399 consensus_queue.cc:1059] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:18:23.583103 25465 consensus_queue.cc:260] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.616096 25444 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:23.595373 25282 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:23.617340 25282 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:23.615612 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 553825us
I20260709 12:18:23.583144 25480 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:23.616309 25399 raft_consensus.cc:3055] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:23.619210 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:23.617666 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 136980us
I20260709 12:18:23.629842 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:23.607267 25441 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:23.614773 21002 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.621173 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:23.632630 21106 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:23.592633 25434 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.641450 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:23.612802 25439 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:23.616232 25456 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:23.589880 25523 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:23.613974 25448 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:23.612447 25464 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:23.618249 25493 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:23.633740 25399 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:23.618687 25433 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:23.706018 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 512415us
I20260709 12:18:23.640784 25466 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:23.704843 21109 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:23.743708 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 98218.4us
I20260709 12:18:23.744027 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.618366 25469 consensus_queue.cc:1059] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:18:23.744664 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.745278 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.640492 25480 raft_consensus.cc:697] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 9 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:23.761703 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.701926 25516 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:18:23.639780 25492 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 12:18:23.774158 21106 raft_consensus.cc:2410] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:23.702679 25448 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.636206 25313 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:18:23.755062 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.646522 25465 raft_consensus.cc:3060] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.775942 21102 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:23.703231 25493 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:23.797665 25474 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.775930 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.807307 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.808513 21109 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:23.772924 25466 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:23.705883 25439 raft_consensus.cc:697] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:23.782490 21075 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:23.787381 25529 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:18:23.783492 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.779130 25470 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:23.794440 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.795894 25399 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.828651 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.797232 25434 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.797493 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 2090) took 1058 ms. Trace:
I20260709 12:18:23.801834 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.634364 25441 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:23.801297 25448 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:23.780826 25525 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:18:23.778121 25523 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:23.778726 21150 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.807699 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.754580 25397 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:18:23.810603 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:23.837188 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 58542.3us
I20260709 12:18:23.837687 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.828172 21032 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 14: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:23.829470 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.830663 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.831578 21110 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:23.832367 21105 rpcz_store.cc:276] 0709 12:18:22.739415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.748216 (+  8801us) service_pool.cc:224] Handling call
0709 12:18:22.748486 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:22.753876 (+  5390us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:22.887889 (+134013us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b480021c3d8. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f 00007fcba49abf37 00007fcba49c055c 00007fcba49c0508 00007fcba49c0488 00007fcba49c0443 00007fcba49bf6ec 00007fcba38e9a96
0709 12:18:23.035058 (+147169us) log.cc:844] Serialized 14 byte log entry
0709 12:18:23.595811 (+560753us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.607371 (+ 11560us) log.cc:844] Serialized 26 byte log entry
0709 12:18:23.607514 (+   143us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:23.607549 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.607609 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:23.797222 (+189613us) raft_consensus.cc:1685] finished
0709 12:18:23.797318 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:23.797434 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":554895,"prepare.queue_time_us":61417,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":3208,"raft.queue_time_us":407636,"raft.run_cpu_time_us":2237,"raft.run_wall_time_us":136536,"spinlock_wait_cycles":69862784,"thread_start_us":289293,"threads_started":2,"wal-append.queue_time_us":179211}
I20260709 12:18:23.806602 25313 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:23.839052 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.841415 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.841928 21111 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.837934 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.839588 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:23.809603 25466 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:23.845036 21109 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:23.838986 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:23.845415 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 230699us
I20260709 12:18:23.846048 21102 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:23.846536 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.846807 21149 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.849166 25322 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:23.849499 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.850431 25322 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:18:23.850729 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.851227 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.831984 25470 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:23.835034 25441 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.854290 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.835973 25523 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.856568 21149 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:23.848084 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.857165 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.808457 25402 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.840770 25447 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:23.870714 25447 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:23.871243 25447 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:23.872051 25447 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.855937 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:23.875646 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.877563 25446 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.831797 25454 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.862990 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.864050 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.864288 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.880179 21180 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.857071 25433 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.863245 25507 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:23.865707 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.884233 25507 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:23.884821 21185 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 9: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:23.885044 25507 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.887434 21183 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:23.848516 25399 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.855307 25493 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.890141 25493 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:23.890286 25359 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.841275 25313 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:23.893219 25313 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.894297 25313 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.852105 25434 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:23.895521 25402 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:23.895632 25434 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:23.896188 21184 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:23.896522 25434 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.900511 25407 raft_consensus.cc:3055] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:23.900903 25407 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:23.901748 25407 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.866088 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:23.904873 21106 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:18:23.865607 25524 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:18:23.855858 25470 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.878655 21186 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:23.918533 21180 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:23.919246 25439 consensus_queue.cc:237] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.933543 21178 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:18:23.912629 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 293462us
I20260709 12:18:23.934963 21186 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:23.936297 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.936898 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 80383.5us
W20260709 12:18:23.911690 25356 consensus_meta.cc:287] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.563s	user 0.004s	sys 0.004s
I20260709 12:18:23.941958 21030 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:23.880291 25454 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:23.864573 25523 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.840408 25480 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:23.953011 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.960230 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:23.960927 21105 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.936995 25518 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:18:23.964984 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.969678 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.970201 21030 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:23.972016 21108 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:23.912739 25431 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:23.972621 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:23.974080 21032 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:23.975212 21033 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:23.980767 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.981534 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.982369 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.975841 21034 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:23.976094 21027 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:18:23.978514 21105 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:23.946326 25492 consensus_queue.cc:1059] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:18:23.945127 25522 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:23.983574 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.987598 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.988615 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:23.942322 25371 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.001359 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:23.947710 25444 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:18:24.003655 21028 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:23.946166 25356 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.004341 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:24.005892 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:23.986984 25530 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:18:24.008625 21034 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:23.984287 25454 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:24.010313 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:24.012883 21034 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 8. Ops: []
I20260709 12:18:24.014084 21034 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:24.015373 21030 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:24.018988 21034 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:24.002506 25481 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:24.006560 25474 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:24.027423 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.025252 25482 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:24.027496 21036 raft_consensus.cc:2393] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:24.031704 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.011116 25282 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:24.009824 25535 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:24.007170 25408 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:18:24.019948 25447 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.046101 21111 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:24.035135 25282 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:24.123488 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 177222us
I20260709 12:18:24.061537 25447 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.124487 25446 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:24.124611 25371 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:24.126207 25447 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:24.026518 25538 consensus_queue.cc:1059] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:18:24.127310 25538 raft_consensus.cc:3055] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:24.127640 25538 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:24.128243 25282 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:24.128958 25538 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.130084 25538 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:24.120241 25539 log.cc:927] Time spent T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.002s
I20260709 12:18:24.041317 25482 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.133774 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:24.137018 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:24.137600 21743 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 5.
I20260709 12:18:24.138971 21150 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:24.034281 25397 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:18:24.148182 21180 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:24.152765 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:24.167008 21179 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:24.162688 25311 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:24.132104 25466 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.177579 25522 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:24.178006 25522 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:24.180548 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:24.181246 21028 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 14: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:24.181917 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:24.183312 25549 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:24.184613 25441 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.185557 21103 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:24.174750 25311 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.187309 25311 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.188618 25520 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:24.189029 25520 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:24.189106 25482 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:24.181936 25471 consensus_meta.cc:287] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.000s
I20260709 12:18:24.165159 25481 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:18:24.191865 25471 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.193410 21029 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:24.193737 25467 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:24.194092 25467 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:24.194711 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:24.194893 25467 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.195858 25467 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.196060 21029 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:24.200289 21743 raft_consensus.cc:1240] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:24.182806 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:24.201308 21032 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:18:24.202292 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:24.188365 25523 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.204504 21032 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:24.206949 21032 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:24.208122 21032 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:24.210402 21032 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:24.213199 25474 consensus_queue.cc:1059] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:24.214278 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:24.214607 25537 raft_consensus.cc:3055] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:24.214825 21742 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:24.200765 25547 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:18:24.215101 25537 raft_consensus.cc:740] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:24.205571 25371 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:24.226802 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.233561 25520 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:24.225364 25461 consensus_meta.cc:287] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.686s	user 0.006s	sys 0.003s
I20260709 12:18:24.236362 25461 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.217043 25356 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:24.272615 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.300189 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.225189 25507 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.313776 25397 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.319007 25533 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:24.319411 25533 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:24.320026 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 564981us
W20260709 12:18:24.321647 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 539193us
I20260709 12:18:24.332445 21031 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:18:24.334103 20999 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:24.335239 20999 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:24.336274 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:24.325021 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:24.338018 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.320976 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:24.342278 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:24.342979 21105 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:24.343104 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:24.347678 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:24.347949 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:24.348248 21111 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:24.348544 21105 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.351742 21102 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:24.352645 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:24.353739 21109 raft_consensus.cc:1275] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:18:24.354064 21109 pending_rounds.cc:85] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 10
I20260709 12:18:24.354274 21109 pending_rounds.cc:107] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 10.11
W20260709 12:18:24.354429 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.354490 21109 raft_consensus.cc:2889] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:24.351743 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.355569 21076 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:24.361411 20999 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:24.362056 21111 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:24.365769 21105 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
W20260709 12:18:24.379634 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.385401 20999 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:24.392697 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:24.424544 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.430372 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 58915.4us
I20260709 12:18:24.429884 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:24.439080 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.243414 25371 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.338505 25397 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.357632 25442 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:24.357476 25538 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:24.439296 25359 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:24.448320 25456 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:24.429944 25434 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:24.447990 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 92484.1us
W20260709 12:18:24.449651 25313 consensus_meta.cc:287] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
I20260709 12:18:24.449918 25447 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.370579 25550 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:18:24.450532 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 129620us
I20260709 12:18:24.492128 21077 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:24.352922 25520 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.450994 25534 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.474092 25402 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.474475 25469 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:24.358882 25141 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:24.467891 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:24.358726 25453 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:24.461575 21149 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:24.524395 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 62891.7us
I20260709 12:18:24.370688 25474 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:24.482455 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:24.320619 25507 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.505643 25538 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:24.487175 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 283574us
I20260709 12:18:24.506111 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:24.357959 25356 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:24.463748 25471 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:24.479984 25536 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:24.525130 21103 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 12:18:24.451697 25408 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:18:24.485913 25456 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:24.527993 21712 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:24.528759 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:24.488615 21028 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:24.541640 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:24.530521 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 137816us
I20260709 12:18:24.491210 25441 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:24.531359 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 48981.6us
I20260709 12:18:24.532286 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:24.516009 25464 raft_consensus.cc:2764] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:18:24.536326 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:24.518664 25141 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.543350 21076 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:24.551591 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:24.533222 25313 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:24.530021 25466 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:24.533566 25461 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:24.504526 25447 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:24.553259 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.526221 25469 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:24.555198 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 49972us
I20260709 12:18:24.556533 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:24.535283 25344 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:24.539288 25523 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:24.557849 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:24.516868 25492 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:18:24.564134 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:24.565132 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:24.553989 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:24.522536 25402 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.539779 25453 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:24.552245 25434 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:24.549149 25456 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.523550 25480 consensus_queue.cc:1048] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:18:24.549441 25309 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:24.567386 21077 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:24.552785 25141 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:24.558861 25465 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:24.556331 25441 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:24.570093 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:24.574597 21103 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:24.575497 21076 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:24.571170 25448 consensus_meta.cc:287] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.731s	user 0.005s	sys 0.009s
I20260709 12:18:24.582823 25448 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.584352 21181 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 14: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:24.585762 25448 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:24.569305 25464 raft_consensus.cc:2764] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:18:24.557981 25538 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:18:24.590214 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.590298 21742 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:24.571306 25461 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:24.550956 25536 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.606530 25536 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:24.439677 25537 consensus_queue.cc:260] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.607158 25536 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:24.607591 25537 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:24.596164 24896 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:24.597232 21000 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:24.567903 25466 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:18:24.600288 25397 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:24.475059 25533 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.604027 25447 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:24.612167 25533 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:24.613546 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:24.614482 25471 consensus_queue.cc:1175] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 8 index: 6 } }
W20260709 12:18:24.622157 25559 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:18:24.634018 21109 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:24.578577 25453 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:18:24.623489 24896 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:24.642928 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 556) took 1273 ms. Trace:
I20260709 12:18:24.643277 21031 rpcz_store.cc:276] 0709 12:18:23.369812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.370244 (+   432us) service_pool.cc:224] Handling call
0709 12:18:23.373681 (+  3437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:24.332891 (+959210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.642692 (+309801us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54000c5dd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:24.642877 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986830208}
I20260709 12:18:24.640533 25565 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:24.640902 25560 log.cc:927] Time spent T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:18:24.641345 25402 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:24.641852 25469 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:24.589363 25570 consensus_queue.cc:1059] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:18:24.628772 25461 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:24.648666 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:24.652753 21031 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:24.607616 25536 raft_consensus.cc:697] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:24.657765 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 90436.9us
I20260709 12:18:24.595512 25282 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.595902 25311 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.670953 21186 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:18:24.659255 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 102421us
I20260709 12:18:24.665479 21077 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:24.662528 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.650727 25309 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:18:24.679982 25309 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:24.680305 25309 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:24.681066 25309 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.682152 25309 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:24.637312 25492 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:18:24.687353 25536 consensus_queue.cc:237] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.688639 25407 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.691368 25570 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:24.691618 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:24.692304 21109 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 14: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:24.697510 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:24.711540 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 46136.6us
I20260709 12:18:24.714295 21033 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:24.654698 25565 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:18:24.734227 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.717741 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:24.713519 25439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.008s	sys 0.025s
I20260709 12:18:24.742947 21077 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:24.745909 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:24.747242 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:24.694473 25469 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:24.749960 21178 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:24.752241 21030 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:24.715746 25344 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:24.741654 25439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.008s	sys 0.026s
W20260709 12:18:24.748381 25470 consensus_meta.cc:287] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.804s	user 0.009s	sys 0.000s
I20260709 12:18:24.833806 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:24.738626 25465 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:24.740375 25466 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:24.843580 21030 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:24.845081 25448 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:24.689586 25522 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.718379 25313 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:24.847122 25571 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:24.847779 25568 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:24.852993 25582 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:24.853444 25543 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:18:24.855357 25344 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:24.860054 25566 log.cc:927] Time spent T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 12:18:24.922298 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 334614us
I20260709 12:18:24.923640 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:24.861219 25282 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:24.718030 25441 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:24.751009 25469 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:24.883298 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.904841 21036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2683) took 1521 ms (client timeout 1954 ms). Trace:
W20260709 12:18:24.935055 21036 rpcz_store.cc:269] 0709 12:18:23.383805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.412152 (+ 28347us) service_pool.cc:224] Handling call
0709 12:18:24.904616 (+1492464us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b540004b354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:24.904780 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406702336}
I20260709 12:18:24.741132 24896 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.911219 25568 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:24.877982 21182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:24.946564 21182 raft_consensus.cc:606] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:24.946915 21182 raft_consensus.cc:614] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:24.846501 25470 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.952630 25311 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:24.953431 25575 raft_consensus.cc:2764] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:18:24.833798 25461 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:24.953830 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:24.907450 25466 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.954905 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:24.955257 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.959358 25575 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.959770 25573 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:25.001108 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45371.6us
I20260709 12:18:24.960052 25579 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:18:24.912016 25448 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.000226 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:24.992810 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.008898 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.009497 21029 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:25.010314 21105 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:24.951081 25442 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:24.959826 25522 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:25.013855 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.015926 25572 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.927930 25582 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.948809 25536 consensus_queue.cc:1059] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:18:24.960466 25583 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:24.953325 25581 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:24.953652 25574 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 12:18:25.030042 25577 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:25.030918 25546 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.879s	user 0.014s	sys 0.000s
I20260709 12:18:25.034332 25456 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.028401 25441 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:24.937405 25565 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.000903 25465 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.007157 25141 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.012398 25573 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:25.036037 25589 log.cc:927] Time spent T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:18:25.042331 25583 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:25.007704 25575 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.048044 25577 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:25.034296 25470 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.035915 25572 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:25.041788 25591 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 12:18:25.041869 25568 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.199777 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:25.210433 21104 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:25.211745 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:25.212049 21107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 2109) took 1580 ms. Trace:
I20260709 12:18:25.222923 25448 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:25.223510 21182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:25.165504 25583 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.164263 25575 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.163342 25577 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.161664 25573 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.269522 21036 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:25.271092 25141 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.271214 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:25.167613 25572 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:25.014364 25313 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.036484 25579 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:18:25.167690 25582 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:25.279312 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54792.4us
W20260709 12:18:25.170295 25534 consensus_meta.cc:287] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.002s
I20260709 12:18:25.280874 25534 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:25.240190 25466 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:25.282013 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:25.272131 21180 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:25.271034 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:25.282039 21102 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:25.284474 21030 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.266011 21182 raft_consensus.cc:606] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:25.279574 25141 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:25.287026 25141 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:25.251631 21108 raft_consensus.cc:2393] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 8: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:25.288468 25141 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.295008 25141 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:25.315786 21028 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:25.318055 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2140) took 1451 ms. Trace:
I20260709 12:18:25.318511 21179 rpcz_store.cc:276] 0709 12:18:23.866162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.879577 (+ 13415us) service_pool.cc:224] Handling call
0709 12:18:23.879824 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.167407 (+287583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.317466 (+1150059us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540033c554. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:25.317820 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658692480}
I20260709 12:18:25.319386 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.332232 25442 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:25.332939 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:25.333956 21035 raft_consensus.cc:2393] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:25.335217 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:25.336145 21036 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:25.337277 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:25.260350 21107 rpcz_store.cc:276] 0709 12:18:23.631890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.633526 (+  1636us) service_pool.cc:224] Handling call
0709 12:18:23.644055 (+ 10529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.703627 (+ 59572us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:23.703658 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.774989 (+ 71331us) log.cc:844] Serialized 26 byte log entry
0709 12:18:23.938576 (+163587us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:23.938613 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.938676 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:24.716016 (+777340us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:25.211501 (+495485us) raft_consensus.cc:1685] finished
0709 12:18:25.211541 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.211879 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":527954,"raft.queue_time_us":108919,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":23808,"spinlock_wait_cycles":13260160,"thread_start_us":140508,"threads_started":1,"wal-append.queue_time_us":222058}
I20260709 12:18:25.308512 25568 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:25.322196 21031 consensus_meta.cc:287] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.669s	user 0.004s	sys 0.013s
I20260709 12:18:25.342048 21031 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:25.351212 21030 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:25.344712 25553 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.356935 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:25.357959 21035 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:25.364588 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:25.365509 21182 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:25.365937 25356 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:25.366348 25356 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:25.368239 25371 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:25.370445 25431 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.372537 21076 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:25.373692 25464 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:25.368304 21186 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:18:25.385743 25356 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.387610 25356 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:25.368551 25553 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:25.401186 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.410563 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.411159 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.418033 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 1965) took 1076 ms. Trace:
W20260709 12:18:25.419061 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.420950 25493 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:18:25.422274 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.422405 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:25.423038 21186 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:25.424897 25553 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.418402 21108 rpcz_store.cc:276] 0709 12:18:24.341882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.342013 (+   131us) service_pool.cc:224] Handling call
0709 12:18:25.417799 (+1075786us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b5400241154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:25.417955 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088319872}
W20260709 12:18:25.419070 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.433957 25557 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 1.116s	user 0.010s	sys 0.000s
W20260709 12:18:25.439488 25407 consensus_meta.cc:287] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.016s
I20260709 12:18:25.438407 25469 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.445118 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:25.445420 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1821) took 1431 ms. Trace:
W20260709 12:18:25.446141 25604 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:18:25.445755 21029 rpcz_store.cc:276] 0709 12:18:24.013780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.196809 (+183029us) service_pool.cc:224] Handling call
0709 12:18:24.197058 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.009855 (+812797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.444904 (+435049us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b540004b854. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:25.445172 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1863777024}
I20260709 12:18:25.449546 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1827) took 1317 ms. Trace:
I20260709 12:18:25.449975 21033 rpcz_store.cc:276] 0709 12:18:24.132472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.686500 (+554028us) service_pool.cc:224] Handling call
0709 12:18:24.686769 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.714781 (+ 28012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.449104 (+734323us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b540027ea54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:25.449366 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62887296}
I20260709 12:18:25.451939 21180 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:25.452281 25444 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.452963 25444 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.457263 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.459198 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.460134 21111 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:25.461127 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:25.462007 21111 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:25.463261 21111 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:25.463852 21107 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:25.468330 25571 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:25.468768 25571 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.469117 25571 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.457401 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:25.482797 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.487344 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:25.460942 21108 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:25.497725 25464 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:25.487746 25469 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:25.510178 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:25.505097 25464 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.516755 25344 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:18:25.517537 25464 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.518458 25444 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:25.514391 21178 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 15.
I20260709 12:18:25.519452 25593 raft_consensus.cc:3055] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:25.509828 25553 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:18:25.520888 25553 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:25.521314 25553 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:25.521402 25587 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.561s	user 0.001s	sys 0.001s
I20260709 12:18:25.522965 25553 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.526093 25588 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:25.535380 25568 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.519930 25593 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:25.546283 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.539108 25588 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:25.563565 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.569283 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:25.569947 21743 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:25.572052 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:25.576014 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:25.576774 21106 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.573930 21709 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:25.550637 25568 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:25.579563 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 71606.2us
I20260709 12:18:25.584836 21107 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:25.585733 25486 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:18:25.597164 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.600378 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1813) took 1622 ms. Trace:
I20260709 12:18:25.600735 21034 rpcz_store.cc:276] 0709 12:18:23.977902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.020291 (+ 42389us) service_pool.cc:224] Handling call
0709 12:18:24.020562 (+   271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:24.030243 (+  9681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.030290 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:24.035087 (+  4797us) log.cc:844] Serialized 52 byte log entry
0709 12:18:24.223599 (+188512us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:24.230689 (+  7090us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.274025 (+ 43336us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.274194 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.274267 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.033651 (+759384us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b180034ffc0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:18:25.516566 (+482915us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b180034ffc0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:18:25.591169 (+ 74603us) raft_consensus.cc:1685] finished
0709 12:18:25.591188 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.600217 (+  9029us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9223,"prepare.queue_time_us":85550,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2957,"raft.queue_time_us":20612,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":23941,"spinlock_wait_cycles":166545024,"thread_start_us":84282,"threads_started":1,"wal-append.queue_time_us":243637}
I20260709 12:18:25.604213 25568 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:25.607985 21076 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:25.590492 25486 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:25.602353 25606 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:18:25.614413 25593 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.616691 25593 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:25.626448 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:25.627326 25344 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:25.627707 25344 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:25.627879 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:25.628125 25344 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.630033 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:25.630393 21186 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:25.611650 25486 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:25.595247 25588 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.636163 21106 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 7.
I20260709 12:18:25.641850 25466 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:25.646966 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.652160 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.653921 25481 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.654523 25481 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.655128 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:25.656038 21738 raft_consensus.cc:2393] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:25.657061 25481 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.657912 21743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a"
dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:53714
I20260709 12:18:25.658597 21743 raft_consensus.cc:606] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:25.660240 25518 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:25.660480 25574 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:25.659822 21742 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:25.639956 25534 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:25.662744 25518 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:25.663246 25570 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.663765 25570 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.663718 25518 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.654402 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:25.612188 25571 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:25.653859 25612 log.cc:927] Time spent T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:18:25.680786 25571 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.681062 25507 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:25.682125 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 52180.7us
W20260709 12:18:25.682735 25613 log.cc:927] Time spent T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:25.683526 21107 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 12:18:25.683454 21179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db9d39844048444b8a7293196d1349e9"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:25.685469 21179 raft_consensus.cc:606] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:25.685833 21179 raft_consensus.cc:614] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:25.659992 25439 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.682919 21076 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:25.689306 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.691893 24896 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.699564 24896 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.700896 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:25.701931 24896 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.706112 25450 raft_consensus.cc:3055] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:25.706547 25450 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:25.686825 25570 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:25.707559 25450 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.708246 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:25.708832 20999 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:25.710126 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:25.710973 25454 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:18:25.711800 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.712437 25454 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:25.712988 25454 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:18:25.713353 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 167453us
I20260709 12:18:25.713795 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:25.713982 25454 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.714996 25568 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.715497 25568 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:25.716527 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.717377 25568 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:25.719244 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:25.714996 25439 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.719978 21182 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:25.720855 25141 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:25.721331 25141 raft_consensus.cc:697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:25.721611 25439 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.719172 25565 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:25.710867 25553 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.720721 25313 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:25.722621 25565 raft_consensus.cc:697] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:25.723246 25571 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.723809 25571 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.724344 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.724993 21110 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:25.725426 25450 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.725947 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.727334 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.719277 25397 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.729019 25397 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.735828 21712 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:25.732369 21103 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:25.722534 25574 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:25.725838 25571 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:25.739348 25397 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:25.741079 21027 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:25.742921 25407 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:25.744100 21033 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:25.744360 21034 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:25.744591 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:25.746860 21105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 610) took 1019 ms. Trace:
W20260709 12:18:25.750154 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.751098 25397 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:25.750715 21032 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:25.747315 25407 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.753508 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:25.754180 21035 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.754315 25407 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:25.758955 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.759405 21106 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:25.723913 25565 consensus_queue.cc:237] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.766037 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.768754 25344 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.771258 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.772573 21179 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:25.772862 21181 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.773545 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:25.775018 25344 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.775068 21178 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:25.768747 25456 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:25.776852 21182 raft_consensus.cc:2393] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 14: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:25.747226 21105 rpcz_store.cc:276] 0709 12:18:24.726013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.013079 (+287066us) service_pool.cc:224] Handling call
0709 12:18:25.013354 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.025829 (+ 12475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.025854 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.026307 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:18:25.309300 (+282993us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:25.313298 (+  3998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.326924 (+ 13626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.743207 (+416283us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5400000da0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f909dbe 00007fcb9f914930 00007fcb9f9148d8 00007fcb9f914858 00007fcb9f914813 00007fcb9f913a9c 00007fcba57ff2f6 00007fcba57f9aa8 00007fcb9f9507cb 00007fcb9f9532c0
0709 12:18:25.744896 (+  1689us) raft_consensus.cc:1685] finished
0709 12:18:25.744914 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.745109 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12079,"raft.queue_time_us":21392,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":57,"spinlock_wait_cycles":31596928,"thread_start_us":233231,"threads_started":1,"wal-append.queue_time_us":262542}
I20260709 12:18:25.722261 25141 consensus_queue.cc:237] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.785017 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 601) took 1434 ms. Trace:
I20260709 12:18:25.785399 21104 rpcz_store.cc:276] 0709 12:18:24.350857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.350979 (+   122us) service_pool.cc:224] Handling call
0709 12:18:24.429811 (+ 78832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.263964 (+834153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.784767 (+520803us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b5400229054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:25.784962 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793622912}
I20260709 12:18:25.787324 21110 raft_consensus.cc:2410] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:18:25.790186 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.790752 21182 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:25.795745 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.791889 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:25.804059 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.805845 21035 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:25.805675 25486 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.807031 25407 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.807577 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 2126) took 1110 ms. Trace:
I20260709 12:18:25.807946 21109 rpcz_store.cc:276] 0709 12:18:24.697096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.697292 (+   196us) service_pool.cc:224] Handling call
0709 12:18:25.807282 (+1109990us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400305a54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:25.807421 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385074048}
I20260709 12:18:25.805586 25518 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.811882 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1834) took 1595 ms. Trace:
I20260709 12:18:25.812259 21028 rpcz_store.cc:276] 0709 12:18:24.216255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.844621 (+628366us) service_pool.cc:224] Handling call
0709 12:18:24.904762 (+ 60141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.316212 (+411450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.811080 (+494868us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540004b354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:25.811700 (+   620us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b540004b350. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:25.811830 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081106048}
I20260709 12:18:25.814898 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:25.820259 25407 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.827033 21181 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:25.828186 21182 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:25.832685 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.833226 21186 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:25.838933 25464 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:25.842084 21178 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:18:25.843602 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:25.844164 21035 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.850720 21035 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:25.842027 21076 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:25.854286 25456 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:25.855836 21028 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:25.857306 25486 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:25.860631 25568 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:25.861073 25568 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:25.861459 25568 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.862207 21076 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:25.842449 21178 pending_rounds.cc:85] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 7
I20260709 12:18:25.863576 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.864135 21181 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:25.863703 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.854007 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:25.865696 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.866261 21149 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:25.865597 21182 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:25.863313 21178 pending_rounds.cc:107] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:18:25.873148 21178 raft_consensus.cc:2889] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:25.874316 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.873378 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.872500 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.876689 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:25.876317 21111 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:25.884829 21103 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:25.885475 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:25.882462 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:25.866919 25571 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:25.872128 25574 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:25.887347 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:25.897738 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.898447 21186 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:25.884680 21000 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:25.902930 25622 log.cc:927] Time spent T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:18:25.870812 25469 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:18:25.906978 25571 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:25.909065 21034 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:18:25.909709 25571 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:25.910959 21035 raft_consensus.cc:1275] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:25.911088 21106 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:25.911334 25536 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:25.911870 25536 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:25.868064 25446 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:18:25.912407 21741 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:25.919560 21109 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:25.914961 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.906708 25465 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:25.919106 21105 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:25.912755 25536 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.951908 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.940464 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:25.933259 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 2118) took 1456 ms. Trace:
W20260709 12:18:25.943167 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.954787 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 75345.4us
I20260709 12:18:25.928344 21179 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:25.957464 21033 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:25.954382 25431 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:25.959807 25431 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:25.918746 25568 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.900377 25507 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:25.960184 25431 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.960672 21178 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:25.957139 25465 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:25.961097 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.962318 25507 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.962716 25507 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.965227 25493 raft_consensus.cc:993] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:25.965657 25493 raft_consensus.cc:1081] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:25.966101 21032 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:25.949831 25467 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:25.966920 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.967509 21184 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:25.968232 21030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:35652
I20260709 12:18:25.968813 21030 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.969120 21030 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:25.967280 25467 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:25.972425 25467 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:25.942826 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:25.952981 21102 rpcz_store.cc:276] 0709 12:18:24.464578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.465975 (+  1397us) service_pool.cc:224] Handling call
0709 12:18:24.466266 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.284112 (+817846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.920595 (+636483us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b540016f3d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:25.920780 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874896640}
I20260709 12:18:25.926285 21712 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:25.981276 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 55077.6us
I20260709 12:18:25.978183 21181 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 16.
I20260709 12:18:25.990535 21184 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:25.973750 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:25.991055 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 56229.7us
I20260709 12:18:25.991470 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:25.992235 21186 raft_consensus.cc:2410] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:18:25.994668 21030 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:25.998464 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 57041.6us
I20260709 12:18:26.000007 21107 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:26.001523 25446 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:26.001941 25446 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.961946 25465 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.002300 25446 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.002595 25466 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:26.003166 25466 raft_consensus.cc:697] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:26.004057 25466 consensus_queue.cc:237] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.010581 21742 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:26.011405 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:26.012105 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.012145 21077 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:25.991250 25467 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:26.020246 25141 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:26.019004 25574 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:26.032469 25507 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.034951 25507 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:26.039080 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.993433 25553 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:26.019012 21034 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:26.038969 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:26.018930 25511 consensus_queue.cc:1048] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:18:26.038741 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:26.042902 21178 raft_consensus.cc:2393] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:18:26.040417 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 45007.2us
I20260709 12:18:26.045495 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:26.046940 25486 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:26.057582 25486 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:26.047230 25568 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:26.041972 25397 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:26.047746 21102 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:26.049492 25450 raft_consensus.cc:3055] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:26.051489 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:26.052596 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:26.080437 21106 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.046388 25519 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:18:26.053524 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.060637 21030 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:26.067809 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:26.083281 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.088491 21032 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:26.082830 25553 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:26.091281 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.086165 25469 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:18:26.097739 25568 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.098186 25568 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.100211 25568 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:26.100618 25568 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.100997 25568 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.095923 25446 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.101279 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:26.101851 21742 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:26.058620 25486 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.080106 25450 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.080669 25593 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:18:26.120978 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:26.102972 21150 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:26.103952 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.121497 21743 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:26.106925 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.116254 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.123966 21743 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:26.138554 21109 raft_consensus.cc:2410] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:18:26.148406 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 45507.3us
I20260709 12:18:26.153255 21107 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:26.156445 21102 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:26.113278 25621 log.cc:927] Time spent T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.265s	user 0.006s	sys 0.000s
I20260709 12:18:26.151538 21743 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.160382 21743 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.161854 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:26.162487 21110 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.103108 25572 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.167052 21106 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:26.102802 25568 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:26.103231 25446 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:26.159294 25313 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:26.163065 25465 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.107102 25397 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.126822 25431 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.103808 25582 consensus_queue.cc:1059] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 12:18:26.210585 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.193080 25313 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.190495 25572 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.191743 25466 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:26.264544 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 204810us
I20260709 12:18:26.116654 25450 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.050160 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:26.272709 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:26.268520 25313 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.285077 21149 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:26.207262 25465 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.288684 25519 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:26.289105 25482 consensus_queue.cc:1059] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:26.290591 25570 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:26.291755 25444 consensus_queue.cc:1059] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:26.311559 25482 raft_consensus.cc:3055] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:26.311899 25482 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:18:26.313098 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.312790 25482 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.313490 25371 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.314010 25482 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:26.315021 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.295187 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:26.282047 25461 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:26.298483 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:26.222018 25553 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:26.302132 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.276368 25593 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.306447 21110 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
W20260709 12:18:26.306094 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.317559 21149 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:26.270259 25454 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:18:26.277459 25466 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.324407 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:26.310202 25519 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.333178 25486 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:26.321612 25446 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:26.335086 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:26.315037 25322 raft_consensus.cc:3055] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:26.333071 25519 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.314041 25371 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.336529 25572 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:26.337862 25371 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:26.338735 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.336206 25322 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.330745 25582 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:26.339741 25582 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.339816 25322 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.341207 25322 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.341022 25582 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.343341 21002 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.343842 25570 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:26.344324 25570 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.345252 25570 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.347306 25454 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.335820 21738 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 9: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:18:26.332417 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.362120 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.362809 21106 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:26.355796 21028 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:26.364198 21743 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:26.369236 21741 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:26.369480 25431 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:26.369659 21000 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:26.370606 25454 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:26.371083 25454 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:26.371906 25454 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:26.374481 25627 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:18:26.376617 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.382045 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.387701 25465 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:26.387639 21105 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:18:26.395555 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.403223 25493 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:26.409509 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 95154.4us
I20260709 12:18:26.409735 21002 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.365984 25593 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.383420 25572 consensus_queue.cc:1059] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:18:26.425568 21105 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:26.407661 25565 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:26.403739 25493 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.432188 25646 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.432686 21102 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:18:26.433086 25635 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:18:26.416844 25465 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:18:26.432222 21111 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:26.441977 21033 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:26.448004 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.448851 25431 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:26.429797 25371 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:26.457417 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.458297 25466 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:26.458868 25466 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:26.459080 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.427865 25572 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:18:26.461476 25397 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:26.462086 25565 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.464159 25565 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:26.464629 25565 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.464928 25313 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.465200 25565 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:26.466257 25565 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:26.467581 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:26.468130 21105 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.467746 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.434751 25454 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.473333 25507 raft_consensus.cc:3055] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:26.475577 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:26.490875 21110 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:18:26.488227 25644 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 12:18:26.417965 25446 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.489750 21028 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:26.449518 25632 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:18:26.498028 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:26.499991 21106 raft_consensus.cc:2393] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:26.497143 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.490149 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:26.504647 21111 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:26.471875 25313 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:26.468869 25519 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.491825 25431 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:26.494166 25507 raft_consensus.cc:740] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.511847 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:26.512935 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 45245us
I20260709 12:18:26.457425 25371 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.502750 25565 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:18:26.517800 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 67624.6us
W20260709 12:18:26.521019 25634 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:18:26.522092 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:26.523206 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 92357.7us
I20260709 12:18:26.524235 25593 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:26.526190 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:26.529440 21110 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 16.
I20260709 12:18:26.530618 25322 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:26.530974 25645 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:26.532893 25645 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.524452 25467 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:18:26.535024 25371 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:26.535020 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:26.536509 21104 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.542383 25445 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.542876 25445 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.544204 25642 raft_consensus.cc:3055] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:26.544589 25642 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.544919 25445 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:26.545467 25642 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.544941 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.547150 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.547344 21030 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:26.547758 21035 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:26.522125 25643 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.532836 25519 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:26.508895 25454 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.556691 25454 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:26.557370 25446 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.560510 21027 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:26.567181 21711 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:26.511193 25431 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:26.567924 25511 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:26.546654 25642 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.568297 25511 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.568702 25511 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:26.568468 25431 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.569802 25431 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.571480 25565 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.573328 25441 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:26.573846 25441 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.575719 25467 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:26.578292 25441 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:26.579622 21105 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:26.580673 21102 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:26.580693 21104 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
W20260709 12:18:26.584324 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 58219.1us
I20260709 12:18:26.592028 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.592634 21035 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:26.593990 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:26.594828 21034 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:26.601454 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.600898 25441 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:26.604427 25441 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.604791 25441 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.549111 25643 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.610818 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:26.611649 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:26.612284 21741 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.613691 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.618148 25371 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.618604 25582 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.616385 25507 consensus_queue.cc:260] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.636096 25507 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.640661 21149 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:26.641645 25651 log.cc:927] Time spent T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 12:18:26.645430 25493 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:26.647130 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 49005.3us
I20260709 12:18:26.647826 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.650243 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:26.651825 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:26.652590 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.658815 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:26.658313 21747 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:26.659417 21180 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:26.660248 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:26.662662 21741 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:26.665122 21150 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.661540 21712 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:26.672784 21028 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:18:26.678630 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 49533.6us
I20260709 12:18:26.679404 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:26.679685 25652 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:26.668447 25431 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.675868 25642 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:26.678113 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 157902us
I20260709 12:18:26.684897 21075 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:26.668026 25371 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.687654 21075 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:26.673038 25568 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:26.691128 21002 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.692092 25573 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:26.692281 21002 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.694005 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.695252 25646 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:26.695778 25454 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.695508 25431 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:26.692631 25450 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.696187 25441 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.698581 25441 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:26.699133 21002 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:26.699466 25568 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.699970 25431 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.675741 25493 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:26.700832 25493 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.701237 25493 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:26.701588 25637 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 12:18:26.703130 21186 raft_consensus.cc:1240] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:26.703600 21180 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:26.669324 25519 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:18:26.704598 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:26.705140 21181 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:26.706696 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:26.707299 21178 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:26.710940 21179 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:26.714610 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:26.715026 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:26.726616 21028 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.727154 21180 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:26.736951 21179 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:26.737735 21181 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:26.703091 25588 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.738834 21186 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:26.739540 21178 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:18:26.739749 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 52166us
W20260709 12:18:26.746781 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.706557 25573 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:26.761715 21184 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:18:26.762091 21184 pending_rounds.cc:85] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 4
I20260709 12:18:26.767961 21184 pending_rounds.cc:107] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:18:26.768292 21184 raft_consensus.cc:2889] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:26.765100 20999 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:26.780987 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:26.778651 21741 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:26.781556 21743 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.742100 25469 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.783018 21182 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:26.778832 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:26.764322 25654 log.cc:927] Time spent T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:18:26.700419 25568 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.776621 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:26.778417 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:26.725028 25486 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:18:26.726915 25446 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:18:26.764650 25573 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.714506 25511 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.726212 25645 consensus_queue.cc:1059] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:18:26.780789 25572 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.802340 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.790256 25565 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:26.809796 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.810607 21104 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:26.790078 25371 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:26.815913 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:26.820102 21743 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:26.764206 25583 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 12:18:26.824163 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.823087 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:26.823442 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.830276 21106 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:26.830418 21746 raft_consensus.cc:2368] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 15. Current term is 16.
I20260709 12:18:26.840931 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:26.838827 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.815172 25652 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.815685 25565 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.845918 21031 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:26.848801 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.797215 24896 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:18:26.852805 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.807334 25431 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:18:26.849417 21104 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:26.852394 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.807524 25454 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:18:26.855892 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:26.857156 21029 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:26.846521 25565 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:26.863921 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 65616.9us
I20260709 12:18:26.809968 25461 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:18:26.867753 21106 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 15.
I20260709 12:18:26.869081 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.847579 25642 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.878746 21075 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:26.846107 25643 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:26.849647 25322 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:26.897747 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 90192.5us
I20260709 12:18:26.902129 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:26.846964 25632 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:18:26.904837 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.822077 25572 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.917627 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.904932 21106 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:26.852552 25371 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.925959 21029 raft_consensus.cc:2393] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:26.922340 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.905114 25439 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:26.927618 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:26.926555 21036 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:26.899362 25660 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:26.931041 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:26.897331 25571 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:18:26.934722 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.935396 21034 raft_consensus.cc:2368] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 9. Current term is 10.
I20260709 12:18:26.934734 21186 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:18:26.937896 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.938483 21030 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:26.901063 25322 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:26.927021 25643 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:26.941823 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:26.940243 21031 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:26.937045 21186 pending_rounds.cc:85] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 6
I20260709 12:18:26.942628 21186 pending_rounds.cc:107] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:18:26.930312 21177 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:26.942971 21186 raft_consensus.cc:2889] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:26.943699 21111 raft_consensus.cc:2393] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 14: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:26.946923 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:26.947532 21185 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:26.928520 25439 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:26.956606 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.962050 21030 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:26.962764 25656 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:18:26.963138 25511 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:26.964073 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:26.966512 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.969480 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.971642 21177 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:26.975069 25467 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.975525 25467 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.977222 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.977829 21036 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:26.977455 25467 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:26.979720 25322 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.980345 25572 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:26.981841 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:26.982421 21111 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:26.968322 25642 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.970088 21034 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:26.978685 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:26.988201 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 45157.9us
I20260709 12:18:26.990970 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.989717 25519 consensus_queue.cc:1243] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:26.992818 25445 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.996093 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.996256 25445 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:26.997265 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:26.998276 25445 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:26.998368 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:26.999024 25439 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:26.999677 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.000241 21036 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:27.001076 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.001511 21036 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:27.003103 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.004137 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.004767 21030 raft_consensus.cc:2393] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:27.008947 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.009297 21077 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:27.011250 21036 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:26.966595 25660 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:27.017943 25660 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.014233 25536 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.014835 25467 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:27.015313 25593 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:27.015657 25465 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:27.016227 25571 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:27.016819 21111 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:27.021494 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.032346 21033 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:27.035264 21185 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:27.038666 21028 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:27.033560 25583 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:18:27.043507 21036 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:27.051828 21183 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:27.052922 25439 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:27.053042 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:27.040055 25667 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.251s	user 0.003s	sys 0.000s
I20260709 12:18:27.053970 21036 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:27.055284 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.055449 21185 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:27.057678 21185 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:27.058421 21185 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.059540 21185 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:27.026804 25593 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:27.060587 25593 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:27.063233 21034 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:27.064291 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.064872 21034 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:27.019333 25536 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.066744 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.067260 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.068753 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.072068 21033 raft_consensus.cc:2393] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:27.073696 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.074710 21033 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:27.075857 21033 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:18:27.080351 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.082615 21034 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:27.083703 21034 raft_consensus.cc:1240] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:18:27.061409 25573 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.087971 21181 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:27.090553 21000 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.018795 25493 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.099407 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:27.102221 21111 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:27.100172 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:27.110195 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.110394 21104 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:27.111104 21000 leader_election.cc:400] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 15. Current term is 16.
I20260709 12:18:27.111415 21000 leader_election.cc:403] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:27.110234 21149 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:27.113921 25431 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:18:27.114301 25450 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:27.114677 25450 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.115157 25450 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.120276 25519 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:27.125419 25450 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.126410 25553 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.126880 25553 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.128777 25553 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.131410 25450 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:27.141665 25536 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:27.143311 25662 log.cc:927] Time spent T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.353s	user 0.000s	sys 0.002s
I20260709 12:18:27.144965 25493 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.097688 25632 raft_consensus.cc:2764] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:18:27.152146 21036 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:27.154492 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:27.155055 21107 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.113188 25675 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:18:27.161171 21182 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:27.169879 25371 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.176280 25441 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:27.176645 25441 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:27.177420 25441 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.186434 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.200958 21107 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:27.191991 25593 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.207196 21111 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 16.
I20260709 12:18:27.178591 25441 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:27.202173 21149 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:27.208072 25684 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.211414 25684 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.213431 25684 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:27.220840 25446 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:27.224285 21002 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.228763 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:27.229399 21111 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:27.230504 21107 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:18:27.222687 21151 leader_election.cc:336] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.589s (SENT)
W20260709 12:18:27.266594 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 255657us
I20260709 12:18:27.225281 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:27.267673 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:27.166757 25431 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 15. Current term is 16.
I20260709 12:18:27.270403 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:27.271006 21747 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:27.272521 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:27.278226 21030 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:27.280298 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:27.268656 25684 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:27.267395 25371 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:27.269822 25680 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:18:27.279886 25536 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:27.265152 25454 consensus_queue.cc:1059] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:18:27.288159 25450 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.300771 21077 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:27.312479 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 89828.5us
I20260709 12:18:27.295548 25371 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:27.300478 25536 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.300298 25519 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:27.321679 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 55780.3us
I20260709 12:18:27.327414 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.307018 25684 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:27.310597 25141 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:18:27.337101 21002 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.338774 21185 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:27.337803 25571 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:27.339710 25659 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:18:27.345201 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:27.410444 21111 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.347093 25676 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:18:27.323820 25466 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:18:27.347952 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:27.319128 25371 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:27.349956 21151 leader_election.cc:336] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.591s (SENT)
I20260709 12:18:27.418803 21151 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.286720 25674 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:18:27.319381 25660 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.326205 25536 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:27.323693 25689 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.326906 25519 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:27.408550 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 86370.6us
W20260709 12:18:27.409790 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 72771.2us
W20260709 12:18:27.380424 25313 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:18:27.328783 25344 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:18:27.320720 25450 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.429221 21109 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:18:27.352317 25465 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:27.426613 25431 raft_consensus.cc:3055] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:27.450392 21111 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:27.435074 25519 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.413910 25571 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.470450 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:27.427383 25141 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 12:18:27.473832 25691 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:18:27.474869 25699 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:27.474188 25356 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 12:18:27.479526 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 153466us
W20260709 12:18:27.480152 21151 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.637s (SENT) [suppressed 43 similar messages]
I20260709 12:18:27.486979 25700 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:27.487466 25700 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:27.487884 25700 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:27.441336 25689 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.497087 25689 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.501258 21107 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:18:27.501593 21107 pending_rounds.cc:85] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 7
I20260709 12:18:27.501873 21742 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:27.503058 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:27.503726 25659 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:27.504206 25659 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:27.505007 25659 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.506640 21102 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:27.508985 21028 raft_consensus.cc:2410] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:18:27.501817 21107 pending_rounds.cc:107] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:18:27.509815 21107 raft_consensus.cc:2889] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:27.451308 25660 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:27.452251 25431 raft_consensus.cc:740] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:27.462733 25568 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:27.442994 25465 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.541853 25446 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.546916 25693 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:18:27.546499 25431 consensus_queue.cc:260] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.549023 25571 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.551009 25536 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.560432 25697 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:27.561614 25536 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.562274 21104 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 12:18:27.563905 25565 consensus_meta.cc:287] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.000s
I20260709 12:18:27.564334 25565 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.565953 21035 raft_consensus.cc:2368] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:27.566287 25565 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.567448 25450 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:27.466566 25684 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.542451 25660 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.568564 25431 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.578073 25700 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.555409 25672 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.590723 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:27.588680 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 144265us
W20260709 12:18:27.592638 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 112499us
I20260709 12:18:27.556667 25446 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:27.617703 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.593673 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:27.639307 21151 leader_election.cc:336] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.688s (SENT)
I20260709 12:18:27.639791 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.588399 25672 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:27.643133 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 291848us
W20260709 12:18:27.645920 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.647127 21076 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:27.663002 25711 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:27.663687 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:27.663973 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.653368 25444 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:27.664538 21742 raft_consensus.cc:2410] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:18:27.652669 25511 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:27.664510 21029 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:27.643086 25519 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.672189 25660 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.673621 25322 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.661352 25588 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:27.678110 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.678704 21027 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.687711 21186 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:27.689409 25565 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:27.689697 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.689952 25565 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.690665 25697 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:27.669200 25705 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.693459 21031 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:27.695036 21029 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:18:27.698961 21151 leader_election.cc:336] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.703s (SENT)
I20260709 12:18:27.699321 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:27.700028 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:27.677645 25588 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:27.703397 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.706944 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:27.708249 21742 raft_consensus.cc:2368] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:27.675511 25511 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.710927 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:27.712889 21107 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:27.697208 25593 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:27.713929 25444 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:27.714154 25565 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.714641 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:27.711561 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.701814 25588 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.716671 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.719726 21107 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:27.720968 21029 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:27.722012 20999 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:27.696599 25680 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:18:27.701316 25697 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:18:27.707312 25700 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.724890 21031 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:27.724411 21075 leader_election.cc:400] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:27.696201 25705 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.706624 25465 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.736197 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:27.736645 21075 leader_election.cc:403] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:18:27.725083 25640 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 1.284s	user 0.005s	sys 0.000s
I20260709 12:18:27.739462 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.744632 25680 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:27.744874 25698 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:27.745160 25680 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:27.745610 25698 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:27.745990 25680 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.746428 25698 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.737879 25674 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:27.705333 25704 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:18:27.751448 25698 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.753261 25672 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:27.759531 21184 raft_consensus.cc:1240] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:18:27.720526 25659 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 12:18:27.760376 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 61442.8us
W20260709 12:18:27.765870 25703 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:18:27.748564 25593 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:27.777518 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:27.778091 21184 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:27.780426 25707 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:18:27.781920 25573 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:27.786736 21184 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:27.760227 25446 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:27.792968 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 627) took 1296 ms. Trace:
I20260709 12:18:27.799196 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:27.799810 21184 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:27.749989 25371 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.797458 21110 rpcz_store.cc:276] 0709 12:18:26.496573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.530033 (+ 33460us) service_pool.cc:224] Handling call
0709 12:18:26.530311 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.629334 (+ 99023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.629373 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.655481 (+ 26108us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.762035 (+106554us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:26.790412 (+ 28377us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.810658 (+ 20246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.810739 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.318958 (+508219us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b1800402400. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a7522 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:18:27.791200 (+472242us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b1800402400. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:18:27.792753 (+  1553us) raft_consensus.cc:1685] finished
0709 12:18:27.792774 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.792909 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54283,"prepare.queue_time_us":28282,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":67072,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":7368,"spinlock_wait_cycles":22086784,"thread_start_us":130517,"threads_started":2,"wal-append.queue_time_us":174485}
I20260709 12:18:27.811771 25511 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:27.804723 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 93956.3us
I20260709 12:18:27.815655 21711 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:27.816447 25511 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:27.816866 25511 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.817193 25511 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.820274 25482 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:27.820657 25482 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:27.821411 25482 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.822310 25482 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:27.825906 21184 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:27.828207 21034 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:18:27.828580 21034 pending_rounds.cc:85] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 7
I20260709 12:18:27.828787 21034 pending_rounds.cc:107] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:18:27.828989 21034 raft_consensus.cc:2889] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:27.816586 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.826689 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.832567 21028 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 14: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:27.824474 25511 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.779433 25653 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:27.892382 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.897687 21033 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 16.
I20260709 12:18:27.902942 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.903112 21036 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:27.895638 21151 leader_election.cc:336] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.880s (SENT)
I20260709 12:18:27.904433 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:27.905576 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:27.907608 21185 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:18:27.800678 25446 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.913313 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.916074 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:27.919973 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.924626 21747 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:27.925173 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:27.925662 21739 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:27.900844 25640 log.cc:927] Time spent T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:18:27.927819 21032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 577) took 1810 ms. Trace:
I20260709 12:18:27.928143 21032 rpcz_store.cc:276] 0709 12:18:26.117197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.118676 (+  1479us) service_pool.cc:224] Handling call
0709 12:18:26.118992 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.119364 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.119398 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.119891 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.279422 (+159531us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:26.279997 (+   575us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.280181 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.280249 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.660529 (+1380280us) spinlock_profiling.cc:243] Waited 9.92 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:27.927569 (+267040us) raft_consensus.cc:1685] finished
0709 12:18:27.927654 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.927766 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6329,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1496,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":24706,"spinlock_wait_cycles":22814080,"thread_start_us":159134,"threads_started":1,"wal-append.queue_time_us":284297}
I20260709 12:18:27.931524 25371 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:27.895483 25653 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:27.836580 25519 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:27.932196 21739 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:27.933393 21002 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.935042 25371 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:27.935531 25371 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:27.936324 25371 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:27.943776 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:27.944705 21150 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:27.947624 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:27.948493 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:27.952311 21030 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
W20260709 12:18:27.953665 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 122647us
I20260709 12:18:27.895287 25642 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:27.957811 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:27.956964 25486 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:27.963694 25486 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:27.963869 21151 leader_election.cc:336] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.903s (SENT)
I20260709 12:18:27.963989 25141 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:27.964866 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:27.895128 25678 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:27.943423 25674 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:27.971762 21033 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:27.973160 21033 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:27.895902 25686 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:18:27.986158 21108 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:27.955660 25519 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:27.964476 25486 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:27.968650 25441 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.965186 25684 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.966284 25141 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.956924 25565 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:18:28.014006 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:28.027104 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.028837 21034 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:28.029722 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.009729 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:27.987581 25715 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:27.953207 25446 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.995541 25344 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:28.002204 25708 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:28.039028 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 75215.8us
I20260709 12:18:27.968142 25642 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:27.987365 25678 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.041606 21034 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:28.001011 25519 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:28.051582 25700 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:28.052412 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.042891 25573 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:28.024451 25141 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:28.061228 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:28.074801 25718 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:18:28.067219 25573 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:28.083333 21035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1842) took 1258 ms (client timeout 1591 ms). Trace:
W20260709 12:18:28.083720 21035 rpcz_store.cc:269] 0709 12:18:26.825304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.825443 (+   139us) service_pool.cc:224] Handling call
0709 12:18:28.083124 (+1257681us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400081bd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:28.083253 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665610112}
I20260709 12:18:28.084257 25573 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:28.088546 25446 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:28.009091 25441 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:28.091781 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.093741 21179 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:28.103894 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:28.025652 25684 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.060230 25313 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:28.086620 25511 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.007992 25653 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.053395 25344 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.121663 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:28.140151 21742 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
W20260709 12:18:28.112604 21151 leader_election.cc:336] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 2.031s (SENT)
I20260709 12:18:28.078783 25705 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.068187 25461 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:18:28.095342 25700 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:28.057826 25708 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.147451 21184 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:28.115968 21027 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:28.197540 21033 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:18:28.303165 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 353975us
I20260709 12:18:28.314699 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:28.315420 21186 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:28.145232 25653 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:28.327149 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:28.331583 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 218991us
I20260709 12:18:28.139202 25439 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.178s
I20260709 12:18:28.146767 25446 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:28.344635 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.126443 25313 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.365459 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:28.336360 25687 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:18:28.337082 25699 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:28.328824 25465 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:28.352789 25467 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:28.353150 25583 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:28.353018 25705 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.321557 25700 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.408715 21076 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:28.413575 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:28.416319 21711 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:28.422799 21033 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:28.377254 25699 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:28.430953 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:28.361024 25446 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.308991 25519 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.437052 25632 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.437532 25632 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.450364 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:28.428087 25574 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:28.451300 21186 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:28.478269 25642 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:28.401193 25467 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.395771 25465 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:28.449347 25482 consensus_meta.cc:287] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.001s
I20260709 12:18:28.440971 25646 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.427811 25593 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 12:18:28.483654 25431 consensus_meta.cc:287] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.915s	user 0.011s	sys 0.000s
I20260709 12:18:28.414436 25583 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:28.512740 25712 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:18:28.533478 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 197388us
I20260709 12:18:28.534679 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:28.548458 21186 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:28.479353 25574 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:28.451614 25588 consensus_meta.cc:287] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.727s	user 0.003s	sys 0.006s
I20260709 12:18:28.424474 25705 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.483042 25678 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:28.533607 25441 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.525118 25684 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:28.554185 25719 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.497s	user 0.002s	sys 0.000s
I20260709 12:18:28.616427 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:28.631471 21186 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:28.635346 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:28.635919 21186 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:28.636704 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:28.637176 21186 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.535795 25646 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:28.640770 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 82908.8us
I20260709 12:18:28.555219 25574 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.641978 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:28.643800 21186 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
W20260709 12:18:28.559068 25695 log.cc:927] Time spent T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 1.120s	user 0.009s	sys 0.009s
I20260709 12:18:28.532805 25536 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 12:18:28.663910 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:28.664467 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.555763 25731 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.558462 24896 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.668205 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:28.565752 25344 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:28.673249 25461 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.674589 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:28.675213 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:28.641294 25441 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:28.685695 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:28.743690 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 187843us
I20260709 12:18:28.777169 21709 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:28.778210 21186 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.561131 25588 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:28.781143 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 139226us
I20260709 12:18:28.680414 25725 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:28.786206 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.683393 25678 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:28.804472 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 388191us
I20260709 12:18:28.559723 25699 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.670938 25731 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.827790 25467 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.777794 25441 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.828753 25731 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.829897 25441 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.830472 25344 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:28.831007 25344 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.832988 25344 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.688913 25461 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.833812 25583 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.834329 25583 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:28.807462 25728 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:28.837276 25698 consensus_meta.cc:287] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 1.076s	user 0.007s	sys 0.000s
I20260709 12:18:28.686525 25642 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:28.840098 25705 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:28.834748 25583 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.786448 25708 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.841161 25699 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:28.841832 25583 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.809103 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 2004) took 1098 ms. Trace:
I20260709 12:18:28.842993 21111 rpcz_store.cc:276] 0709 12:18:27.710218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.711318 (+  1100us) service_pool.cc:224] Handling call
0709 12:18:27.711591 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.759948 (+ 48357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.759974 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.763153 (+  3179us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.955234 (+192081us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:27.955280 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.087805 (+132525us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b5400137ed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:28.087848 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.384319 (+296471us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:28.808902 (+424583us) raft_consensus.cc:1685] finished
0709 12:18:28.808923 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.809045 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9266,"raft.queue_time_us":386,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3364,"spinlock_wait_cycles":120865280,"thread_start_us":149601,"threads_started":1,"wal-append.queue_time_us":198902}
W20260709 12:18:28.786819 25707 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:18:28.845252 25461 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.820066 25439 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.845945 25439 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.847139 21028 raft_consensus.cc:2410] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:18:28.820703 25724 log.cc:927] Time spent T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
W20260709 12:18:28.847862 25723 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.312s	user 0.000s	sys 0.000s
I20260709 12:18:28.823185 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:28.848744 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2743) took 1161 ms. Trace:
I20260709 12:18:28.848888 21032 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.823403 25588 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.849510 25588 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:28.849953 25588 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.849128 21030 rpcz_store.cc:276] 0709 12:18:27.687274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.958210 (+270936us) service_pool.cc:224] Handling call
0709 12:18:27.969458 (+ 11248us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:28.036229 (+ 66771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.036274 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:28.043607 (+  7333us) log.cc:844] Serialized 52 byte log entry
0709 12:18:28.147487 (+103880us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:28.147526 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.147590 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.848537 (+700947us) raft_consensus.cc:1685] finished
0709 12:18:28.848556 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.848684 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48103,"raft.queue_time_us":49584,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":14910,"thread_start_us":62371,"threads_started":1,"wal-append.queue_time_us":306932}
I20260709 12:18:28.851864 25588 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:28.812134 25313 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:28.683001 24896 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.853978 24896 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.683782 25734 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 12:18:28.825546 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:28.855557 21151 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:28.855778 25734 raft_consensus.cc:2764] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:18:28.856801 25439 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.808670 25725 raft_consensus.cc:697] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:28.857990 25725 consensus_queue.cc:237] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:28.859405 25733 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:18:28.818159 25511 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:28.850176 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:28.861207 25511 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.861955 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:28.862517 21177 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:28.863247 25511 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.823961 25678 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.863950 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.864526 21035 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:18:28.865042 25678 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:28.867039 25446 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:28.867800 25721 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.309s	user 0.000s	sys 0.000s
W20260709 12:18:28.867938 25486 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.859s	user 0.008s	sys 0.000s
I20260709 12:18:28.868345 25486 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.809013 25700 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.870386 25486 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.871431 25511 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.871855 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2738) took 1191 ms. Trace:
I20260709 12:18:28.871910 25511 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.872421 21036 rpcz_store.cc:276] 0709 12:18:27.680875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.680988 (+   113us) service_pool.cc:224] Handling call
0709 12:18:27.681233 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.903587 (+222354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.871632 (+968045us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54000c62d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:28.871800 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509887872}
I20260709 12:18:28.871825 21177 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:28.875689 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.876281 21036 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:28.876742 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:28.876899 25511 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:28.879024 21151 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:28.877822 25697 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:18:28.880760 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 329358us
W20260709 12:18:28.887027 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:28.891498 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:28.892004 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.815387 21186 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:28.890692 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:28.895169 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:28.898168 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 482835us
I20260709 12:18:28.893923 25678 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:28.905339 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:28.906186 21107 raft_consensus.cc:2410] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 12:18:28.889961 25141 consensus_meta.cc:287] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.001s
I20260709 12:18:28.911181 21106 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:28.881769 25446 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.918009 21712 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:28.923369 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:28.881594 25738 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.924106 21186 raft_consensus.cc:2393] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:28.917352 21076 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:28.922503 21032 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:28.923697 25740 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.928157 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:28.928313 25740 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.928764 21102 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:28.905030 25313 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.936705 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:28.918244 25344 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:28.910524 25739 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:28.941367 21151 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:28.944885 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:28.946756 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.924880 25734 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:28.949420 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:28.952612 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:28.957373 21036 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.958271 21102 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 15.
I20260709 12:18:28.953718 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.959005 21027 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:28.954568 25632 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:28.955149 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.964428 21032 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:28.930259 25740 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.927353 25678 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:28.960156 21151 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:28.961135 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:28.969883 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:28.970232 21102 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:28.959314 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:28.936523 25725 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:28.923056 25141 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:28.961130 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.971930 21030 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:28.972036 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.955529 25344 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.976133 25725 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:28.979094 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.979691 21032 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:28.955906 25465 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:28.940716 25737 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:28.986202 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:28.989785 21179 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:28.986361 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.986809 21036 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:28.931756 25738 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:28.943101 25642 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:18:28.938069 25744 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:18:29.002710 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.967656 25734 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.002564 25653 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:28.971486 25583 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.040720 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:29.041388 21183 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:29.003180 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:28.988227 25588 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:28.990831 25467 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:29.006567 25344 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:28.998389 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.044896 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:29.013752 21030 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:29.000733 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:28.977813 25730 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:28.978624 25659 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.020903 21179 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 15.
I20260709 12:18:29.015363 21032 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:28.986778 25446 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:29.043327 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:29.046998 21027 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:28.956429 25739 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.063205 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:29.052187 20999 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:29.063787 21030 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:29.064440 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.048794 21036 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:29.066262 25749 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:29.066699 25749 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.067039 25749 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:28.974449 25678 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.072755 25678 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:29.076368 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.076959 21102 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:29.078792 21102 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:18:29.047695 25750 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:18:29.046535 25714 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:29.040066 25583 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.075162 25735 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:18:29.108819 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.116525 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 71699us
I20260709 12:18:29.117296 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:29.091172 25141 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.043233 25653 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.091238 25730 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 15 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:29.094061 25700 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.127677 25700 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.129588 25700 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.130466 25728 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:29.120196 25439 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:18:29.132282 25653 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:29.133662 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:29.133891 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:29.134250 21031 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:29.135196 25446 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:29.135844 25446 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:29.091357 25643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.010s	sys 0.036s
I20260709 12:18:29.137235 25446 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:29.115720 25715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.021s	sys 0.017s
W20260709 12:18:29.137930 25715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.021s	sys 0.017s
I20260709 12:18:29.138168 25715 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:29.050516 25725 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.123085 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.124981 25730 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.139010 25715 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.139905 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.140486 21102 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:29.127183 25583 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:29.137578 25643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.010s	sys 0.036s
I20260709 12:18:29.047819 25588 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.048300 25467 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.074337 25659 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.158211 21030 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:29.161290 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.163808 21102 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:29.171159 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.134121 25749 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.172240 25467 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:29.174747 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 118961us
I20260709 12:18:29.175447 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:29.176012 21030 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:29.179605 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.180155 21742 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
W20260709 12:18:29.181423 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 44833.5us
I20260709 12:18:29.182591 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.184376 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.184485 25735 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:29.186071 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.184954 21102 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:29.164685 25313 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:29.208174 21739 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:29.164750 25519 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:29.172273 25588 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:29.115887 25574 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.181038 25678 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:29.247052 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.247689 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.193485 25467 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.255988 21102 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:29.257038 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:29.258824 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 225945us
I20260709 12:18:29.263836 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.264393 21102 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:29.287916 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.288805 21739 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:29.289811 21075 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:29.260129 25588 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:18:29.266870 25738 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:29.288401 25583 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.303583 25141 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:29.262604 25467 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:29.305337 25716 log.cc:927] Time spent T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 1.219s	user 0.012s	sys 0.028s
W20260709 12:18:29.317447 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 133785us
W20260709 12:18:29.318239 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.318698 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2755) took 1315 ms. Trace:
W20260709 12:18:29.306051 25758 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:18:29.308703 25754 log.cc:927] Time spent T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:18:29.309428 25756 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:18:29.297129 25749 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.299229 25653 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:29.319070 21033 rpcz_store.cc:276] 0709 12:18:28.003340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.314549 (+311209us) service_pool.cc:224] Handling call
0709 12:18:28.314817 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:28.423220 (+108403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.318485 (+895265us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540027ef54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:29.318650 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247862528}
I20260709 12:18:29.319994 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.321815 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.327234 25704 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.328783 25344 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.336762 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.314178 25141 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:29.355594 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.299528 25770 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:18:29.318307 25734 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:29.358887 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.393446 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.394131 21102 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 6.
I20260709 12:18:29.359810 25653 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.424779 21077 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:29.426694 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:29.316655 25583 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.429304 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:29.367797 25344 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.430467 25467 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.431913 25344 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.432575 25741 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:29.432950 25741 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:29.433275 25741 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:29.433807 25751 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
W20260709 12:18:29.435305 25764 log.cc:927] Time spent T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:18:29.435726 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2178) took 1709 ms. Trace:
I20260709 12:18:29.437045 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2174) took 1744 ms. Trace:
I20260709 12:18:29.436097 21178 rpcz_store.cc:276] 0709 12:18:27.725980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.737761 (+ 11781us) service_pool.cc:224] Handling call
0709 12:18:27.738087 (+   326us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:27.738474 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.738500 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:27.742858 (+  4358us) log.cc:844] Serialized 78 byte log entry
0709 12:18:27.954609 (+211751us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:27.954644 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.954705 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.451788 (+497083us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b480024da58. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f 00007fcba49abf37 00007fcba49c055c 00007fcba49c0508 00007fcba49c0488 00007fcba49c0443 00007fcba49bf6ec 00007fcba38e9a96
0709 12:18:29.271997 (+820209us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:29.435527 (+163530us) raft_consensus.cc:1685] finished
0709 12:18:29.435549 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.435675 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":546,"raft.run_cpu_time_us":9991,"raft.run_wall_time_us":739618,"spinlock_wait_cycles":26870912,"thread_start_us":210024,"threads_started":1,"wal-append.queue_time_us":292696}
I20260709 12:18:29.437393 21182 rpcz_store.cc:276] 0709 12:18:27.692281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.692406 (+   125us) service_pool.cc:224] Handling call
0709 12:18:27.698469 (+  6063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.710021 (+ 11552us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:28.951547 (+1241526us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b18001a8d20. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c889e07 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a4455 00007fcba338c3c7 00007fcb9f99e9a7 00007fcb9f9a75e5 00007fcb9f9a7568
0709 12:18:29.065687 (+114140us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.142457 (+ 76770us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.159353 (+ 16896us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.159485 (+   132us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:29.161933 (+  2448us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.162597 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.162661 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.436863 (+274202us) raft_consensus.cc:1685] finished
0709 12:18:29.436887 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.436994 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4417,"prepare.queue_time_us":376330,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":4190,"raft.queue_time_us":29224,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":11739,"spinlock_wait_cycles":10076416,"thread_start_us":190476,"threads_started":2,"wal-append.queue_time_us":183049}
I20260709 12:18:29.443498 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2630) took 1095 ms. Trace:
I20260709 12:18:29.443841 21179 rpcz_store.cc:276] 0709 12:18:28.348310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.048346 (+700036us) service_pool.cc:224] Handling call
0709 12:18:29.076731 (+ 28385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.093103 (+ 16372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.093137 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.120559 (+ 27422us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.269254 (+148695us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:29.290114 (+ 20860us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.421453 (+131339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.421844 (+   391us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.443317 (+ 21473us) raft_consensus.cc:1685] finished
0709 12:18:29.443337 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.443445 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18258,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":8025,"raft.queue_time_us":86717,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":15733,"thread_start_us":216634,"threads_started":2,"wal-append.queue_time_us":254498}
I20260709 12:18:29.446055 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 688) took 1021 ms. Trace:
I20260709 12:18:29.446364 21179 rpcz_store.cc:276] 0709 12:18:28.424923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.445352 (+1020429us) service_pool.cc:224] Handling call
0709 12:18:29.445632 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.445791 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.445815 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.445852 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:29.445880 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.445924 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.446009 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:29.437975 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:29.450536 21178 raft_consensus.cc:2376] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12. Re-sending same reply.
I20260709 12:18:29.367390 25588 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:18:29.422875 25653 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:29.506817 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 77595.1us
I20260709 12:18:29.420212 25714 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:18:29.304059 25735 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:29.505147 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 54138.1us
I20260709 12:18:29.540354 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2175) took 1847 ms. Trace:
I20260709 12:18:29.539291 25777 consensus_queue.cc:1059] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:29.507637 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:29.508265 25706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.377s	user 0.008s	sys 0.007s
I20260709 12:18:29.365334 25704 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.545047 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 689) took 1097 ms. Trace:
I20260709 12:18:29.537904 25740 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:29.553406 21178 rpcz_store.cc:276] 0709 12:18:28.447757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.538224 (+1090467us) service_pool.cc:224] Handling call
0709 12:18:29.544732 (+  6508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.544854 (+   122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.544868 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.544892 (+    24us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:29.544910 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.544941 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.545006 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:29.537541 25739 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.552218 21185 rpcz_store.cc:276] 0709 12:18:27.693863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.693981 (+   118us) service_pool.cc:224] Handling call
0709 12:18:27.701083 (+  7102us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.908071 (+206988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.540114 (+1632043us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54000be0d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:29.540298 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474342656}
I20260709 12:18:29.549966 25574 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:29.554566 25706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.507s	user 0.009s	sys 0.008s
I20260709 12:18:29.563656 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 690) took 1036 ms. Trace:
W20260709 12:18:29.564340 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 56783.2us
I20260709 12:18:29.553098 25725 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:29.552528 25450 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:29.597056 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.602414 21178 rpcz_store.cc:276] 0709 12:18:28.527383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.556374 (+1028991us) service_pool.cc:224] Handling call
0709 12:18:29.563174 (+  6800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.563359 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.563384 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.563423 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:29.563459 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.563506 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.563601 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:29.551091 25778 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.177s
I20260709 12:18:29.568143 25777 raft_consensus.cc:3055] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:29.620184 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2636) took 1190 ms. Trace:
I20260709 12:18:29.579859 25740 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:29.654899 25776 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:18:29.840711 25653 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.930050 25653 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:29.930233 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:29.801136 25779 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:18:29.887799 25676 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:29.804046 25704 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.626830 25777 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:29.932883 25741 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.824985 25141 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.887979 25439 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.875201 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:29.935039 25741 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.933813 25777 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.934791 25439 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.875882 25786 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:18:29.692377 25773 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
W20260709 12:18:29.685359 25772 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:18:29.839538 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:29.697079 25769 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 12:18:29.839165 21742 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:18:29.936861 25728 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:29.889958 25781 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.626933 21179 rpcz_store.cc:276] 0709 12:18:28.430322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.450042 (+1019720us) service_pool.cc:224] Handling call
0709 12:18:29.450302 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.450478 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:29.505138 (+ 54660us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.619824 (+114686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.619880 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:29.619928 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.619997 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.620125 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":589,"prepare.queue_time_us":55821,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":1524,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2327,"thread_start_us":114294,"threads_started":1,"wal-append.queue_time_us":183191}
I20260709 12:18:29.885673 25642 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.836212 21035 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:29.798542 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:29.989331 21184 raft_consensus.cc:2376] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12. Re-sending same reply.
W20260709 12:18:29.989924 21184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 685) took 1667 ms (client timeout 1502 ms). Trace:
W20260709 12:18:29.990279 21184 rpcz_store.cc:269] 0709 12:18:28.322611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.322817 (+   206us) service_pool.cc:224] Handling call
0709 12:18:29.798394 (+1475577us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba495a0a0 00007fcba4959984 00007fcb9ded46d4 00007fcb9ded4662
0709 12:18:29.989812 (+191418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23314304}
I20260709 12:18:29.989364 21711 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:29.941375 25141 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:29.931409 25676 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:29.905368 21746 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:29.855988 21739 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:18:29.946905 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 520239us
I20260709 12:18:29.996085 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:29.788880 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2634) took 1391 ms. Trace:
I20260709 12:18:29.965047 25565 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.965131 25715 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:29.997167 21149 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:29.778719 25680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.955s	user 0.000s	sys 0.046s
W20260709 12:18:29.688040 25782 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:18:29.769466 25674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.720s	user 0.023s	sys 0.019s
I20260709 12:18:29.623582 25725 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:29.813001 25784 log.cc:927] Time spent T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:18:29.967125 25583 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:29.968192 25659 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.975140 25771 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.977437 25780 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.355s	user 0.000s	sys 0.000s
W20260709 12:18:29.978411 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.847581 21033 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:29.965893 25646 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:29.991503 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:28.076916 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:30.001046 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:29.999219 21182 rpcz_store.cc:276] 0709 12:18:28.397329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.439191 (+1041862us) service_pool.cc:224] Handling call
0709 12:18:29.439503 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.542341 (+102838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.542376 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.544333 (+  1957us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.752239 (+207906us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:29.752280 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.752348 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.788651 (+ 36303us) raft_consensus.cc:1685] finished
0709 12:18:29.788672 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.788819 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66167,"raft.queue_time_us":116038,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":2926,"thread_start_us":130571,"threads_started":1,"wal-append.queue_time_us":225270}
I20260709 12:18:29.964016 25786 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:30.004053 25674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.955s	user 0.028s	sys 0.020s
I20260709 12:18:30.001652 25486 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:30.036285 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:30.036993 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:29.998385 25565 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.007619 25439 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.003023 25715 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.009729 21180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2623) took 1668 ms. Trace:
I20260709 12:18:30.043457 21180 rpcz_store.cc:276] 0709 12:18:28.341743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.341884 (+   141us) service_pool.cc:224] Handling call
0709 12:18:29.011034 (+669150us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:18:29.011230 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.011584 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.011611 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.012041 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.179845 (+167804us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:29.179882 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.179946 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.009463 (+829517us) raft_consensus.cc:1685] finished
0709 12:18:30.009485 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.009673 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1274,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3810,"spinlock_wait_cycles":27776768,"thread_start_us":166948,"threads_started":1,"wal-append.queue_time_us":289294}
I20260709 12:18:30.045199 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:29.982095 25653 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:30.011364 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2191) took 1327 ms. Trace:
I20260709 12:18:29.997215 25728 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.997540 25777 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:29.999990 25680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.185s	user 0.000s	sys 0.053s
I20260709 12:18:30.012171 21711 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:30.028436 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.029552 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.003510 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:30.031724 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:30.074940 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 62845.7us
I20260709 12:18:30.039230 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.039836 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.040362 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2192) took 1354 ms. Trace:
I20260709 12:18:29.998898 25642 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:29.999104 25781 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.036278 25486 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:30.011714 25791 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:30.047976 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.080863 21182 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:30.047204 21178 rpcz_store.cc:276] 0709 12:18:28.683751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.623399 (+939648us) service_pool.cc:224] Handling call
0709 12:18:29.627953 (+  4554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.729491 (+101538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.740093 (+ 10602us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.784274 (+ 44181us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.982553 (+198279us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:29.982590 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.982650 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.011154 (+ 28504us) raft_consensus.cc:1685] finished
0709 12:18:30.011190 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.011313 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20626,"raft.queue_time_us":63074,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":23806,"thread_start_us":195065,"threads_started":1,"wal-append.queue_time_us":217502}
I20260709 12:18:30.048522 25653 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.049938 25715 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.055003 21180 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:30.057140 25786 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.030684 25771 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.025523 25778 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:18:30.059283 25728 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.064666 25565 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.065786 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.031983 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.076094 21106 raft_consensus.cc:2410] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:18:30.075851 21185 rpcz_store.cc:276] 0709 12:18:28.686441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.624707 (+938266us) service_pool.cc:224] Handling call
0709 12:18:29.635813 (+ 11106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.636020 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:29.690968 (+ 54948us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.040049 (+349081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:30.040098 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:30.040144 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.040201 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.040307 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55116,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":78,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":4917,"thread_start_us":348706,"threads_started":1}
I20260709 12:18:30.036599 25583 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:30.078657 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 75209.1us
I20260709 12:18:30.088866 21107 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:30.080427 25791 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.080300 25511 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.093971 25511 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.094336 25511 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.086272 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.094987 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2757) took 2032 ms. Trace:
I20260709 12:18:30.095590 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.096175 21180 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:30.096240 25771 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.096935 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.097596 21181 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:30.097892 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.098227 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2624) took 1755 ms. Trace:
I20260709 12:18:30.100922 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:30.092691 25781 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.087872 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.103773 21182 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:30.089599 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:30.105048 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:30.105202 21149 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.090157 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.083288 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:30.080323 25486 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:30.110157 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.110769 21186 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:18:30.111979 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:30.112485 21186 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.080720 25322 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:30.091686 25791 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.120054 21186 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:30.092151 25676 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.092729 25653 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.121582 21712 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:30.093586 25642 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:30.106621 21103 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.108980 25781 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:30.109185 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.103932 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.121973 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.116645 21149 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:30.118543 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:30.130311 21186 raft_consensus.cc:2376] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12. Re-sending same reply.
I20260709 12:18:30.124595 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.098587 21181 rpcz_store.cc:276] 0709 12:18:28.342563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.342703 (+   140us) service_pool.cc:224] Handling call
0709 12:18:30.085530 (+1742827us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b58001d2e98. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c86fb71 00007fcb9c86fa22 00007fcba57888d9 00007fcba48e2ee0 00007fcba49ac0ab 00007fcba49ac131 00007fcba496dfc0 00007fcba4958929 00007fcba49583d2 00007fcb9decfbd4
0709 12:18:30.085701 (+   171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:30.097371 (+ 11670us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b54001e71a0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f90bdc0 00007fcb9f9961c0 00007fcb9f997231 00007fcb9f993d8f 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c
0709 12:18:30.097981 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.098172 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49734784}
I20260709 12:18:30.132009 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.130951 21179 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.132262 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.095332 21034 rpcz_store.cc:276] 0709 12:18:28.062311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.326545 (+264234us) service_pool.cc:224] Handling call
0709 12:18:28.327813 (+  1268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:28.434338 (+106525us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:28.513036 (+ 78698us) log.cc:844] Serialized 14 byte log entry
0709 12:18:28.940737 (+427701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:28.940787 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:28.940829 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.094770 (+1153941us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003d40d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:30.094826 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.094937 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":509,"prepare.queue_time_us":56279,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":4462,"raft.queue_time_us":108,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":7968,"spinlock_wait_cycles":244453632,"thread_start_us":427390,"threads_started":1,"wal-append.queue_time_us":467791,"wal-append.run_cpu_time_us":999,"wal-append.run_wall_time_us":1014939}
I20260709 12:18:30.134331 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.135138 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.135260 21149 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.136039 21181 raft_consensus.cc:2410] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:18:30.119887 25771 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.136176 21149 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:30.137140 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.137826 21185 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:30.139874 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.138521 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:30.143476 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.154454 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.156020 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.186139 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.193771 21179 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:30.195195 25786 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:30.196902 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:30.198351 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 62211.5us
I20260709 12:18:30.200918 21179 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:30.202217 21179 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:30.128829 25781 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:30.136472 25574 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.203662 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:30.104118 25583 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.139410 25322 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.139029 25642 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:30.137400 25728 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:30.186044 25778 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.139233 25771 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.208827 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.211921 21178 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:30.219347 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.206730 25781 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:30.223938 21034 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:30.222271 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.221215 21107 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:30.206681 25749 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:30.212937 25642 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:30.226588 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.213475 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:30.231164 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.211350 25322 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.231794 21109 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 12: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:30.234139 21033 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:30.235432 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.212796 25728 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:30.219214 25734 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:30.241106 21033 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:18:30.219424 25699 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.221594 25771 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.222299 25778 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.244557 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.259966 21027 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:30.257961 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.260808 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.246162 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.261161 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.261650 21036 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:30.262156 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.221596 25442 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.251793 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:30.253305 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.211565 25574 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.230177 25486 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.256767 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.257987 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.258628 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.219828 25735 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:30.219615 25565 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:30.308763 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.242960 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.309880 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.310773 21103 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:30.263775 21027 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:30.269802 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.312062 21031 raft_consensus.cc:2410] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:30.237528 25642 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.257145 25728 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.251228 25646 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.276283 25741 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:30.283105 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2627) took 1939 ms. Trace:
W20260709 12:18:30.288307 25794 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:18:30.292073 21028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1884) took 2598 ms (client timeout 2144 ms). Trace:
I20260709 12:18:30.300027 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:30.302371 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 45681.1us
I20260709 12:18:30.302862 21032 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:18:30.303040 21033 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
W20260709 12:18:30.337927 21028 rpcz_store.cc:269] 0709 12:18:27.693505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.902678 (+209173us) service_pool.cc:224] Handling call
0709 12:18:30.291844 (+2389166us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b540004b354. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:30.291981 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2168558336}
W20260709 12:18:30.299938 25789 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:18:30.314693 21030 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:18:30.239517 25322 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.307981 25725 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.319967 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.310878 25439 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:30.260108 25734 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:30.266969 25778 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.333727 21106 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:30.350730 25486 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.351470 25511 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.353439 25511 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.342795 21027 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:18:30.335558 21177 rpcz_store.cc:276] 0709 12:18:28.343471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.874290 (+530819us) service_pool.cc:224] Handling call
0709 12:18:28.874572 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.878410 (+  3838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.878473 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.892462 (+ 13989us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.014283 (+121821us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:29.158861 (+144578us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.162364 (+  3503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.162454 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.433549 (+271095us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18003c2c20. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:18:30.278898 (+845349us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b24001ef008. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c72d9c4 00007fcb9c72bacb 00007fcb9c8e6dc9 00007fcb9c8e6a55 00007fcb9c8e5fb0 00007fcb9f55c488 00007fcb9f55cbe8 00007fcb9f534398 00007fcb9f52f76a 00007fcb9f52ebb6
0709 12:18:30.282902 (+  4004us) raft_consensus.cc:1685] finished
0709 12:18:30.282922 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.283049 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2360,"prepare.queue_time_us":112821,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":14081,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5334,"spinlock_wait_cycles":135940992,"thread_start_us":231830,"threads_started":2,"wal-append.queue_time_us":229385}
I20260709 12:18:30.338181 21032 pending_rounds.cc:85] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 6
I20260709 12:18:30.356397 21032 pending_rounds.cc:107] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:18:30.356639 21032 raft_consensus.cc:2889] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:30.237401 25749 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.338862 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.345124 21178 raft_consensus.cc:2410] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:18:30.356710 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.357988 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.359756 21184 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:30.345589 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2631) took 1981 ms. Trace:
I20260709 12:18:30.310586 25442 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:30.360610 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 279039us
I20260709 12:18:30.320367 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:30.350083 25734 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.301684 25699 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.363832 20999 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.318164 25565 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.367179 25486 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:30.368609 25565 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.368965 25674 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.369320 25674 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.369634 25674 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.370082 25574 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.368760 21034 raft_consensus.cc:2410] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:18:30.376147 25749 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.376531 25674 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.376858 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.378013 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.378446 25674 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.383289 25583 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:30.385192 25699 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:30.338505 25646 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.387224 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 2009) took 1976 ms. Trace:
I20260709 12:18:30.387640 21104 rpcz_store.cc:276] 0709 12:18:28.410555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.411890 (+  1335us) service_pool.cc:224] Handling call
0709 12:18:28.412156 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.896814 (+484658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.896846 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.869302 (+972456us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b2c0005c228. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:18:29.873171 (+  3869us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.138960 (+265789us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:30.138997 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.139061 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.386913 (+247852us) raft_consensus.cc:1685] finished
0709 12:18:30.386935 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.387163 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12330,"raft.queue_time_us":73222,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":44018,"spinlock_wait_cycles":9072000,"thread_start_us":684888,"threads_started":2,"wal-append.queue_time_us":417951}
I20260709 12:18:30.389039 25442 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.345971 25439 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.389973 25439 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:30.317731 25735 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.391688 25735 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:30.392560 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:30.395159 25511 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:30.395175 25778 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.397488 21179 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:30.397624 25778 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.400079 25322 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.374164 25791 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:30.427037 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 63278.5us
W20260709 12:18:30.422611 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 72804.4us
I20260709 12:18:30.444185 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:30.448726 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:30.448964 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.449388 21103 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.450058 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.451570 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.452169 21107 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:30.403947 21178 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:30.423084 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:30.449611 21109 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 16.
I20260709 12:18:30.360965 21183 rpcz_store.cc:276] 0709 12:18:28.364488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.301064 (+936576us) service_pool.cc:224] Handling call
0709 12:18:29.301344 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.551562 (+250218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.551588 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.826031 (+274443us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b2c00061b88. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:18:29.826441 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.187423 (+360982us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:30.187462 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.187530 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.313223 (+125693us) raft_consensus.cc:1685] finished
0709 12:18:30.313243 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.345527 (+ 32284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14966,"raft.queue_time_us":63326,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":2236,"spinlock_wait_cycles":7968640,"thread_start_us":602193,"threads_started":2,"wal-append.queue_time_us":424493}
W20260709 12:18:30.462459 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.463778 21103 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:30.465332 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.465574 21741 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:18:30.387241 25646 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:30.467568 21108 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:30.481477 21177 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:30.422173 25741 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:30.518909 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.519951 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.454135 25371 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:30.424311 25583 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:30.520001 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.522449 21033 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:30.522897 21182 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:30.523018 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:30.525473 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.526175 21032 raft_consensus.cc:2368] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13.
I20260709 12:18:30.527803 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:30.460201 25659 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:30.528487 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.532266 21027 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:30.515365 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.533555 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:30.534822 21030 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.539127 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.542474 21030 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:30.404250 25781 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.547941 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:30.548223 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 426694us
I20260709 12:18:30.548840 21178 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 12: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:18:30.550943 21151 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.006s	sys 0.060s
W20260709 12:18:30.551282 21151 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.006s	sys 0.060s
W20260709 12:18:30.551528 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 579727us
I20260709 12:18:30.560060 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:30.458274 25141 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:18:30.561305 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:30.564404 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.567241 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:30.568940 21178 raft_consensus.cc:2393] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 6: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:30.572641 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.582585 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.583748 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.533500 25704 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:30.578315 25565 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:30.527824 25741 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.606696 25777 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:30.612185 25511 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:18:30.623776 25777 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.602051 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.625924 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:30.626268 25777 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.601357 21027 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:18:30.627174 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.628307 21030 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:30.629971 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:30.629719 21183 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:30.634603 21030 raft_consensus.cc:2410] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 13 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:30.530678 25583 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:30.663800 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 56889.2us
I20260709 12:18:30.666364 25511 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:18:30.675099 25781 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:30.687495 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 696) took 1422 ms. Trace:
I20260709 12:18:30.687870 21181 rpcz_store.cc:276] 0709 12:18:29.264766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.189370 (+924604us) service_pool.cc:224] Handling call
0709 12:18:30.189704 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:30.195129 (+  5425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.195160 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:30.195587 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.422072 (+226485us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:30.422112 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.422172 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.687316 (+265144us) raft_consensus.cc:1685] finished
0709 12:18:30.687334 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.687445 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6211,"raft.queue_time_us":5952,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":226131,"threads_started":1,"wal-append.queue_time_us":409707}
I20260709 12:18:30.689438 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.692660 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.693367 21181 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:30.694264 25781 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:30.714728 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 49788.7us
W20260709 12:18:30.717710 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.722786 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:30.725724 21178 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:30.734759 21109 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:18:30.725371 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 280092us
I20260709 12:18:30.736868 21103 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:18:30.737229 21103 pending_rounds.cc:85] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 11
I20260709 12:18:30.737427 21103 pending_rounds.cc:107] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:18:30.737628 21103 raft_consensus.cc:2889] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:30.713666 25781 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.737689 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.741833 21103 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:18:30.745000 21036 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:30.750725 21108 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:30.761531 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 199449us
I20260709 12:18:30.762075 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:30.766664 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 243021us
I20260709 12:18:30.762199 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.726013 25771 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.740154 25322 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.775851 20999 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.782860 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.729326 25642 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.729939 25806 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:18:30.738796 25439 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:30.792574 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:30.793147 21110 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.790449 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.790707 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.790993 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:30.794417 21109 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:30.792011 21102 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.779193 25676 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.796427 21186 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:30.808387 21184 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:30.814468 21102 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:18:30.797940 25704 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:30.794723 20928 catalog_manager.cc:5697] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 5 to 6, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 6 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:30.815826 25781 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.779424 25371 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:30.785197 25699 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:30.800040 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.831285 25704 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.833602 25728 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:30.840270 25823 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:30.840642 25439 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:30.896046 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 100870us
I20260709 12:18:30.898351 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:30.902258 21110 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:30.906450 25830 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:30.798344 25676 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.118142 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.121651 21106 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:31.052726 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2648) took 1147 ms. Trace:
I20260709 12:18:31.078336 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:31.122816 21182 rpcz_store.cc:276] 0709 12:18:29.905735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.104372 (+198637us) service_pool.cc:224] Handling call
0709 12:18:31.052507 (+948135us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400020654. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:31.052662 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779032448}
I20260709 12:18:31.120787 21180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2639) took 1217 ms. Trace:
W20260709 12:18:30.988494 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 252908us
W20260709 12:18:31.125257 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 338145us
I20260709 12:18:31.125398 21076 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.124874 21180 rpcz_store.cc:276] 0709 12:18:29.903776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.199801 (+296025us) service_pool.cc:224] Handling call
0709 12:18:30.200100 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:30.208061 (+  7961us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:30.208108 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:30.209730 (+  1622us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.562488 (+352758us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:30.562529 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.562593 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.810835 (+248242us) raft_consensus.cc:1685] finished
0709 12:18:30.810868 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.120715 (+309847us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3681,"raft.queue_time_us":8644,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":9159,"thread_start_us":331544,"threads_started":1,"wal-append.queue_time_us":506454}
I20260709 12:18:31.126430 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:31.124892 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 597117us
I20260709 12:18:31.129712 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:31.004264 21151 leader_election.cc:336] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.637s (SENT)
W20260709 12:18:31.130604 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 126385us
W20260709 12:18:31.131692 21151 leader_election.cc:336] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.702s (SENT)
I20260709 12:18:31.123126 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:31.132702 21110 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:31.088346 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.128057 21711 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:31.123914 21105 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:31.170509 21151 leader_election.cc:336] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.753s (SENT)
I20260709 12:18:31.139720 21002 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:31.171073 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:30.906643 25826 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:30.912484 25821 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:18:30.912768 25819 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 12:18:31.175311 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 47341.5us
W20260709 12:18:30.964371 25811 log.cc:927] Time spent T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:18:30.895725 25699 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.133368 25771 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:30.903579 25653 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:30.896483 25704 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:30.964207 25749 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:31.099223 25822 raft_consensus.cc:3055] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:18:31.187961 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.050201 25827 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:30.964150 25829 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:31.123458 25583 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.133046 25676 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.155601 25439 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:31.133168 25741 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.125017 25830 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:31.155961 25823 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:31.187332 25726 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:18:31.204036 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:31.175647 25322 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:31.211807 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.895540 25734 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.179826 25806 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:31.233966 21105 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:31.291591 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1904) took 1043 ms. Trace:
I20260709 12:18:31.291491 21180 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:31.189467 25313 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.907542 25828 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:31.205395 25646 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:31.205052 25749 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:31.243891 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 104221us
I20260709 12:18:31.211477 25822 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:31.189034 25699 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.099604 25371 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.295233 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:31.312872 21110 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:31.186756 25826 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.241736 25583 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.292217 21031 rpcz_store.cc:276] 0709 12:18:30.248210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.319379 (+ 71169us) service_pool.cc:224] Handling call
0709 12:18:30.345071 (+ 25692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:30.355205 (+ 10134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.355235 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:30.355644 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.689737 (+334093us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:30.689776 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.689835 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.291362 (+601527us) raft_consensus.cc:1685] finished
0709 12:18:31.291381 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.291536 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9791,"raft.queue_time_us":14581,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":1883,"thread_start_us":292690,"threads_started":1,"wal-append.queue_time_us":420714}
I20260709 12:18:31.234606 25829 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:31.324429 21183 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:31.303998 21102 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:18:31.315237 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 188864us
I20260709 12:18:31.315577 25822 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.312275 21002 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:31.316960 21103 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:31.325891 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.305004 21109 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:31.291244 25823 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.320079 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:31.320590 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.212937 25653 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:31.325847 21151 leader_election.cc:336] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.935s (SENT)
I20260709 12:18:31.330169 21151 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:31.328306 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 149331us
I20260709 12:18:31.331225 21077 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.313844 25749 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.334303 21076 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.333482 21077 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.335147 21106 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:31.333987 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:31.337877 25851 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:31.338435 25837 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:31.338865 25837 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:31.339210 25824 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:18:31.340567 25653 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.341248 21108 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:31.341387 25734 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.341637 25850 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.318552 25806 raft_consensus.cc:697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:31.342271 25850 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.293185 25835 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:31.342589 25806 consensus_queue.cc:237] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.343053 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:31.342952 25835 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.338361 25851 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.344888 25835 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.345371 25781 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:31.345989 25781 consensus_queue.cc:1243] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:31.345589 25684 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.336503 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:31.237156 25827 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.351552 25827 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.354247 21102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81f567d6458f4dddaa94452e04485030"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:31.354787 21102 raft_consensus.cc:606] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:31.251711 25439 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.348645 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.332378 25841 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:31.332121 25771 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.334064 25646 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.347362 25822 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.339219 25837 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.357700 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 2199) took 1143 ms. Trace:
I20260709 12:18:31.335444 25728 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.306785 25322 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.330979 25823 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.379830 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:31.362192 21110 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:18:31.363652 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:31.360284 21000 connection.cc:256] RPC call timeout handler was delayed by -1.0815253250000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:18:31.364609 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:31.365137 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:31.370777 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:31.326650 25583 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.373275 21029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1905) took 1072 ms. Trace:
I20260709 12:18:31.346110 25851 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.381458 21033 raft_consensus.cc:2410] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:18:31.375499 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:31.378561 25781 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:31.385633 25781 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.385888 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:31.386096 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:31.376991 21179 rpcz_store.cc:276] 0709 12:18:30.214038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.299780 (+ 85742us) service_pool.cc:224] Handling call
0709 12:18:31.357505 (+1057725us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b540001a4d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:31.357640 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136104832}
I20260709 12:18:31.326594 25829 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:31.368737 25841 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:31.391002 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:31.391935 21035 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.370519 21076 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.382481 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:31.383203 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:31.382012 21034 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:31.373868 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:31.387666 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:31.394552 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:31.376339 25684 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:31.369954 25827 raft_consensus.cc:2764] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:18:31.380668 25771 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:31.353449 25313 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:18:31.401440 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 2027) took 1293 ms. Trace:
I20260709 12:18:31.384475 21029 rpcz_store.cc:276] 0709 12:18:30.300578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.318173 (+ 17595us) service_pool.cc:224] Handling call
0709 12:18:30.318464 (+   291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:30.337148 (+ 18684us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:30.355802 (+ 18654us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.727560 (+371758us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:30.740584 (+ 13024us) log.cc:844] Serialized 52 byte log entry
0709 12:18:30.740734 (+   150us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:30.740947 (+   213us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.741430 (+   483us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.742552 (+  1122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.742633 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.373087 (+630454us) raft_consensus.cc:1685] finished
0709 12:18:31.373105 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.373214 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4630,"prepare.queue_time_us":66456,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":93,"raft.queue_time_us":5304,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":8609,"thread_start_us":336563,"threads_started":1,"wal-append.queue_time_us":474343}
I20260709 12:18:31.396132 21179 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:31.404017 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:31.379076 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:31.396325 21034 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:31.397591 21103 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
W20260709 12:18:31.396317 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 78878.1us
I20260709 12:18:31.408385 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:31.395941 21077 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.402735 21111 rpcz_store.cc:276] 0709 12:18:30.108474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.115729 (+  7255us) service_pool.cc:224] Handling call
0709 12:18:30.122970 (+  7241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.123138 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:30.516577 (+393439us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.195880 (+679303us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.364131 (+168251us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.401145 (+ 37014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.401192 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:31.401234 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.401290 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.401387 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36802,"prepare.queue_time_us":260719,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":7802,"raft.queue_time_us":418411,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":24248,"thread_start_us":1171041,"threads_started":4,"wal-append.queue_time_us":447822}
I20260709 12:18:31.409046 21180 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:31.384578 25839 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:31.413473 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.414513 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:31.382463 25835 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:18:31.396210 25841 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.398891 25646 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.419770 21076 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.399493 25856 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:31.428411 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.429273 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.430414 21077 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:31.418903 25851 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:31.419459 25574 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:31.353107 25830 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.421546 25653 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:31.407464 25736 consensus_queue.cc:1059] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:18:31.407301 25684 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:31.450201 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 50077.6us
W20260709 12:18:31.450510 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 104880us
I20260709 12:18:31.435194 25827 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:31.424079 25839 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:31.410915 25771 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.407159 25805 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 12:18:31.460602 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 81601.9us
I20260709 12:18:31.454356 21035 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:31.429823 25828 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:31.435667 25741 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:31.423954 25848 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:31.448933 25851 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:31.437274 25826 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.427313 25646 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.434455 25840 raft_consensus.cc:2764] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:18:31.477707 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:31.450088 25574 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:31.480358 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 71999us
I20260709 12:18:31.437139 25726 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:18:31.480482 25741 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:31.468488 25781 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:31.496013 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 66821.8us
I20260709 12:18:31.478271 25643 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.492496 25771 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.435098 25856 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.492766 25791 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.490567 25839 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.475293 25141 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:31.484089 25851 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.482282 25830 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.480854 25848 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:31.475425 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 45092.8us
I20260709 12:18:31.495685 25574 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.507803 25684 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:31.498176 25860 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.527083 25322 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:31.486806 25729 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.527844 25729 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.530968 25729 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.512542 25439 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.483677 25857 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.532497 25857 raft_consensus.cc:993] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:31.532895 25857 raft_consensus.cc:1081] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:31.511415 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.535844 25583 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.516489 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.517946 25704 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:31.522404 25852 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:18:31.540084 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.494298 25827 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:31.544023 25827 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.545706 25704 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.498051 25741 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:31.541473 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 78199.1us
I20260709 12:18:31.541632 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:31.548066 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:31.548606 21177 raft_consensus.cc:606] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:31.534368 25699 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.551648 21077 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:31.553277 21077 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:31.510548 25141 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:31.557047 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 75872.9us
I20260709 12:18:31.560180 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:31.537031 25848 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:31.547442 25857 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:31.574502 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 63164.3us
I20260709 12:18:31.576092 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.580080 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.576995 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:31.586050 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:31.588886 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.589901 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.590831 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:31.591312 21102 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:31.593355 25854 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
I20260709 12:18:31.601627 25676 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.559511 25856 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.559650 25141 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.604617 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:31.613137 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 113779us
I20260709 12:18:31.615511 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:31.609103 21102 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 17.
I20260709 12:18:31.582118 25860 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:31.573421 25866 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.616972 21746 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:31.620453 21031 raft_consensus.cc:2368] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:31.604444 25704 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.621452 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.624708 21102 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:31.626825 21743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 639) took 1655 ms. Trace:
I20260709 12:18:31.627277 21743 rpcz_store.cc:276] 0709 12:18:29.964394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.964591 (+   197us) service_pool.cc:224] Handling call
0709 12:18:29.964892 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.058308 (+ 93416us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:18:30.210185 (+151877us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.525034 (+314849us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:30.525084 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:30.525133 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.620088 (+1094955us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b54001a63d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:31.620134 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.620259 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178633,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":4387,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":5777,"spinlock_wait_cycles":214306560,"thread_start_us":465546,"threads_started":2,"wal-append.queue_time_us":455399}
I20260709 12:18:31.635568 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:31.632320 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:31.640650 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.643131 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:31.652752 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:31.736893 21742 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.618013 25861 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:31.666218 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:31.738082 21743 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:31.611914 25322 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:18:31.671437 21741 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:18:31.632825 25860 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:31.616442 25859 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:18:31.774063 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:31.774567 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 163093us
I20260709 12:18:31.775149 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:31.773699 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:31.779896 21182 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.675290 25699 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.675318 25646 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.678335 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:31.611123 25828 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.678985 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:31.807206 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:31.669152 25874 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:31.669047 25866 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:31.669754 25837 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.670893 25704 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:31.739634 21102 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:31.763183 21186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 2204) took 1495 ms. Trace:
I20260709 12:18:31.764907 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.633272 25749 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.803831 21184 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:31.805261 25781 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:18:31.806998 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:31.807288 21149 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.808295 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:31.809788 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 252013us
I20260709 12:18:31.820273 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:31.820797 21102 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.816404 21186 rpcz_store.cc:276] 0709 12:18:30.267702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.319646 (+ 51944us) service_pool.cc:224] Handling call
0709 12:18:31.762995 (+1443349us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54002620d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:31.763129 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993812224}
I20260709 12:18:31.824899 21742 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
W20260709 12:18:31.811051 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 196377us
W20260709 12:18:31.816789 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 51980us
I20260709 12:18:31.827438 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:31.831045 21032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59998 (request call id 2785) took 1307 ms (client timeout 1614 ms). Trace:
W20260709 12:18:31.831459 21032 rpcz_store.cc:269] 0709 12:18:30.523835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.526687 (+  2852us) service_pool.cc:224] Handling call
0709 12:18:31.830858 (+1304171us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000c30d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:31.830988 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465974656}
I20260709 12:18:31.833534 21076 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:31.826530 21077 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:31.835600 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:31.837203 21077 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:31.835783 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:18:31.839180 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 211508us
I20260709 12:18:31.844868 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48236 (request call id 701) took 1295 ms. Trace:
I20260709 12:18:31.838966 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:31.813501 25866 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:31.846263 21178 rpcz_store.cc:276] 0709 12:18:30.549338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.572420 (+ 23082us) service_pool.cc:224] Handling call
0709 12:18:31.844705 (+1272285us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003fd754. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:31.844815 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341054848}
I20260709 12:18:31.852715 21182 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:31.853488 21102 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:31.812471 25857 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:31.856809 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:31.828485 25791 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:31.827085 25883 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:31.838033 25874 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.838285 25879 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.810640 25890 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:18:31.813036 25885 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:18:31.845615 25881 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.846711 25699 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:31.870013 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 51580.8us
I20260709 12:18:31.860406 25791 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.853633 25676 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.828446 25704 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.857780 25866 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.891099 21149 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.853821 25646 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:31.846939 25859 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:18:31.866777 25883 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:31.869886 25880 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.897632 25851 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.856740 25860 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.908607 25851 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:31.903153 25823 consensus_meta.cc:287] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.000s
I20260709 12:18:31.911087 25704 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.910976 25823 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.912003 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:31.912926 25823 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:31.913892 25832 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.573s	user 0.000s	sys 0.005s
I20260709 12:18:31.915071 21028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2782) took 1396 ms. Trace:
I20260709 12:18:31.898345 25886 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:31.916692 25890 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:31.915418 21028 rpcz_store.cc:276] 0709 12:18:30.519098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.520903 (+  1805us) service_pool.cc:224] Handling call
0709 12:18:30.521200 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:30.523068 (+  1868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.523096 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:30.531414 (+  8318us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.826169 (+294755us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:30.826204 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.826263 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.913361 (+1087098us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:31.914737 (+  1376us) raft_consensus.cc:1685] finished
0709 12:18:31.914785 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.915015 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1501,"raft.queue_time_us":5760,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":13465,"spinlock_wait_cycles":40149248,"thread_start_us":230413,"threads_started":1,"wal-append.queue_time_us":777990}
I20260709 12:18:31.917181 25890 raft_consensus.cc:697] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:31.918020 25890 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.918609 25653 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:31.900122 25885 consensus_queue.cc:1243] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:31.919085 25653 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.902446 25889 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.919638 25889 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:31.903113 25583 raft_consensus.cc:2764] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:18:31.921635 25889 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.923091 21105 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:18:31.896028 25791 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.892688 25699 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:31.906589 25822 consensus_meta.cc:287] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.529s	user 0.016s	sys 0.004s
I20260709 12:18:31.915217 25837 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.943814 21109 raft_consensus.cc:2410] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:18:31.904346 25883 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.933262 25699 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.931255 25704 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:31.932586 25889 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:31.959174 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 117785us
I20260709 12:18:31.905726 25646 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.904420 25741 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.963250 21106 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:31.966966 21747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53712 (request call id 11) took 1223 ms. Trace:
I20260709 12:18:31.967443 21747 rpcz_store.cc:276] 0709 12:18:30.743905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.744066 (+   161us) service_pool.cc:224] Handling call
0709 12:18:31.966668 (+1222602us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b54004bce20. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f911520 00007fcb9f99ab42 00007fcb9f999800 00007fcb9f9929fa 00007fcba495a4c9 00007fcb9ded6c54 00007fcb9ded6be2 00007fcb9ded6b11 00007fcb9ded6a8c 00007fcb9ded5d42
0709 12:18:31.966888 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86837120}
W20260709 12:18:31.969082 20919 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 40fd334874764b26ba28ac382c4199f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:18:31.969628 25642 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:31.931150 25841 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.983439 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:31.983717 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 92685.8us
W20260709 12:18:31.984649 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 145772us
I20260709 12:18:31.985481 21076 leader_election.cc:400] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13.
I20260709 12:18:31.986361 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:31.982040 25371 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:31.962486 25704 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.991947 21076 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:31.916019 25886 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:31.964181 25889 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.000555 25889 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:32.001199 25741 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.001931 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:31.960176 25574 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.004113 21076 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:31.994230 25882 raft_consensus.cc:2764] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:18:32.029973 21180 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:31.990639 25749 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.037802 21111 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 12: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
W20260709 12:18:32.038532 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 74171.3us
I20260709 12:18:31.945818 25857 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.022010 25741 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:32.023941 25646 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:31.994362 25371 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.046437 25684 raft_consensus.cc:993] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:32.057729 25883 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.059892 25883 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:32.024957 25141 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.039794 25841 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.128584 25653 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.134639 25653 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.136626 25864 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.136844 24896 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.137143 25864 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.137275 24896 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.139139 24896 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.132454 25791 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.143460 25791 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:32.131155 25371 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.145471 25864 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.151163 20928 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 9 to 10, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 10 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:32.152788 25699 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:32.146971 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.158396 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:32.158788 21104 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.159988 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.160791 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:32.146595 20933 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49682 (request call id 221) took 25961 ms (client timeout 15000 ms). Trace:
I20260709 12:18:32.190493 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:32.178786 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:32.191944 21029 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 6.
I20260709 12:18:32.171903 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:32.192824 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.194012 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.039927 25896 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:32.165935 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:32.164340 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:32.196364 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:32.222880 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.223106 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.224030 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:32.224119 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.230887 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:32.234100 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:32.129804 25891 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:18:32.194168 25699 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.235661 21104 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:32.247256 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:32.247684 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.248643 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:32.249823 21104 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:18:32.238058 25848 consensus_meta.cc:287] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.018s
I20260709 12:18:32.251626 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:32.251084 25848 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.253810 25848 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.235513 21034 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.152963 20928 catalog_manager.cc:5697] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 4 to 9, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 9 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:32.251762 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 604) took 1706 ms. Trace:
I20260709 12:18:32.257601 21076 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:32.253988 21103 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:32.239856 25847 log.cc:927] Time spent T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.900s	user 0.024s	sys 0.026s
I20260709 12:18:32.259793 21027 rpcz_store.cc:276] 0709 12:18:30.545196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.630961 (+ 85765us) service_pool.cc:224] Handling call
0709 12:18:30.633375 (+  2414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.666838 (+ 33463us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:31.041627 (+374789us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.254469 (+212842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.254520 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:31.254560 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.239330 (+984770us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:32.251559 (+ 12229us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b5400062cd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:32.251603 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.251703 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1976,"prepare.queue_time_us":2169,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":22,"raft.queue_time_us":82881,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":108003840,"thread_start_us":534209,"threads_started":2,"wal-append.queue_time_us":297988}
W20260709 12:18:32.331640 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 49575us
I20260709 12:18:32.333213 21076 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:32.336054 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.339345 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:32.339915 21742 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.348249 20999 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.202138 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.350477 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:32.351142 21739 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:32.353820 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:32.356355 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.359421 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.360373 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:32.366454 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 662) took 1030 ms. Trace:
I20260709 12:18:32.367020 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.367034 21109 rpcz_store.cc:276] 0709 12:18:31.335907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.336251 (+   344us) service_pool.cc:224] Handling call
0709 12:18:32.277043 (+940792us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54000f8f54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:32.366395 (+ 89352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359634816}
I20260709 12:18:32.368081 21035 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.267823 25858 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:32.370651 21742 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:32.371112 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.371789 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:32.375135 21029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81f567d6458f4dddaa94452e04485030"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:18:32.375759 21029 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.196914 25749 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:32.349953 25653 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:32.363001 25881 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.397189 20999 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:32.400406 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:32.401018 21027 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:32.372610 25680 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:32.371703 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:32.383925 21035 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:32.395349 21029 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.385160 21034 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:32.379966 25882 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:32.347108 25371 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:32.396881 25860 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.398586 25653 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:32.402081 25141 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.405100 25825 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:32.412439 25676 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:18:32.439437 25845 log.cc:927] Time spent T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 1.100s	user 0.003s	sys 0.015s
I20260709 12:18:32.442289 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45970 (request call id 659) took 1122 ms. Trace:
I20260709 12:18:32.446043 25896 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:32.475018 25896 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:32.190881 20933 rpcz_store.cc:269] 0709 12:18:06.239182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.252882 (+ 13700us) service_pool.cc:224] Handling call
0709 12:18:32.146384 (+25893502us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:23.641599 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:23.787724 (+146125us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:23.787766 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:18:23.787786 (+    20us) tablet.cc:662] Decoding operations
0709 12:18:23.790982 (+  3196us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:23.791044 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:23.791070 (+    26us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:18:23.792362 (+  1292us) tablet.cc:701] Row locks acquired
0709 12:18:23.792875 (+   513us) write_op.cc:260] PREPARE: finished
0709 12:18:23.793015 (+   140us) write_op.cc:270] Start()
0709 12:18:23.793125 (+   110us) write_op.cc:276] Timestamp: P: 1783599503792968 usec, L: 0
0709 12:18:23.793142 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:18:23.793767 (+   625us) log.cc:844] Serialized 7820 byte log entry
0709 12:18:24.429341 (+635574us) op_driver.cc:464] REPLICATION: finished
0709 12:18:24.571750 (+142409us) write_op.cc:301] APPLY: starting
0709 12:18:24.573592 (+  1842us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:24.847859 (+274267us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:24.847958 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:25.163781 (+315823us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:25.164109 (+   328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:18:25.164157 (+    48us) write_op.cc:312] APPLY: finished
0709 12:18:25.164572 (+   415us) log.cc:844] Serialized 180 byte log entry
0709 12:18:25.165441 (+   869us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:25.165633 (+   192us) write_op.cc:454] Released schema lock
0709 12:18:25.165689 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:25.166062 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:25.166088 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13035,"reported_tablets":52,"spinlock_wait_cycles":10496,"child_traces":[["op",{"apply.queue_time_us":133662,"apply.run_cpu_time_us":29847,"apply.run_wall_time_us":596243,"cfile_cache_hit":78,"cfile_cache_hit_bytes":81471,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":18435,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":10,"num_ops":20,"prepare.queue_time_us":141083,"prepare.run_cpu_time_us":27195,"prepare.run_wall_time_us":221889,"raft.queue_time_us":237866,"raft.run_cpu_time_us":25432,"raft.run_wall_time_us":125775,"replication_time_us":635717,"thread_start_us":429950,"threads_started":4,"wal-append.queue_time_us":173549,"wal-append.run_cpu_time_us":64907,"wal-append.run_wall_time_us":2298681}]]}
I20260709 12:18:32.447809 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1915) took 1080 ms. Trace:
I20260709 12:18:32.479413 21036 rpcz_store.cc:276] 0709 12:18:31.367010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.382269 (+ 15259us) service_pool.cc:224] Handling call
0709 12:18:32.447590 (+1065321us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540027ea54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:32.447734 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2357900544}
I20260709 12:18:32.453536 21712 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:32.454077 25715 consensus_queue.cc:1059] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:32.422358 25653 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.426360 20928 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 5 to 8, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 8 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:32.397935 25748 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:18:32.411614 25704 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:32.485205 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 120717us
I20260709 12:18:32.415541 25882 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.416283 25883 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:32.398713 25855 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:18:32.463167 21108 rpcz_store.cc:276] 0709 12:18:31.320247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.320363 (+   116us) service_pool.cc:224] Handling call
0709 12:18:32.442137 (+1121774us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5400369cd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:32.442238 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28989824}
I20260709 12:18:32.419415 25371 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.425302 25860 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:32.468917 25829 consensus_meta.cc:287] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 1.069s	user 0.013s	sys 0.008s
I20260709 12:18:32.511831 25872 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:32.508998 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 524580us
I20260709 12:18:32.512984 21149 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:32.402643 25749 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.514321 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:32.515362 21149 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:32.515478 25860 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:32.515551 25749 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:32.455348 25728 raft_consensus.cc:3055] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:32.516301 21028 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:32.380396 25858 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.519289 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:32.520015 21182 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:32.520797 25371 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:32.521778 25858 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.423864 25886 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:32.524081 21178 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:32.523808 20928 catalog_manager.cc:5697] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 7 to 11, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:32.524544 25886 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:32.525040 25886 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.525348 20928 catalog_manager.cc:5697] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 2 to 7, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 7 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:32.516142 25870 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:32.483143 25834 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 1.143s	user 0.004s	sys 0.000s
I20260709 12:18:32.498353 25882 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.484140 25745 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:32.482075 25825 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:32.499136 25676 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:32.546147 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:32.546579 25676 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.516563 25889 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:32.550272 21030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 608) took 2004 ms. Trace:
I20260709 12:18:32.507292 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48236 (request call id 705) took 1946 ms. Trace:
W20260709 12:18:32.509189 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 525787us
W20260709 12:18:32.509895 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 517809us
I20260709 12:18:32.510967 25684 raft_consensus.cc:1081] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:32.511548 25829 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.470026 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1911) took 1104 ms. Trace:
I20260709 12:18:32.529349 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:32.519162 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:32.494542 25864 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:32.533087 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 128796us
I20260709 12:18:32.516162 25728 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:32.512220 25872 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:32.570948 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 44282.2us
I20260709 12:18:32.535833 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.566220 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:32.574221 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:32.499181 25835 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:32.509063 25642 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.544442 25745 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:32.545554 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:32.545759 25855 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:32.594412 25855 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:32.595252 25728 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.596248 25728 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:32.568348 25734 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:32.599128 25734 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:32.599498 25734 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.546659 20928 catalog_manager.cc:5697] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:32.601378 20928 catalog_manager.cc:5697] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 4 to 8, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 8 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:32.603091 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:32.604410 25829 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.606446 25574 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:32.559403 25890 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:32.608981 25890 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:32.609720 25890 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.611147 25890 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:32.611559 25896 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.614243 25896 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:32.614794 25749 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:32.615315 25371 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:32.617316 21111 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:18:32.551770 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.550606 21030 rpcz_store.cc:276] 0709 12:18:30.546050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.641136 (+ 95086us) service_pool.cc:224] Handling call
0709 12:18:30.641404 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:30.643624 (+  2220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.643653 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:30.644088 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.848205 (+204117us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:30.848245 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.848308 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.504471 (+656163us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4800080358. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba48bdaa1 00007fcba48b4b37 00007fcba48b49ca 00007fcba49ac26f 00007fcba49abf37 00007fcba49c055c 00007fcba49c0508 00007fcba49c0488 00007fcba49c0443 00007fcba49bf6ec 00007fcba38e9a96
0709 12:18:32.439681 (+935210us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:32.550073 (+110392us) raft_consensus.cc:1685] finished
0709 12:18:32.550095 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.550217 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7964,"raft.queue_time_us":13778,"raft.run_cpu_time_us":3198,"raft.run_wall_time_us":841000,"spinlock_wait_cycles":81111552,"thread_start_us":200671,"threads_started":1,"wal-append.queue_time_us":658606}
I20260709 12:18:32.550725 21183 rpcz_store.cc:276] 0709 12:18:30.561280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.637745 (+ 76465us) service_pool.cc:224] Handling call
0709 12:18:30.639968 (+  2223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.324803 (+684835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.507085 (+1182282us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400386154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:32.507240 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573692160}
I20260709 12:18:32.618412 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.618785 21105 raft_consensus.cc:2393] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:32.619367 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:32.558069 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:32.593406 25771 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.620246 25771 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.621197 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.621358 25835 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.622404 21105 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:32.623405 25835 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:32.560043 21179 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.559441 21033 rpcz_store.cc:276] 0709 12:18:31.365732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.386716 (+ 20984us) service_pool.cc:224] Handling call
0709 12:18:31.387015 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:32.041780 (+654765us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b18003967c0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9f53c4bc 00007fcb9c88a48b 00007fcba56e49a9 00007fcb9c8a669b 00007fcb9c8a493f 00007fcb9c8a4455 00007fcb9f98c060 00007fcb9f98cbfb 00007fcb9f99764b
0709 12:18:32.041872 (+    92us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.041887 (+    15us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:32.042230 (+   343us) log.cc:844] Serialized 26 byte log entry
0709 12:18:32.258833 (+216603us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:32.258881 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.258946 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:32.469710 (+210764us) raft_consensus.cc:1685] finished
0709 12:18:32.469757 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.469967 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9245,"raft.queue_time_us":61329,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":11690,"spinlock_wait_cycles":20808448,"thread_start_us":283604,"threads_started":2,"wal-append.queue_time_us":357350}
I20260709 12:18:32.561690 21181 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:32.625058 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:32.626067 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:32.560672 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:32.627490 25745 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:32.627617 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:32.628165 21178 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.619391 21104 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:32.550740 21029 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.526664 25883 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:32.631732 25883 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.632249 21029 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:32.633088 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:32.633260 25771 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:32.632176 21183 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:32.635082 21111 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:32.636629 21741 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:32.633648 21181 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:32.630991 21104 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:32.577248 21102 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:18:32.582649 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.583415 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:32.585995 21109 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:18:32.586815 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:32.559528 25889 raft_consensus.cc:697] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:32.587654 25313 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:32.587827 25866 consensus_meta.cc:287] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.000s
I20260709 12:18:32.588421 25825 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.575963 25864 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.550828 25886 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:32.590330 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:32.591414 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:32.591681 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:32.535321 25870 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:18:32.641001 25806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.296s	user 0.003s	sys 0.018s
I20260709 12:18:32.636876 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:32.651966 21077 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 2.672s (SENT) [suppressed 19 similar messages]
I20260709 12:18:32.668913 21108 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:32.694110 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 77046.6us
W20260709 12:18:32.673094 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 121399us
I20260709 12:18:32.683826 21182 raft_consensus.cc:2410] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:18:32.675892 21178 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:32.694087 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:32.698729 21151 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.670454 25684 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.704807 21179 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:32.717031 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:32.718945 21183 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 6.
W20260709 12:18:32.693547 25806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.003s	sys 0.018s
I20260709 12:18:32.734546 21002 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.734987 25886 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:32.735782 25886 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:32.736214 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.736493 25886 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:32.736881 25886 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:32.737188 25439 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:32.735873 21002 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.721197 21747 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:32.722191 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 130859us
I20260709 12:18:32.716738 25322 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:32.683596 25642 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:32.684216 25749 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:32.725992 25882 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.672204 25791 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:32.756711 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.716840 25855 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.670885 25729 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:18:32.694411 25870 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.684733 25866 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.719838 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:32.742559 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:32.747433 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.775836 21109 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 12: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:32.748129 21102 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:18:32.697333 25519 consensus_queue.cc:1059] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:18:32.751148 21186 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:32.750394 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:32.737659 25886 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.748833 25322 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:32.757776 21105 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:18:32.785746 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 133803us
I20260709 12:18:32.761548 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.761899 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:32.764658 21031 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:32.765501 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.817538 21029 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:32.732343 25684 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.766567 21034 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:32.738963 25831 consensus_queue.cc:1059] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:18:32.846979 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:32.847558 21105 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:32.847872 21105 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:32.735878 25771 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:32.720553 25313 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:32.590266 25872 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.739239 24896 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:32.782537 25859 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.732765 25861 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:32.777491 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 57733.7us
I20260709 12:18:32.748562 21106 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:32.776103 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:32.769659 25439 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:32.778395 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:32.862900 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.774395 25849 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:18:32.699927 25781 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 12:18:32.784415 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 247889us
I20260709 12:18:32.779090 25749 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.766122 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.819931 21103 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:32.820813 21028 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:32.820065 21036 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:32.821503 21031 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:18:32.869824 21033 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:32.824050 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 62221.9us
I20260709 12:18:32.767540 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:32.740448 25653 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.754004 25482 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:18:32.857059 24896 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.756629 25900 consensus_queue.cc:1059] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 12:18:32.855784 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.779819 25574 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:32.784859 25322 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:32.862644 25439 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:32.859365 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 92113.7us
I20260709 12:18:32.770804 25898 consensus_queue.cc:1059] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:18:32.863118 21032 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:32.778409 21107 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:18:32.816764 25855 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:32.772156 25791 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.869113 21105 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.894115 21105 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.863854 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2223) took 1232 ms. Trace:
I20260709 12:18:32.827913 25674 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.872300 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.872740 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.857208 25886 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:32.852428 21029 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:32.854719 25771 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:32.853922 25680 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:32.859848 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 83807.2us
I20260709 12:18:32.865721 25829 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:32.889503 21033 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
W20260709 12:18:32.892088 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 320173us
I20260709 12:18:32.890997 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.905479 21036 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:32.880417 24896 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:32.916795 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.916390 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 44155.2us
I20260709 12:18:32.907822 21110 raft_consensus.cc:1240] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:32.918426 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:32.925820 21002 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.922360 21035 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:18:32.868088 25911 consensus_queue.cc:1059] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:18:32.895470 21177 rpcz_store.cc:276] 0709 12:18:31.631047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.631181 (+   134us) service_pool.cc:224] Handling call
0709 12:18:31.631479 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:31.772533 (+141054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:31.772567 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:31.773155 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 12:18:31.929380 (+156225us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:31.938520 (+  9140us) log.cc:844] Serialized 14 byte log entry
0709 12:18:32.506156 (+567636us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b18002592a0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c821c0a 00007fcba5f61219 00007fcb9c8a9a40 00007fcb9c8a44e4 00007fcb9c8a4455 00007fcb9f98c060 00007fcb9f99e716 00007fcb9f9af287 00007fcb9f9af208
0709 12:18:32.826236 (+320080us) log.cc:844] Serialized 14 byte log entry
0709 12:18:32.846393 (+ 20157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.846461 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:32.863637 (+ 17176us) raft_consensus.cc:1685] finished
0709 12:18:32.863658 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.863799 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19817,"prepare.queue_time_us":369857,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":11159,"raft.queue_time_us":651163,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":4437,"spinlock_wait_cycles":14111616,"thread_start_us":616178,"threads_started":3,"wal-append.queue_time_us":191397}
I20260709 12:18:32.884703 25858 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:32.827471 25889 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:32.929059 21712 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:32.892835 25313 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:32.936015 21103 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:32.893226 25439 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.879837 25859 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:18:32.968288 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:32.952102 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.955070 21032 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
W20260709 12:18:32.966950 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.969878 21105 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:32.927342 25676 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.922327 25574 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:32.971825 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 99505.8us
I20260709 12:18:32.971968 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:32.784847 20928 catalog_manager.cc:5697] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 6 to 9, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 9 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:32.971267 21747 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:32.950284 25699 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:32.980854 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:32.950911 25313 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:32.993826 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:32.993784 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 68076.9us
I20260709 12:18:32.995131 21002 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:33.001133 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.927933 25680 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:32.975631 25829 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:32.951198 25825 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:18:33.004894 21002 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:32.989535 25857 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:33.024680 25859 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:33.000332 25729 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:33.027082 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.029198 25856 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:33.027156 25859 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:33.030409 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:33.010404 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 137726us
I20260709 12:18:32.966714 25849 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:18:33.004909 25866 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:33.031358 25919 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:18:33.003693 25831 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:33.031848 25831 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.032198 25831 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.012799 25911 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:32.989742 25924 consensus_queue.cc:1059] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:18:33.009558 25482 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:33.003820 25519 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:18:33.008893 25674 raft_consensus.cc:2764] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:18:33.015450 25653 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:33.014078 25829 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.016846 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:33.016606 25313 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.017467 25684 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:33.019618 25922 log.cc:927] Time spent T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:18:33.014497 20928 catalog_manager.cc:5697] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 5 to 12, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 12 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:33.027554 25680 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.030764 25859 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:33.037521 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.959515 25858 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:33.054399 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 192908us
I20260709 12:18:33.056568 25313 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.058955 25642 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:33.062943 25729 raft_consensus.cc:697] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:33.067394 25915 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:33.068229 25762 raft_consensus.cc:3055] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:33.055269 25923 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:33.073585 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 2041) took 1494 ms. Trace:
I20260709 12:18:33.148332 21110 rpcz_store.cc:276] 0709 12:18:31.579440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.579553 (+   113us) service_pool.cc:224] Handling call
0709 12:18:32.442259 (+862706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.926173 (+483914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.072810 (+146637us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b5400369cd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:33.073421 (+   611us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b5400369cd0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:33.073531 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3053547136}
I20260709 12:18:33.074255 25898 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:33.074931 25828 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:33.067207 25882 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:33.076808 25872 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.039850 25676 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:33.079747 25745 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:33.097378 25918 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 12:18:33.099835 25894 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:33.101131 21061 heartbeater.cc:646] Failed to heartbeat to 127.19.108.62:42247 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.108.62:42247 timed out after 15.000s (SENT)
I20260709 12:18:33.101802 25574 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.102576 25835 raft_consensus.cc:3055] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:33.102730 25841 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:33.036975 25771 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.183550 21181 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:33.183929 21739 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:33.054178 25646 consensus_queue.cc:1059] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:18:33.027107 25857 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:33.106671 25728 consensus_meta.cc:287] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.000s
I20260709 12:18:33.135738 25936 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:33.044342 25911 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:33.140007 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 207832us
I20260709 12:18:33.140146 21151 leader_election.cc:400] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:33.202068 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:33.202247 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 69093.9us
I20260709 12:18:33.203040 21151 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.071630 25864 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:33.157799 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 159177us
I20260709 12:18:33.140908 25642 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:33.164867 21185 raft_consensus.cc:1240] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:33.148909 25859 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.146615 25762 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:33.169548 25791 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:33.161945 25890 consensus_meta.cc:287] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 12:18:33.156634 25322 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:33.172446 25734 consensus_meta.cc:287] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.000s
I20260709 12:18:33.173930 25781 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:33.216419 25948 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:33.148162 25923 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:33.217111 25923 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.217985 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:33.219342 25653 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:33.219797 25946 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:18:33.220225 25745 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.180048 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.221125 25856 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:33.221431 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.199407 25857 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.151224 25898 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:33.177289 25894 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:33.159044 25896 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:33.215507 25729 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.247061 25896 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:33.248579 25926 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:18:33.249135 25896 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:33.162524 25866 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.249778 25866 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.185763 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.188798 25676 raft_consensus.cc:697] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:33.181643 25835 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:33.183821 25882 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.216084 25734 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.180732 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.252592 21181 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:33.254014 25882 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.255184 21180 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:18:33.254971 25870 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.256069 25882 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.257701 25835 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:33.258816 25929 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 12:18:33.256888 25870 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:33.259773 25835 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.260326 25676 consensus_queue.cc:237] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.227910 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.262807 21186 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:33.228907 21036 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:33.229492 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.230001 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:33.230985 21032 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:33.231526 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.259028 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:33.264281 21033 raft_consensus.cc:2376] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13. Re-sending same reply.
I20260709 12:18:33.264745 21742 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:18:33.214564 21709 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.156423 25828 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:33.235080 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.205690 25911 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:33.278132 25911 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.278730 25882 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:33.215790 25831 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.281941 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.282229 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.282724 25831 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.223503 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:33.237088 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:33.283548 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 60116.9us
I20260709 12:18:33.284055 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.284751 21027 raft_consensus.cc:2393] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:33.285020 25944 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:18:33.285418 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.285969 21027 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:33.237231 25894 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.286566 25828 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.287331 25894 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:33.287907 25828 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.288159 21076 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:33.289001 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:33.289369 25322 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:33.289894 25322 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:33.290325 25322 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.235575 25850 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:33.303584 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:33.216800 25781 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:33.241559 25923 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.179931 20928 catalog_manager.cc:5697] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 6 to 8, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 8 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.243717 25898 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.215196 24896 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.237388 25771 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:33.250231 25762 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.252280 21179 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:33.232220 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.267855 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.332232 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:33.269090 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.269989 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:33.270895 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.241495 21028 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: [12.6-14.7]
I20260709 12:18:33.333320 21036 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 12: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:33.333503 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.333684 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.334149 21034 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:33.334697 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.297214 25858 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.335531 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.336547 21034 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:18:33.276139 25864 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:33.277271 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.277422 25866 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:33.291038 25945 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:33.237457 25699 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:18:33.291278 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:33.286681 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.292276 25653 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:33.292891 25879 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:33.293475 25883 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:33.294493 25924 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:33.330989 25901 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:33.205792 25936 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.296686 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.297358 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.278757 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.291504 25829 consensus_queue.cc:1059] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:33.300680 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:33.301333 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 86840.7us
I20260709 12:18:33.302627 21180 raft_consensus.cc:2376] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12. Re-sending same reply.
I20260709 12:18:33.358327 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.303210 21747 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:18:33.308948 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:33.358995 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.310405 21109 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:33.312407 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:33.189357 25841 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.297137 25896 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:33.313495 21105 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:33.314757 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:33.238251 25642 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.317407 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:33.318802 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:33.322943 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:33.366616 21747 pending_rounds.cc:85] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Aborting all ops after (but not including) 12
I20260709 12:18:33.366925 21747 pending_rounds.cc:107] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:18:33.327310 25923 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.327728 21738 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:33.253543 25734 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:33.313421 25908 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:33.338666 21034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:18:33.338554 21029 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:33.378597 21032 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:33.342104 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.344022 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:33.379266 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:33.348672 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45144.6us
I20260709 12:18:33.350765 21035 raft_consensus.cc:2368] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12.
I20260709 12:18:33.378974 21034 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.349211 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.361038 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.361738 21709 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.343613 25371 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:33.365302 25951 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:18:33.368119 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.368543 21108 raft_consensus.cc:2393] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:33.328045 25860 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:18:33.370723 21107 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:33.348029 25898 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.371206 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.329912 25439 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.364889 25781 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.489981 25939 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:18:33.493741 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 70183.8us
I20260709 12:18:33.494359 21178 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:18:33.483119 21711 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:33.495575 25745 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:33.425194 25894 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:33.496464 25894 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.427570 25814 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:33.498373 25841 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.418466 21742 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:33.386823 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:33.482465 21746 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:33.339949 21036 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:33.419579 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.379999 21076 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:33.367156 21747 raft_consensus.cc:2889] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:33.502499 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 122565us
I20260709 12:18:33.385556 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:33.499982 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 138309us
I20260709 12:18:33.503546 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:33.504729 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.380359 21034 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.414291 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:33.505810 21028 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:33.505923 21076 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:33.500741 21184 raft_consensus.cc:2410] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:18:33.508229 21709 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:33.505751 21180 raft_consensus.cc:2368] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12.
I20260709 12:18:33.509406 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:33.511651 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.512490 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.357159 25945 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:33.512693 21180 raft_consensus.cc:2393] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 8: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:33.375415 21179 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:33.505239 21107 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:33.507099 21185 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 16: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:33.495788 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:33.522493 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.582809 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 64022.8us
W20260709 12:18:33.583128 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 66933.8us
I20260709 12:18:33.517630 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:33.523479 21149 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:33.375597 25901 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:33.586796 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.604986 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:33.386682 25313 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:18:33.602900 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 107168us
I20260709 12:18:33.611968 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.426005 25322 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:33.384207 25896 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:33.609330 21107 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 12: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:33.610010 21032 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:33.509413 25814 raft_consensus.cc:2764] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:18:33.610760 21180 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:33.584249 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.582864 25858 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.427001 25864 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.192s
I20260709 12:18:33.617558 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.512390 25841 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.412398 25642 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.510573 25866 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:33.621610 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:33.624182 25961 log.cc:927] Time spent T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:18:33.439463 20928 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 9 to 10, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 10 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:33.633237 25957 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:18:33.611174 25870 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:33.633605 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.581770 25835 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:18:33.616312 25313 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.667027 25850 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:33.667780 20928 catalog_manager.cc:5697] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:33.668440 25313 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:33.635360 21034 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.635942 25857 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.654773 25858 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.670408 25857 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:33.670205 25945 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.671145 21107 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:33.620258 25886 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:33.671589 25858 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.498526 25894 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:33.638478 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 126785us
I20260709 12:18:33.672847 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:33.582084 25882 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:33.675012 25882 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.675390 25882 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:33.678160 25439 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.679000 25866 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:33.679869 25866 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.444271 25936 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.426836 24896 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.641726 21185 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:33.515194 25883 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.588737 25762 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.687258 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.687518 21104 raft_consensus.cc:1240] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:33.614032 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.642124 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.680413 21739 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:33.657922 25841 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.667811 21033 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:33.642441 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54537.4us
I20260709 12:18:33.693528 25896 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.694437 25861 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:33.687252 25883 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:33.696334 25835 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:33.688346 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.699085 25947 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.699023 21184 raft_consensus.cc:2410] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:33.700055 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.700055 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:33.701633 25781 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.608129 21108 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 13: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:33.401973 25371 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.651371 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:33.425132 25734 consensus_queue.cc:1059] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.198s
I20260709 12:18:33.689139 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:33.654318 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 132445us
I20260709 12:18:33.712646 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:33.656080 21747 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:33.713439 21180 raft_consensus.cc:2393] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:18:33.656903 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.664825 21027 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:18:33.665581 21182 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
W20260709 12:18:33.714636 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.706673 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.713739 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:33.715514 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 101548us
I20260709 12:18:33.715886 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:33.711629 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 60356.9us
I20260709 12:18:33.652478 21102 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:33.719594 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:33.719983 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.636912 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:33.720593 21179 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:33.714808 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.720772 21105 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:33.722085 21077 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:33.720257 21102 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:33.723397 21034 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.725144 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:33.725716 21151 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:33.726501 21029 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:18:33.725209 21185 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:33.730003 21182 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:33.732054 21108 raft_consensus.cc:2410] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:18:33.728259 21029 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:33.737170 21105 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:33.715010 25879 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.743556 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:33.657182 25322 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:33.744833 21180 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:33.748776 21180 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:33.749178 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:33.750367 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:33.751127 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.713754 25653 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:33.729792 25704 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:33.747488 25901 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.740180 25828 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:18:33.764366 21151 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.724589 25957 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:33.775628 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:33.780086 21151 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.762027 21179 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:33.781301 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.782716 21108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:33.783291 21179 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:33.784374 25958 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.783385 21108 raft_consensus.cc:606] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:33.784958 21108 raft_consensus.cc:614] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:33.785043 25958 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:33.785666 25958 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:33.786348 25734 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:33.754773 25850 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:33.778160 25704 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.792990 25704 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:33.768504 25322 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:33.794075 25322 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.795006 25957 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.796561 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:33.797068 25957 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:33.778223 25313 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:33.798192 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:33.799043 25653 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.799504 25653 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.755638 25791 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:33.760372 25482 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:33.764509 25859 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:33.768385 25883 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:33.806466 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:33.805307 25850 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:33.813133 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:33.813500 20928 catalog_manager.cc:5697] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 7 to 11, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 11 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:33.814491 25870 raft_consensus.cc:3055] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:33.816411 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.824204 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:33.803762 25911 consensus_meta.cc:287] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.523s	user 0.004s	sys 0.004s
I20260709 12:18:33.801333 25653 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:33.759753 25894 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:18:33.828578 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:33.834182 21034 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:33.823347 25870 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:33.841123 25870 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:33.841740 25864 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.756062 25879 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.805675 25482 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.845754 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.846364 21178 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:33.847255 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:33.861528 21177 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:33.863329 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.864676 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:33.865278 21178 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:33.866148 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:33.856068 25729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.008s	sys 0.021s
I20260709 12:18:33.825357 25313 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:18:33.857028 25482 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.827143 25940 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
W20260709 12:18:33.891135 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.857494 25371 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:33.877987 25729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.008s	sys 0.022s
I20260709 12:18:33.833369 25911 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:33.862202 25439 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:18:33.890347 25870 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:33.951164 20928 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.953393 20928 catalog_manager.cc:5697] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 9 to 11, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 11 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.956966 25882 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:33.968673 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 242016us
I20260709 12:18:33.970642 21183 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:18:33.971101 21183 pending_rounds.cc:85] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 6
I20260709 12:18:33.971316 21183 pending_rounds.cc:107] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:18:33.971534 21183 raft_consensus.cc:2889] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.972674 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:33.988238 21031 raft_consensus.cc:1240] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:18:33.994354 25969 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:33.995842 25969 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:33.996870 25967 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:33.997224 25967 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:33.997517 25969 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:33.959926 25771 consensus_meta.cc:287] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.623s	user 0.005s	sys 0.005s
W20260709 12:18:33.998670 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.004657 21178 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:18:34.006125 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:34.006781 21178 raft_consensus.cc:2393] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 7: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:33.987239 25825 raft_consensus.cc:3055] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:34.020524 21108 raft_consensus.cc:2368] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14.
I20260709 12:18:33.993170 25313 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.059223 21739 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:34.061407 21181 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
W20260709 12:18:34.036705 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.031912 21178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db9d39844048444b8a7293196d1349e9"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:34.065076 21178 raft_consensus.cc:606] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:34.065390 21178 raft_consensus.cc:614] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:34.066428 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 225452us
I20260709 12:18:34.026413 25771 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:33.922854 25850 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.073022 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.025602 25825 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:34.032496 25781 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:34.078058 21002 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.086742 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.088549 21746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32986 (request call id 632) took 1520 ms. Trace:
I20260709 12:18:34.089154 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.090262 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:34.090337 21030 raft_consensus.cc:1240] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:33.997961 25967 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.088932 21746 rpcz_store.cc:276] 0709 12:18:32.557086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.557762 (+   676us) service_pool.cc:224] Handling call
0709 12:18:34.077735 (+1519973us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54005235d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:34.077849 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706286464}
I20260709 12:18:34.095212 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.093194 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.097000 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:34.056088 25883 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:18:34.064291 25313 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.084285 25856 raft_consensus.cc:2764] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:18:34.092305 25371 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:34.097173 25831 raft_consensus.cc:3055] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:34.106424 25866 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:34.130873 25879 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:34.118173 25898 consensus_meta.cc:287] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.000s
I20260709 12:18:34.075169 25771 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.132803 21182 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:34.093909 25781 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.119459 25831 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:34.130890 25653 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:18:34.140990 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 149116us
I20260709 12:18:34.135106 25967 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:34.151634 21077 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.635s (SENT)
I20260709 12:18:34.144004 25856 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:34.163527 21077 leader_election.cc:336] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Timed out: RequestConsensusVote RPC to 127.19.108.3:36737 timed out after 1.783s (SENT)
I20260709 12:18:34.164822 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:34.149237 25653 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:34.153512 25911 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.123224 25825 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.139824 25901 consensus_queue.cc:1059] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:18:34.161984 25856 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:34.211453 21183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2249) took 1029 ms. Trace:
I20260709 12:18:34.211925 21183 rpcz_store.cc:276] 0709 12:18:33.182531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.188322 (+  5791us) service_pool.cc:224] Handling call
0709 12:18:33.188565 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.971941 (+783376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.211260 (+239319us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54000be5d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:34.211405 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797823744}
I20260709 12:18:34.181568 21186 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:34.185400 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:34.213959 21035 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:34.193809 25947 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:34.196815 25860 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:34.202775 25966 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.203662 25313 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.204932 25653 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.173679 25970 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:34.215994 25856 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:34.175186 25985 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:34.176981 25882 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.099478 20928 catalog_manager.cc:5697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 10 to 11, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 11 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:34.224102 25901 consensus_queue.cc:1243] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:34.232870 25482 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.233862 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:34.247670 21741 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:34.238484 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:34.249696 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:34.250499 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:34.233896 21150 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.239620 25781 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.243633 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.244357 21035 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:34.259891 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.260949 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:34.215708 25984 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:34.244879 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 149723us
I20260709 12:18:34.222139 21077 leader_election.cc:400] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12.
I20260709 12:18:34.261389 21150 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:34.268450 21077 leader_election.cc:403] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:18:34.266377 21184 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:18:34.267395 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:34.267452 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:34.283464 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 62427us
I20260709 12:18:34.283902 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.284226 21077 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:34.249140 25947 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.286242 21109 raft_consensus.cc:2393] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 14: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:34.286204 21182 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:34.178076 25831 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.226694 25966 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.287815 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.291710 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.292066 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:34.292658 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:34.260339 25985 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:34.268488 25313 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:34.304754 21151 leader_election.cc:400] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12.
I20260709 12:18:34.305065 21151 leader_election.cc:403] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:34.308665 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.290046 25857 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12.
I20260709 12:18:34.313601 21109 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:34.315011 21077 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:34.316151 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.289884 25781 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:34.297158 25866 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:34.324447 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:34.326582 21077 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:34.327795 21077 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:34.329442 21109 raft_consensus.cc:3055] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:34.330040 21109 raft_consensus.cc:740] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:34.310631 25864 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:34.308359 25791 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12.
I20260709 12:18:34.334522 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:34.270512 25984 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.325919 25970 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:34.312002 25313 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:34.339711 25992 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:18:34.335029 25371 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:18:34.325229 25781 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.328385 25883 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:34.310442 25642 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:18:34.357446 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 51563.3us
I20260709 12:18:34.358444 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 2075) took 1051 ms. Trace:
I20260709 12:18:34.297359 25947 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.333984 21109 consensus_queue.cc:260] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.368369 21742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32994 (request call id 865) took 1088 ms. Trace:
I20260709 12:18:34.335434 25857 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:34.373660 25781 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.399024 21180 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:34.393520 25870 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:34.374605 25883 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:34.380671 25482 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:34.381407 25313 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:34.382472 25987 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:18:34.384569 21109 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:34.395913 25858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.011s	sys 0.025s
I20260709 12:18:34.382736 25970 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:34.384275 21742 rpcz_store.cc:276] 0709 12:18:33.280372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.317166 (+ 36794us) service_pool.cc:224] Handling call
0709 12:18:34.368221 (+1051055us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b5400123754. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:34.368321 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119919488}
I20260709 12:18:34.337131 25985 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.378640 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:34.448712 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 70151.9us
I20260709 12:18:34.451452 21036 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:34.410748 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 168841us
I20260709 12:18:34.411605 25859 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:18:34.418416 25960 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.909s	user 0.004s	sys 0.000s
I20260709 12:18:34.424059 21738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 636) took 1238 ms. Trace:
I20260709 12:18:34.425424 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 624) took 1122 ms. Trace:
I20260709 12:18:34.455969 21031 rpcz_store.cc:276] 0709 12:18:33.303373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.342873 (+ 39500us) service_pool.cc:224] Handling call
0709 12:18:33.343118 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:34.001622 (+658504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.425176 (+423554us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54000816d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:34.425366 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483060480}
I20260709 12:18:34.425855 25748 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:34.429095 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 101475us
I20260709 12:18:34.408885 25857 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:34.375831 21103 rpcz_store.cc:276] 0709 12:18:33.306584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.306857 (+   273us) service_pool.cc:224] Handling call
0709 12:18:33.307095 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.387128 (+ 80033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.387157 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:33.387193 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:33.387224 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.358221 (+970997us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b540016eed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:34.358269 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.358388 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183692544}
I20260709 12:18:34.435055 25994 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:34.436409 25947 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
W20260709 12:18:34.465018 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.437630 25984 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:34.438639 25966 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:34.430742 25883 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:34.460981 25748 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:34.475306 25999 log.cc:927] Time spent T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:18:34.475659 25748 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.476233 25970 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:34.439428 21712 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.477102 25970 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.409932 25870 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:34.443018 25322 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:34.443253 25993 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:18:34.453104 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.453439 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.454232 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.454262 21032 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:34.479003 25855 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:34.443975 25858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.012s	sys 0.026s
I20260709 12:18:34.455410 21738 rpcz_store.cc:276] 0709 12:18:33.185691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.186208 (+   517us) service_pool.cc:224] Handling call
0709 12:18:33.186497 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.370093 (+183596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.423812 (+1053719us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54006a6b54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:34.423991 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324428032}
I20260709 12:18:34.460723 21036 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:18:34.436805 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.489548 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.368206 20928 catalog_manager.cc:5697] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:34.455176 25859 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:18:34.480774 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.483290 21107 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:34.479080 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:34.460768 25482 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:34.479370 25322 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.491894 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 2823) took 1186 ms. Trace:
I20260709 12:18:34.499682 21027 rpcz_store.cc:276] 0709 12:18:33.305574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.381658 (+ 76084us) service_pool.cc:224] Handling call
0709 12:18:33.381889 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.714154 (+332265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.491685 (+777531us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54002238d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:34.491842 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630739200}
I20260709 12:18:34.493470 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:34.505689 21104 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:34.505101 26008 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:18:34.508529 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 2080) took 1194 ms. Trace:
I20260709 12:18:34.509532 26004 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:18:34.509764 26007 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:34.478487 25870 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.492794 25748 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:34.508948 21106 rpcz_store.cc:276] 0709 12:18:33.313941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.314058 (+   117us) service_pool.cc:224] Handling call
0709 12:18:33.314347 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:33.314672 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.314697 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:33.321625 (+  6928us) log.cc:844] Serialized 26 byte log entry
0709 12:18:33.509666 (+188041us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:33.509704 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.509765 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.417867 (+908102us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:34.505716 (+ 87849us) raft_consensus.cc:1685] finished
0709 12:18:34.505736 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.508476 (+  2740us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":957,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":10913,"spinlock_wait_cycles":9206144,"thread_start_us":159947,"threads_started":1,"wal-append.queue_time_us":170685}
I20260709 12:18:34.517069 21106 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:34.517462 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.518210 21106 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:34.518941 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2690) took 1243 ms. Trace:
I20260709 12:18:34.519286 21181 rpcz_store.cc:276] 0709 12:18:33.275718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.367924 (+ 92206us) service_pool.cc:224] Handling call
0709 12:18:34.518770 (+1150846us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54002625d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:34.518892 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170258304}
I20260709 12:18:34.525019 21106 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:18:34.526013 21180 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:34.526340 21106 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:34.529639 21104 raft_consensus.cc:1240] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:34.534938 25981 log.cc:927] Time spent T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.359s	user 0.002s	sys 0.000s
I20260709 12:18:34.527278 26001 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:34.536079 26001 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:34.536429 26001 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.539655 21182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2706) took 1209 ms. Trace:
I20260709 12:18:34.540036 21182 rpcz_store.cc:276] 0709 12:18:33.330619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.144475 (+813856us) service_pool.cc:224] Handling call
0709 12:18:34.144709 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.290229 (+145520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.539431 (+249202us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003fc854. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:34.539596 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325021440}
I20260709 12:18:34.541110 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:34.542057 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2699) took 1236 ms. Trace:
I20260709 12:18:34.542416 21179 rpcz_store.cc:276] 0709 12:18:33.305882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.784495 (+478613us) service_pool.cc:224] Handling call
0709 12:18:33.787659 (+  3164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.802075 (+ 14416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.802102 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:33.802138 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:33.802172 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.541843 (+739671us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5400387a54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:34.541891 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.542003 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32758656}
I20260709 12:18:34.543614 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:34.545710 21179 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:18:34.546034 21179 pending_rounds.cc:85] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 6
I20260709 12:18:34.546244 21179 pending_rounds.cc:107] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:18:34.546460 21179 raft_consensus.cc:2889] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:34.548844 26001 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.550951 25704 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:34.513475 25482 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.552484 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:34.553076 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:34.555642 21179 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:34.504300 25791 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:34.564900 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:34.566685 21739 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:34.566805 21738 raft_consensus.cc:2410] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 12:18:34.571252 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.569497 21179 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:34.553833 25870 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.581255 21109 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:34.592918 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:34.566342 25680 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:18:34.588038 25956 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:18:34.611605 21746 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:34.600736 21739 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:34.576773 25850 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:18:34.575336 25726 consensus_queue.cc:1059] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:18:34.605222 25322 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:34.605983 25974 log.cc:927] Time spent T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.431s	user 0.001s	sys 0.000s
I20260709 12:18:34.608530 21111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 2071) took 1318 ms. Trace:
I20260709 12:18:34.609764 25939 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:34.583474 25985 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:18:34.571691 25482 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.619597 25894 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:34.579293 25872 consensus_queue.cc:1059] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:18:34.626108 26001 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:34.593422 25574 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:34.636441 21111 rpcz_store.cc:276] 0709 12:18:33.289617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.291052 (+  1435us) service_pool.cc:224] Handling call
0709 12:18:34.608364 (+1317312us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b540016f8d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:34.608477 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873986432}
I20260709 12:18:34.645285 21033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1943) took 1272 ms. Trace:
I20260709 12:18:34.640442 25322 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:34.641122 25973 log.cc:927] Time spent T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.499s	user 0.002s	sys 0.000s
I20260709 12:18:34.641482 25967 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:34.641276 25781 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.658694 21182 raft_consensus.cc:2368] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 12. Current term is 13.
I20260709 12:18:34.642704 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 2088) took 1120 ms. Trace:
I20260709 12:18:34.642937 26014 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.661218 26014 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.661630 25967 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:34.645615 21033 rpcz_store.cc:276] 0709 12:18:33.372408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.387159 (+ 14751us) service_pool.cc:224] Handling call
0709 12:18:33.387385 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.690412 (+303027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.645085 (+954673us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400222ed4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:34.645232 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644516736}
I20260709 12:18:34.662470 25967 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.663218 26014 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:34.664080 21185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 2259) took 1436 ms. Trace:
I20260709 12:18:34.664415 21185 rpcz_store.cc:276] 0709 12:18:33.227508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.729967 (+502459us) service_pool.cc:224] Handling call
0709 12:18:33.730220 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:33.762392 (+ 32172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.762420 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:33.762825 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 12:18:33.967964 (+205139us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:33.968004 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.968077 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.640643 (+672566us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:34.663832 (+ 23189us) raft_consensus.cc:1685] finished
0709 12:18:34.663851 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.664028 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30580,"raft.queue_time_us":32801,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":3369216,"thread_start_us":204766,"threads_started":1,"wal-append.queue_time_us":334825}
I20260709 12:18:34.608690 25883 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:34.647540 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 55287.7us
I20260709 12:18:34.637742 25939 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:34.652144 25322 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.655704 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 677) took 1144 ms. Trace:
I20260709 12:18:34.613490 20928 catalog_manager.cc:5697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:34.655987 21178 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:34.659257 21102 rpcz_store.cc:276] 0709 12:18:33.522547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.734565 (+212018us) service_pool.cc:224] Handling call
0709 12:18:33.734877 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:33.735193 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.735221 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:33.735751 (+   530us) log.cc:844] Serialized 52 byte log entry
0709 12:18:34.065869 (+330118us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:34.065909 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.065977 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.605503 (+539526us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:34.642466 (+ 36963us) raft_consensus.cc:1685] finished
0709 12:18:34.642487 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.642653 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33028,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":40877824,"thread_start_us":285897,"threads_started":1,"wal-append.queue_time_us":392733}
I20260709 12:18:34.643985 25894 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:34.658269 25781 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.679373 21110 rpcz_store.cc:276] 0709 12:18:33.511722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.512705 (+   983us) service_pool.cc:224] Handling call
0709 12:18:33.512970 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:33.705065 (+192095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.705098 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:34.516858 (+811760us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b2c0005c228. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:18:34.517204 (+   346us) log.cc:844] Serialized 26 byte log entry
0709 12:18:34.569535 (+ 52331us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:34.569569 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.569668 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.655459 (+ 85791us) raft_consensus.cc:1685] finished
0709 12:18:34.655479 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.655651 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93903,"raft.queue_time_us":134230,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6470,"spinlock_wait_cycles":15552768,"thread_start_us":166884,"threads_started":2,"wal-append.queue_time_us":76711}
I20260709 12:18:34.655869 21184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 2262) took 1339 ms. Trace:
I20260709 12:18:34.648056 25574 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:34.683357 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 118553us
I20260709 12:18:34.684361 21184 rpcz_store.cc:276] 0709 12:18:33.316625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.699864 (+383239us) service_pool.cc:224] Handling call
0709 12:18:34.655707 (+955843us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b540024ead4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:34.655817 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206495616}
I20260709 12:18:34.685556 21002 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.665997 25791 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:34.689124 25439 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:34.691562 25439 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:34.692626 25439 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.694665 26014 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:34.698333 21033 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:34.700940 21102 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:34.701262 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:34.702308 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.705070 21036 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:18:34.706466 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.685947 25866 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:34.707194 21102 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 12: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:34.686403 25574 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:34.689301 25482 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:34.724771 21110 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:34.724080 25939 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.729084 25894 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.701992 25791 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.727526 25781 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.809528 25322 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.811712 25771 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.813789 20928 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 6 to 9, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 9 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:34.816608 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.819969 25791 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.820833 25939 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.821985 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2703) took 1502 ms. Trace:
I20260709 12:18:34.828037 21183 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:34.828241 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.828734 21177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2700) took 1522 ms (client timeout 1512 ms). Trace:
W20260709 12:18:34.829128 21177 rpcz_store.cc:269] 0709 12:18:33.306104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.341855 (+ 35751us) service_pool.cc:224] Handling call
0709 12:18:34.828571 (+1486716us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540001c7d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:34.828669 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005234560}
W20260709 12:18:34.832329 25856 consensus_meta.cc:287] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 12:18:34.832580 25676 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:34.833065 25676 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:34.812616 25781 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.833859 25676 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.835454 25781 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:34.849661 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.850971 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.851595 21108 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:34.852417 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:34.853937 21111 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:18:34.856854 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:34.857432 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.858144 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.858040 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.859458 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:34.859941 21108 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.860230 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:34.860791 21182 raft_consensus.cc:2376] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14. Re-sending same reply.
I20260709 12:18:34.822357 21178 rpcz_store.cc:276] 0709 12:18:33.319241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.140532 (+821291us) service_pool.cc:224] Handling call
0709 12:18:34.655823 (+515291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.682231 (+ 26408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.821793 (+139562us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540024ead0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9938ad 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:34.821926 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184366464}
I20260709 12:18:34.861523 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:34.861867 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:34.862501 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:34.881426 25825 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:34.881639 21182 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:34.862820 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:34.863198 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.882668 25726 raft_consensus.cc:3055] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:34.883078 25726 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:34.863413 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.883808 25726 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.884379 25858 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:34.885100 25883 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:34.884899 25858 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.885798 21105 raft_consensus.cc:1240] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:34.886788 25858 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.886974 25894 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.858464 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:34.890869 21107 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:34.864060 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:34.867223 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.857949 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:34.894179 21181 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 15: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:34.894276 25715 raft_consensus.cc:3055] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:34.894665 25715 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:34.864625 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:34.895474 25715 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.896553 25715 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:34.897034 21183 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:34.866021 25676 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:34.899539 25831 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.899813 25482 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:34.867170 25771 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.901717 25771 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.882822 21149 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:34.867568 21186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2692) took 1563 ms (client timeout 1562 ms). Trace:
W20260709 12:18:34.903982 21186 rpcz_store.cc:269] 0709 12:18:33.304199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.341788 (+ 37589us) service_pool.cc:224] Handling call
0709 12:18:34.867418 (+1525630us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540038b154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:34.867508 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798733696}
I20260709 12:18:34.728361 21180 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:34.868280 25841 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:34.905861 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.872157 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.874768 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.907203 21032 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:34.875422 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.903708 25771 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.909229 25653 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.909686 21186 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:18:34.910005 21186 pending_rounds.cc:85] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 6
I20260709 12:18:34.910208 21186 pending_rounds.cc:107] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:18:34.910425 21186 raft_consensus.cc:2889] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:34.904422 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:34.876528 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.912688 25771 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:18:34.879739 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.880491 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:34.913653 21030 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:34.903601 25898 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:34.877636 25859 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.914656 25859 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.911444 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:34.890636 21178 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:34.832705 25856 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:34.925354 25482 consensus_queue.cc:1175] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a1b891e53adc40a6a1ae813238321e93" responder_term: 13 status { last_received { term: 12 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:34.812525 25574 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.950120 26020 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:34.951577 25882 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:34.952198 26020 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.953186 25574 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:34.938129 21149 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.954097 26020 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:34.954542 25322 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:34.937619 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:34.956185 21180 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
W20260709 12:18:34.956812 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 244854us
I20260709 12:18:34.958992 25857 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:34.959898 21108 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:34.949944 21077 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:34.954654 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:34.950292 26014 consensus_queue.cc:1059] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:18:34.961571 26014 raft_consensus.cc:3055] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:34.961896 26014 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:34.962169 21183 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:34.962586 26014 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.963668 26014 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.943234 25726 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:34.926529 25856 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:34.968597 25901 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:34.970429 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:34.971199 25956 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:34.972227 25901 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:34.972446 21076 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:34.972824 25901 consensus_queue.cc:1243] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:34.973794 26001 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:34.971817 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:34.974963 26001 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:34.975369 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:34.976099 26001 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:34.976492 21077 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:34.977218 26001 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:34.977720 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:34.978420 25870 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:34.978760 21151 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:34.978871 25870 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.979385 25870 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.980986 25791 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:34.981423 25791 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.981797 25791 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:34.968729 21149 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.945031 21712 leader_election.cc:400] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 12. Current term is 13.
I20260709 12:18:34.983686 21712 leader_election.cc:403] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:34.979023 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 132914us
I20260709 12:18:34.984649 21149 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:34.985186 25322 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:34.988863 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.990993 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:34.991701 21739 raft_consensus.cc:2368] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14.
I20260709 12:18:34.992589 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:34.994974 25992 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:34.995141 25941 consensus_queue.cc:1059] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:34.995798 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:34.995958 25941 raft_consensus.cc:3055] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:34.996373 25941 raft_consensus.cc:740] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:34.996819 25985 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.997262 25985 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:34.997143 25941 consensus_queue.cc:260] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:34.999065 25941 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:34.999645 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.999241 25985 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.001536 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.002251 25924 consensus_queue.cc:1059] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:35.003191 25728 raft_consensus.cc:3055] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:35.003526 25728 raft_consensus.cc:740] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:35.003677 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.004297 25728 consensus_queue.cc:260] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.004977 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.005540 21746 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 7.
I20260709 12:18:35.005959 25728 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:35.007632 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.008975 21746 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:35.009918 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:35.011757 21150 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:35.012704 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:35.013293 21739 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:18:35.021175 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.021901 21742 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
W20260709 12:18:35.022775 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 77895.1us
I20260709 12:18:35.022621 25859 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:35.024290 25859 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.024675 25859 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:35.024995 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:35.026007 25653 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:35.026558 25925 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:35.026687 25653 raft_consensus.cc:697] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:35.013670 25831 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.027611 25831 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.023852 21000 leader_election.cc:400] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14.
I20260709 12:18:35.027704 25653 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.028661 21000 leader_election.cc:403] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:35.029389 21000 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:35.013062 21150 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:34.951121 21184 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:35.040405 21739 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
W20260709 12:18:35.043432 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 58836.8us
I20260709 12:18:35.044198 21149 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.044955 25781 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:35.045009 25898 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:35.047199 25898 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:35.049686 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.050699 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.053277 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 74565.2us
I20260709 12:18:35.058704 21179 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:35.062722 20999 leader_election.cc:400] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14.
I20260709 12:18:35.064031 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.074870 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:35.081229 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:35.050768 25825 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:35.041898 25985 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14.
I20260709 12:18:35.083488 21077 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:35.042065 25726 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 12. Current term is 13.
I20260709 12:18:35.086803 21077 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:35.084777 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:35.084960 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 47138.6us
I20260709 12:18:35.050531 25947 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.086264 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.088667 21184 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:35.089201 21178 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:35.072607 25858 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.108330 25858 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.108723 25791 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.110313 25858 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.084263 25898 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:18:35.098146 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.102907 26016 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:18:35.099181 21150 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:35.094417 26001 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:35.089941 25313 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:18:35.107270 25870 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.071169 25970 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:18:35.112895 21178 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:35.072491 25646 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:18:35.120893 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.131443 21181 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:35.121990 21149 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:35.111155 26041 log.cc:927] Time spent T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:18:35.130313 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 66350.2us
W20260709 12:18:35.134924 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.110782 25791 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:35.136943 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:35.110915 25860 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:35.114049 25956 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:35.142385 21149 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.115021 25866 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:35.146605 21103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 2101) took 1052 ms. Trace:
I20260709 12:18:35.116888 25831 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.146987 25322 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.133846 26009 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:35.148352 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.149927 25994 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:35.178011 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:35.151618 25870 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:35.152921 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.179235 21181 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:35.142179 25859 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.156527 21185 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 12:18:35.115415 26005 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:35.158829 21149 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.175380 21739 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:35.130928 25771 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:35.181406 21179 raft_consensus.cc:2368] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:35.157503 21103 rpcz_store.cc:276] 0709 12:18:34.094664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.463797 (+369133us) service_pool.cc:224] Handling call
0709 12:18:34.464046 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:34.477286 (+ 13240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.477326 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:34.892897 (+415571us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b2c0005c228. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:18:34.893256 (+   359us) log.cc:844] Serialized 26 byte log entry
0709 12:18:35.084582 (+191326us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:35.084618 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.084678 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:35.146347 (+ 61669us) raft_consensus.cc:1685] finished
0709 12:18:35.146366 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.146550 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12910,"raft.queue_time_us":21774,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":12027,"spinlock_wait_cycles":9207168,"thread_start_us":191004,"threads_started":1,"wal-append.queue_time_us":229683}
I20260709 12:18:35.115206 25967 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:35.130421 25883 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:35.119269 25825 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:18:35.141322 25956 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.140774 25992 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:35.192747 21149 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.157810 25482 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.208187 21002 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:18:35.209052 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 60777.1us
I20260709 12:18:35.220405 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.221107 21103 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:18:35.221550 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:35.222278 21103 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:35.223184 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:35.229455 25870 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:35.229728 21110 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:35.189806 25829 consensus_queue.cc:1059] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:18:35.239835 25829 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:35.240190 25829 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:35.240968 25829 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.242093 25829 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:35.243254 25850 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:35.243780 25850 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.246079 25748 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:35.246578 25748 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.143904 25860 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.248878 25748 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.252347 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.257623 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:35.204931 26044 log.cc:927] Time spent T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:18:35.259050 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:35.263833 21029 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.266022 21036 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:35.191527 26009 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:35.207665 25894 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:35.268642 21110 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:35.268875 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.278774 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.279826 21107 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:35.280757 21036 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:35.212932 25994 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:35.273281 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.177341 25866 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.214833 25985 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:35.272452 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:35.295009 21104 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.212386 25956 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:35.286530 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:35.262621 25835 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:35.206135 25901 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:18:35.303494 21002 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:35.210186 25883 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.294253 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:35.276979 26041 log.cc:927] Time spent T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:35.312794 21029 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:35.292447 25994 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.265204 25781 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:18:35.339277 21106 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:35.295799 25939 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.344291 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:35.347862 21742 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:35.291280 25646 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:35.308306 25715 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.307961 25835 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.308070 25894 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:35.364607 21742 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:35.365911 21150 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:35.344784 25994 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:35.375308 25715 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:35.380621 26045 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:35.381299 21104 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:35.374774 25894 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.383955 25715 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.384109 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.384723 21104 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:35.384841 25894 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:35.352074 25825 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:35.385978 25825 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.386353 25825 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:35.377262 25482 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:35.389168 25482 raft_consensus.cc:697] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:35.390086 25482 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:35.391402 26046 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:18:35.396615 21106 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:35.397132 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.397765 21184 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:35.400429 25860 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:35.345044 25859 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 8 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:35.398811 21712 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:35.361768 25835 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.412506 21180 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:35.418054 25835 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.358246 25699 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:35.358080 25939 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.419337 25715 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:35.362308 25646 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.423385 25699 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.377323 26009 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.428982 25715 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.438910 25883 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.435747 25956 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.439766 25866 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:35.444358 25939 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:35.444890 25715 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.445703 25850 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:35.454382 25956 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:35.454469 26037 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 12:18:35.455015 25835 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.464437 25825 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.466585 25825 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.468772 25994 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.471073 25994 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:35.512753 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 209132us
I20260709 12:18:35.528545 21034 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:35.529690 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:35.530314 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:35.548277 21033 raft_consensus.cc:1240] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 15. Current term is 16. Ops: [12.6-15.7]
I20260709 12:18:35.528788 21030 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:35.531618 21108 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:18:35.531777 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:35.535553 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.536137 21036 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:35.528316 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:35.552356 21032 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:35.554978 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.555781 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:35.556075 21180 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:18:35.556403 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.556902 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.561352 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:35.562157 21185 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:35.563709 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:35.566777 21029 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:35.570638 21031 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:35.558485 21183 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:35.573649 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:35.575229 21151 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.572660 21103 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:18:35.558606 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:35.580078 21103 pending_rounds.cc:85] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 6
I20260709 12:18:35.598399 21103 pending_rounds.cc:107] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 14.7
W20260709 12:18:35.605510 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.609458 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.611268 25829 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.612233 25829 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.615059 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.615892 25870 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:35.616539 25870 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:35.617801 25894 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.618547 25894 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.619539 25985 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:35.625303 25894 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:35.625921 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.631698 25994 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:35.633850 21710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.643291 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.644277 25971 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.645025 25971 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:35.642537 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 67540.9us
I20260709 12:18:35.643177 25894 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:35.651443 25971 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.651590 25894 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:35.653208 25894 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.603608 21103 raft_consensus.cc:2889] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:35.634013 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.664449 21746 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:35.669423 21000 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:35.672194 25911 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.675141 20999 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.678081 25939 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:35.678956 25939 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:35.679188 25676 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:35.680222 25939 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:35.680593 25939 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:35.681555 25939 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.683398 25939 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:35.684075 21180 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:35.690701 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.691431 21102 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:35.692219 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.697204 25699 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.699239 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:35.700629 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:35.699150 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:35.654378 25715 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.618276 25870 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.678212 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.675068 26001 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.715288 21000 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:35.718995 21077 leader_election.cc:400] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 7 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8.
I20260709 12:18:35.725910 25715 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.718989 25574 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.727571 26059 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.727485 25574 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.729929 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.727033 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.735278 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:35.742010 21111 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.745553 21185 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:35.748786 25574 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.757895 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:35.761091 21104 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:35.763043 21111 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:35.760195 26059 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:35.751470 26001 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:35.766872 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 88823.2us
I20260709 12:18:35.771533 25829 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:35.773672 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 64321.6us
I20260709 12:18:35.776913 26009 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:35.773145 21180 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.767462 26059 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.776808 21149 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:35.784255 26009 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:35.784654 26059 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.796244 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.786819 26009 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:35.799846 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.802781 26009 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.802601 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:35.823624 21033 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:35.824579 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:35.836890 21180 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
W20260709 12:18:35.838222 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 45947.7us
I20260709 12:18:35.814395 26059 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.859411 25825 consensus_queue.cc:1059] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:35.859361 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.869983 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:35.877203 25971 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:35.892876 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:35.892843 21742 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:35.896931 21739 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:35.895605 21712 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:35.895730 25894 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:35.901052 25894 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.904361 25894 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:35.905757 26016 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.906348 26016 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:35.910084 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 52508.6us
I20260709 12:18:35.913811 25855 raft_consensus.cc:2804] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:35.915181 25855 raft_consensus.cc:697] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 13 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:35.916375 25855 consensus_queue.cc:237] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.913367 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:35.924111 26016 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:35.924678 25901 consensus_queue.cc:1059] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:18:35.919234 25994 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.925886 25994 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.927357 26059 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:35.927995 25994 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.917707 26009 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:35.917137 26001 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:35.936023 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:35.937628 21739 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.939116 21179 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:35.943470 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:35.949913 25883 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.950053 20999 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:35.955205 25994 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:18:35.955902 26076 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:18:35.957221 25883 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.957634 21738 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:35.958487 25864 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:35.959210 21075 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:35.959725 25883 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:35.933110 25439 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:18:35.960320 25971 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:35.967218 25870 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.955170 25829 consensus_queue.cc:1059] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:18:35.961819 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:35.962227 26069 log.cc:927] Time spent T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 12:18:35.962425 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:35.964021 26074 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:35.967211 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:35.968394 25870 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:35.970744 21033 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:35.972065 25870 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:35.967788 25971 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.973284 25971 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:35.973460 21738 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 7.
I20260709 12:18:35.974151 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:35.974798 21106 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:35.974798 25864 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:35.986513 21075 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:36.017338 26070 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.255s	user 0.001s	sys 0.003s
I20260709 12:18:36.018329 25925 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.987210 25829 consensus_queue.cc:1243] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:18:36.021718 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:36.020387 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 43709.1us
I20260709 12:18:36.018527 21002 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:36.026589 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:36.030314 21709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:36.032438 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 79799us
I20260709 12:18:35.974990 25911 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:18:36.029678 25574 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:36.037055 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.036916 25947 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:36.046495 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:36.040282 25864 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:36.047056 25970 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:36.048163 25970 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:36.048539 25970 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:36.049119 25646 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:36.049489 25970 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:36.049955 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 74508us
I20260709 12:18:36.050657 21002 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:36.044946 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.035324 25901 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:36.052919 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.046818 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:36.053525 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:36.043577 26009 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:36.059270 26058 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:36.059815 26058 raft_consensus.cc:697] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:36.060158 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:36.060846 21738 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:36.061172 21111 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:36.061430 25726 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:36.063180 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:36.063803 21742 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:36.064095 25911 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.064817 21034 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:36.070401 21027 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:36.070586 21738 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:36.072461 25939 raft_consensus.cc:3055] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:36.072899 25939 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:36.073664 25901 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.019006 25925 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.073812 25939 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.074110 25482 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:36.043915 25947 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.064873 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:36.073114 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:36.054098 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:36.084379 21033 raft_consensus.cc:3060] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:36.064636 25911 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.045936 26001 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:36.083698 21032 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:36.070943 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.042179 25574 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.095070 25574 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.095507 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:36.096143 21186 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 8.
I20260709 12:18:36.096279 25911 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.097031 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:36.098949 26075 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:18:36.099403 21105 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:36.088145 21107 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:36.092561 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:36.093173 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.072818 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.099608 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:36.087495 21739 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:36.093690 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:36.110634 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 49708.9us
I20260709 12:18:36.114530 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:36.087208 25947 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.086807 25970 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.118371 25945 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:36.119724 25939 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.121559 21742 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:36.123638 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.121263 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.126930 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.060732 26058 consensus_queue.cc:237] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.129594 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:36.144543 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.125908 25945 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:36.148295 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 75691.4us
I20260709 12:18:36.151590 25925 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.153708 21033 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:36.155668 25901 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.164791 20999 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:36.170048 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:36.171401 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:36.169241 25894 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.174465 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:36.175078 21180 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:18:36.175916 25894 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:36.163679 25945 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.179751 21108 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:36.186198 25994 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:36.186964 25901 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.187467 25901 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.188103 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:36.189450 25901 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.196678 21186 raft_consensus.cc:2368] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:36.194900 26080 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:18:36.194826 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.197968 21185 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 16.
I20260709 12:18:36.178963 25866 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:36.195134 26016 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:18:36.224501 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:36.226783 21105 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:36.231590 26083 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.129s	user 0.002s	sys 0.003s
I20260709 12:18:36.231894 25850 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.232401 25850 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.238622 25967 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:36.239089 25967 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.239413 25967 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.240293 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:36.240923 21183 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:36.241899 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:36.244033 21108 raft_consensus.cc:3055] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:36.244390 21108 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:36.245153 21108 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.247761 26086 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:36.231107 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:36.223991 25901 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:36.252378 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:36.273260 20999 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:36.276103 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 90075.9us
I20260709 12:18:36.229005 26080 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:36.284829 21185 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:36.229599 26009 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:36.280828 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:36.263824 25715 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:36.226373 25971 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.309413 21110 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:36.230671 26058 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:36.328038 25825 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:36.332536 21104 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:18:36.332891 25894 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:36.309644 25715 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.335153 25856 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:36.275236 25901 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:36.285146 26080 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:36.234750 25850 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.336400 21000 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.363214 25715 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:36.365339 20999 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:36.278242 25945 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.372686 21106 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 12:18:36.376780 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:36.377748 21077 leader_election.cc:400] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
W20260709 12:18:36.406801 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 70474.8us
I20260709 12:18:36.381254 21108 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.407500 21077 leader_election.cc:403] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:36.384306 25971 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:36.384773 26058 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.412369 21149 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:36.416502 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:36.407291 21106 pending_rounds.cc:85] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 6
I20260709 12:18:36.366397 25894 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.417307 21106 pending_rounds.cc:107] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 12:18:36.421857 21106 raft_consensus.cc:2889] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:36.414618 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 52994.3us
I20260709 12:18:36.420436 21102 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:36.426759 21185 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:18:36.361133 25825 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:36.411652 26080 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:36.425546 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:36.420943 25829 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.424794 21109 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 15.
I20260709 12:18:36.428853 25870 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:36.362108 26009 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.434990 25947 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.436827 26009 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:36.436967 25947 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:36.437525 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 242795us
I20260709 12:18:36.441404 25829 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10.
I20260709 12:18:36.442178 21033 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:36.417186 26059 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:36.421571 25439 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:36.420442 26086 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:36.358171 25574 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.453032 25439 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.444952 25870 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:36.430953 25911 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:18:36.486197 26086 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.497562 21185 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:36.465479 26059 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:36.500502 26099 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:36.501137 25574 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:36.492600 26087 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:18:36.495093 25925 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.503364 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:36.504719 25870 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.505635 25911 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:36.441349 25825 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.506829 25859 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:18:36.508016 26086 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:36.509430 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:36.519702 26080 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.555912 21741 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.526199 25894 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:36.534795 26021 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:36.537667 25967 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.542098 21746 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.497360 25439 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.540612 26099 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.545233 25911 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:36.557092 25859 consensus_queue.cc:1243] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:36.569463 25825 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:36.566494 26021 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:36.495798 25901 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:36.583407 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 163988us
W20260709 12:18:36.584860 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 156426us
I20260709 12:18:36.572433 26099 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.556893 25726 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:18:36.575663 25925 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.590907 25925 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.592602 25859 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:36.599114 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:36.599840 21110 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:36.612839 26059 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.615319 21738 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:18:36.616284 26080 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.617269 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:36.617978 21178 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:36.617290 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:36.619139 21109 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.587685 25894 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:18:36.621596 21105 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:36.624434 21746 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:36.586408 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:36.625613 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 132255us
I20260709 12:18:36.626623 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.628042 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.628968 21108 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:18:36.630131 21111 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:18:36.631531 21741 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
W20260709 12:18:36.632186 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.632565 21075 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:36.590636 25856 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:36.633520 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:36.583586 26058 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.635670 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:36.635941 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:36.636415 21181 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 6.
I20260709 12:18:36.638170 21106 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:36.629336 21108 pending_rounds.cc:85] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 8
I20260709 12:18:36.642685 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:36.640643 21108 pending_rounds.cc:107] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:18:36.643385 21105 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.643435 21108 raft_consensus.cc:2889] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:36.642531 21712 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:36.637323 25970 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:36.641008 25894 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:36.645929 25970 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:36.646818 25970 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.633739 25945 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.648599 25901 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:36.649202 25911 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.649574 21109 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:36.650374 25911 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:36.651000 25866 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:36.653865 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.654953 21076 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.655360 25967 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.641718 26001 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.633196 26080 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:36.659142 25967 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:36.646186 21102 pending_rounds.cc:85] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 9
I20260709 12:18:36.660930 21102 pending_rounds.cc:107] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:18:36.644842 21075 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:36.658042 25866 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:36.655776 25971 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:36.656941 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:36.661152 21102 raft_consensus.cc:2889] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:36.664467 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.666347 21033 raft_consensus.cc:2393] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 7: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:36.668035 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.665371 25967 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:36.668689 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.668226 21149 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:36.675129 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.662693 25894 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:36.691607 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:36.664507 25855 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:36.699486 25855 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.699546 25967 raft_consensus.cc:697] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:36.700006 25855 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:36.700639 26014 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:18:36.656947 25439 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.700439 25859 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:36.731412 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:36.733398 21739 raft_consensus.cc:2368] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:36.734540 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:36.735358 21105 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:36.667230 26021 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.738607 26021 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.739835 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:36.740372 21184 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.746984 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:36.748464 25482 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:36.752638 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:36.753371 21177 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:36.753623 25858 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.754806 26009 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:36.700562 25967 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.757860 25439 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.733644 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:36.695703 26001 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:36.758786 21741 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.764777 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.765355 21029 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 7.
I20260709 12:18:36.769263 21746 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:36.769901 21179 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:36.779331 21184 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:36.781030 21031 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:18:36.787261 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:36.787755 21031 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.790287 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:36.791174 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.792511 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:36.791635 21034 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:36.803382 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:36.803987 21109 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.814177 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:36.808352 25859 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:18:36.810570 25939 consensus_meta.cc:287] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.001s
I20260709 12:18:36.827360 21741 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:36.839148 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:36.816855 25859 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.846796 21031 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:36.848155 21076 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.859884 21109 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:36.815068 25715 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.872135 21150 leader_election.cc:400] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:36.872464 21150 leader_election.cc:403] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:36.873102 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 100540us
I20260709 12:18:36.874293 26009 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:36.876305 21108 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:36.881659 25715 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.815169 25894 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.833681 25855 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.893720 26122 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:36.894445 26122 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:36.895344 26122 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.901160 25855 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:36.902679 21738 raft_consensus.cc:2368] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
I20260709 12:18:36.903627 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:36.904215 21111 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:36.911295 21111 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 17.
I20260709 12:18:36.913297 21034 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:36.906400 26099 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.931372 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:36.931953 21034 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.933643 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:36.938876 21181 raft_consensus.cc:606] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:36.951570 21107 raft_consensus.cc:2368] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14.
I20260709 12:18:36.958946 26116 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:36.959476 26116 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:36.960498 26111 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:36.961005 26111 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:36.963276 26111 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:36.974186 21034 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:37.015527 26099 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:37.029027 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:37.029975 21184 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:37.019701 26086 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.031915 26086 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:37.034124 26086 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:37.034792 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:37.035386 21179 raft_consensus.cc:3060] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.038885 21184 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 17.
I20260709 12:18:37.039542 26009 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:37.040267 26116 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:37.051188 21179 raft_consensus.cc:2468] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
W20260709 12:18:37.052436 26120 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:18:37.055208 26086 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:37.055771 26086 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:37.058099 26086 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:37.083276 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:37.084123 21712 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:37.085258 26098 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:37.085731 26098 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 17 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:37.086576 26098 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:37.087780 26087 raft_consensus.cc:2804] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:37.088284 26087 raft_consensus.cc:697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:37.089123 26087 consensus_queue.cc:237] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:37.091418 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:37.093228 26096 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.599s	user 0.001s	sys 0.001s
I20260709 12:18:37.094250 26086 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:37.112941 21150 leader_election.cc:400] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
I20260709 12:18:37.113240 21150 leader_election.cc:403] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:37.113715 26009 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 7. Current term is 8.
I20260709 12:18:37.116547 21742 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:37.117537 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:37.123590 26126 log.cc:927] Time spent T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 12:18:37.134546 26124 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 12:18:37.139899 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:37.140463 21180 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:37.140978 25825 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.141466 25825 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:37.144330 21002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.149655 26105 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:37.150162 26105 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:37.151396 26123 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:37.151897 26123 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:37.152565 21180 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:37.152863 26105 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:37.153985 26123 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:37.155375 25825 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:37.163017 26116 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:37.172852 26086 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:37.182317 21036 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:18:37.184450 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:37.185061 21036 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:37.186810 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:37.187268 21036 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:37.187409 21029 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:37.240762 26107 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:37.241318 26107 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:37.242087 26109 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:37.242612 26109 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:37.243366 26107 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:37.244625 26109 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:37.254557 26118 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.384s	user 0.003s	sys 0.000s
I20260709 12:18:37.266741 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:37.269362 21029 raft_consensus.cc:2393] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:37.286422 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:37.289431 21002 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:18:37.384418 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 95060.4us
W20260709 12:18:37.584124 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 286320us
W20260709 12:18:37.633265 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 48386.8us
W20260709 12:18:37.681300 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 531048us
I20260709 12:18:37.294727 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:37.754761 21029 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:18:37.774641 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 140672us
I20260709 12:18:37.776995 26107 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:18:37.813055 20919 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aaaf493e892d4ee9839b45b601fc8400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:18:37.844038 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 458901us
W20260709 12:18:37.850821 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 75429.1us
I20260709 12:18:37.857405 25939 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:37.857999 25939 raft_consensus.cc:697] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:37.858966 25939 consensus_queue.cc:237] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:37.867324 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 185247us
I20260709 12:18:37.903043 26107 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:37.903669 26107 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:37.905761 26107 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:37.934926 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 89580.7us
I20260709 12:18:37.936340 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:37.938047 21029 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
W20260709 12:18:37.938570 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 86976.4us
I20260709 12:18:37.940466 20999 leader_election.cc:400] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14.
I20260709 12:18:37.940754 20999 leader_election.cc:403] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:37.984270 26107 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.984824 26107 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:37.991849 21034 raft_consensus.cc:1275] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:37.978670 26103 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:38.022149 26103 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:38.024730 26103 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:38.079631 26107 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.265758 26107 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:38.266291 26107 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:38.167580 26103 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.267095 26103 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:38.269223 26103 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:38.363054 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 420984us
I20260709 12:18:38.395274 25939 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:38.396903 25939 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14.
I20260709 12:18:38.397559 25939 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.397994 25939 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.411741 26107 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.705730 25939 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.706338 25939 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:38.706797 25939 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.708737 25939 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.709960 25939 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.710392 25939 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.671059 26087 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:38.711300 26087 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:38.712304 25939 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.713398 26087 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.713601 25939 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.714092 25939 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.714687 26086 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:18:38.728300 26086 consensus_queue.cc:1243] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer 3ed9deaeb4014e9d87aeebbc6384f81f log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:38.733346 26086 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:38.733829 26086 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.734560 26087 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:38.735109 26087 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:38.735878 25939 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.736369 25939 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:38.736805 25939 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.737022 26087 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.748386 26086 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:38.748937 26086 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:38.749363 26086 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.753084 25825 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:38.753597 25825 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.755519 25825 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.755962 25825 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:38.756386 25825 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.758173 25825 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.758630 25825 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.760574 25825 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.786018 26087 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.786592 26087 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:38.788813 25894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.537s	user 0.018s	sys 0.020s
I20260709 12:18:38.789151 26087 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:38.789165 25894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.538s	user 0.018s	sys 0.020s
I20260709 12:18:38.816321 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2776) took 1015 ms. Trace:
I20260709 12:18:38.880266 25939 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.880877 25939 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:38.881333 25939 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.886884 21179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2779) took 1091 ms. Trace:
I20260709 12:18:38.887245 21179 rpcz_store.cc:276] 0709 12:18:37.795654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.886106 (+1090452us) service_pool.cc:224] Handling call
0709 12:18:38.886411 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.886579 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:38.886605 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.886643 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:38.886671 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.886717 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.886814 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:38.889343 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2778) took 1093 ms. Trace:
I20260709 12:18:38.889688 21178 rpcz_store.cc:276] 0709 12:18:37.795417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.888600 (+1093183us) service_pool.cc:224] Handling call
0709 12:18:38.888883 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.889047 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:38.889072 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.889109 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:38.889144 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.889188 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.889281 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:38.852456 21181 rpcz_store.cc:276] 0709 12:18:37.794879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.805890 (+1011011us) service_pool.cc:224] Handling call
0709 12:18:38.807577 (+  1687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.808698 (+  1121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:38.808779 (+    81us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.809003 (+   224us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:38.809157 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.809523 (+   366us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.810056 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:38.905668 26086 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:38.952984 26107 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.953564 26107 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:38.955399 25939 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.956785 25939 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:38.870378 25825 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.956856 26107 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:38.959165 25825 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:38.959632 25825 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:38.957239 25939 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:38.986527 25939 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:38.989225 26107 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.034480 26107 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.037338 26107 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.037817 26107 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:39.038239 26107 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.042402 26107 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.017521 25825 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:39.044804 21000 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.4:35157 timed out after 1.599s (SENT) [suppressed 6 similar messages]
I20260709 12:18:39.034391 25939 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:39.048396 25939 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.050321 25939 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.135931 25894 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.136538 25894 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.137532 26086 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.138077 26086 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.140036 26086 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:39.140166 25894 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:39.145388 25894 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.147279 25894 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.155611 26086 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:39.156085 26086 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.157972 25894 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:39.163451 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:39.164011 21186 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:39.171329 21151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.040s
W20260709 12:18:39.171645 21151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.002s	sys 0.040s
I20260709 12:18:39.186424 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:39.187129 25894 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.187213 21151 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:39.187668 25894 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.189967 25894 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.190447 25894 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:39.192132 26107 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.192617 26107 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.194482 26107 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.190757 25894 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.205847 25894 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:39.205253 21186 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
W20260709 12:18:39.208070 21186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2780) took 1412 ms (client timeout 1653 ms). Trace:
W20260709 12:18:39.218431 21186 rpcz_store.cc:269] 0709 12:18:37.795917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.163170 (+1367253us) service_pool.cc:224] Handling call
0709 12:18:39.208012 (+ 44842us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:39.223307 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 178522us
I20260709 12:18:39.247776 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:39.278452 21738 raft_consensus.cc:2368] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12.
W20260709 12:18:39.301915 21738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33006 (request call id 687) took 2037 ms (client timeout 1599 ms). Trace:
I20260709 12:18:39.223562 26107 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:39.302309 21738 rpcz_store.cc:269] 0709 12:18:37.248233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.251920 (+  3687us) service_pool.cc:224] Handling call
0709 12:18:39.285804 (+2033884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:39.312177 21077 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:39.250212 25829 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.315622 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.231717 25947 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:39.249107 26122 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:39.250046 25574 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:39.352073 21034 pending_rounds.cc:85] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 5
I20260709 12:18:39.325431 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.249284 26111 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:39.250916 26080 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:39.251080 26001 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.315829 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.273296 26021 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.274324 25971 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.323503 21027 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:39.351812 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.280405 26116 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:39.304672 25939 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:39.352409 21034 pending_rounds.cc:107] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:18:39.361647 21029 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:18:39.232530 26106 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:18:39.371361 21036 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:39.311182 25970 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.353361 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.390802 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.341899 25947 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.394352 21029 pending_rounds.cc:85] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 8
I20260709 12:18:39.346771 25901 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.394151 21034 raft_consensus.cc:2889] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.405577 21029 pending_rounds.cc:107] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:18:39.411789 21029 raft_consensus.cc:2889] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.390398 26001 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.395412 25971 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.438629 26001 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.346916 25829 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.438990 25971 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.417392 25956 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.439688 25956 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.440486 25829 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.370721 25574 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.391264 26080 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.346499 26107 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.413130 26086 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.454067 25956 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.409999 25947 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:39.497376 26109 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:39.362063 26122 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.440676 26108 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:39.486992 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 186946us
I20260709 12:18:39.490549 25574 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.425586 25970 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.418515 25901 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.399827 25939 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.492786 25704 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.454150 26001 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:39.475495 25829 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.475291 25971 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.496418 26107 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.568813 26105 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:39.569581 26122 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.569342 26105 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.570053 25704 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.496863 26086 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.390502 26021 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.432260 26087 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:39.396003 26116 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.585098 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:39.585691 21742 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 8.
I20260709 12:18:39.503844 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 2304) took 2458 ms. Trace:
I20260709 12:18:39.375681 26111 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.519681 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:39.497902 26109 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.533960 25482 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.543795 26128 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:39.544037 25970 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.545604 25901 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.554486 25939 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.554625 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.577327 25971 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.571910 25829 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.555087 25994 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:39.615075 21742 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:39.615113 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:39.607321 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 87766.2us
I20260709 12:18:39.664999 21738 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:39.577397 26001 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:39.668172 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:39.578112 26080 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.541041 26108 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.665738 21151 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:39.593083 25704 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:39.648090 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 1.6768e+06us
I20260709 12:18:39.685930 21036 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:39.633347 26128 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.605226 21104 rpcz_store.cc:276] 0709 12:18:37.226497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.226628 (+   131us) service_pool.cc:224] Handling call
0709 12:18:37.228527 (+  1899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.228699 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:37.229198 (+   499us) log.cc:844] Serialized 14 byte log entry
0709 12:18:37.872693 (+643495us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.474801 (+1602108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:39.474867 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:39.478109 (+  3242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.478482 (+   373us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.478985 (+   503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1870197,"prepare.queue_time_us":894595,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":3549759,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":13880,"thread_start_us":410720,"threads_started":3}
I20260709 12:18:39.693578 21035 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.694041 26109 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.695410 21033 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:39.695705 25971 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.696218 25971 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:39.696692 25971 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.697526 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.729696 26166 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.730042 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.730203 26166 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.727463 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.731594 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.732302 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.733686 26191 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.747902 21035 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:39.641755 25482 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.732008 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.730614 21102 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 16.
I20260709 12:18:39.733357 26105 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.601524 26086 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.607254 26087 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.743217 21106 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:39.747383 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.758618 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.742825 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.770260 21110 raft_consensus.cc:2410] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:18:39.775152 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.774880 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.768244 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.782303 21105 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:39.751888 26122 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.693621 26108 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.777165 21103 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:39.784693 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.792299 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:39.793058 21074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.023s	sys 0.029s
W20260709 12:18:39.793910 21074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.023s	sys 0.029s
I20260709 12:18:39.795123 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.796422 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:39.797609 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 485477us
I20260709 12:18:39.801134 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.675699 25994 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.670081 25894 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.810670 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.811244 26181 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:39.802368 26105 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:39.806367 26108 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.812484 26189 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:39.769594 26106 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:39.824443 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.818261 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:39.797582 26145 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:18:39.827032 21031 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:39.768258 26183 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.820631 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.785205 26153 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.823388 21104 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:39.824095 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.828064 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:39.826581 21133 debug-util.cc:398] Leaking SignalData structure 0x7b08003000c0 after lost signal to thread 19891
I20260709 12:18:39.829805 21178 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: []
W20260709 12:18:39.821980 21076 connection.cc:256] RPC call timeout handler was delayed by -1.179785407000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 12:18:39.831501 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.831663 25970 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.759011 26191 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.844233 21035 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:39.844419 21033 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
W20260709 12:18:39.872025 21133 debug-util.cc:398] Leaking SignalData structure 0x7b080016eba0 after lost signal to thread 20968
I20260709 12:18:39.866060 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:39.873245 21133 debug-util.cc:398] Leaking SignalData structure 0x7b080016ece0 after lost signal to thread 21060
W20260709 12:18:39.874372 21133 debug-util.cc:398] Leaking SignalData structure 0x7b0800087e40 after lost signal to thread 21136
W20260709 12:18:39.874678 21133 debug-util.cc:398] Leaking SignalData structure 0x7b0800087e20 after lost signal to thread 21137
I20260709 12:18:39.844586 21110 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:39.873185 21028 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:39.879081 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.866456 25829 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.892064 21036 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:39.892994 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.819834 26105 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:39.806167 26122 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.886696 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:39.868369 25994 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.829487 26128 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:39.867599 26116 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.866246 25971 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:39.896512 21133 debug-util.cc:398] Leaking SignalData structure 0x7b0800373ae0 after lost signal to thread 21211
W20260709 12:18:39.918483 21133 debug-util.cc:398] Leaking SignalData structure 0x7b080038ae20 after lost signal to thread 21212
I20260709 12:18:39.919037 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.868753 25947 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.893580 21104 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:39.878471 25901 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:39.693751 26080 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:39.867092 26111 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:39.899943 21033 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:39.823827 26181 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.892449 26087 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.831825 26182 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:39.879956 26177 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:39.829309 26108 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.892508 26173 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:39.919606 21133 debug-util.cc:398] Leaking SignalData structure 0x7b08001d19c0 after lost signal to thread 21771
W20260709 12:18:39.897430 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 231736us
I20260709 12:18:39.866545 25970 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.901018 26105 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:39.899843 25574 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.900676 26166 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.117177 26197 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.902362 26021 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:39.901393 26190 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:39.831288 26189 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.118944 25574 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.834304 26106 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:39.905005 25894 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:39.830508 26001 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:39.911311 26009 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:39.922724 25994 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:40.085287 25825 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.170047 25970 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:40.054090 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 146722us
I20260709 12:18:39.935580 26086 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:40.086263 21133 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9e80 after lost signal to thread 21772
W20260709 12:18:40.175426 21133 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6260 after lost signal to thread 25646
W20260709 12:18:40.176697 21133 debug-util.cc:398] Leaking SignalData structure 0x7b0800388720 after lost signal to thread 26085
I20260709 12:18:40.111565 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.115341 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.116003 26191 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.116276 25947 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.119851 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:39.881747 26153 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.127298 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.041074 26087 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.174888 26009 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.166890 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.193537 26087 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:40.173789 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 88461.8us
I20260709 12:18:39.935207 26080 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.117661 26166 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.120102 26189 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.128010 26111 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.183790 21103 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 14: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:39.868808 26183 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.119379 25482 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.176904 21076 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.187278 21110 raft_consensus.cc:2410] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:40.118122 26190 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.183614 25956 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:18:40.214574 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.117720 26197 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.184752 25994 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.201606 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.201604 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.205264 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.222967 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.206297 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:40.170416 25825 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.074894 26182 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.199389 25894 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.120529 25901 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.208508 21102 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:18:40.040740 26193 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.220976 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.220436 21181 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:40.086043 26177 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.221309 21106 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:40.199594 26176 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:40.224257 21029 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.234805 21105 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:40.235146 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.224802 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.236388 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:40.237130 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.209160 21076 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.228286 21181 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:40.228345 21027 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:40.222653 26014 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:40.188372 25866 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:18:40.193940 21108 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:40.107969 26173 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.221909 25482 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.246486 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.239503 21181 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.247618 21181 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.244046 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.240499 21033 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:40.239238 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.249011 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.222939 26191 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:18:40.249589 26009 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.249847 26151 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:18:40.250564 26108 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.250789 26021 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:40.251102 26203 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.240212 26193 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.251667 26203 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.253264 26193 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.253676 26203 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.254164 21035 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:40.255136 26087 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.239774 26014 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.256316 26014 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:40.257431 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.214533 26111 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.247076 21027 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:40.248225 21104 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:40.260390 21103 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:18:40.220395 26086 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:40.261891 21107 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:40.260350 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.224826 26192 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:40.205178 26166 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.272138 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.266459 21029 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:40.269495 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.270052 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.274219 21028 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:40.237951 26188 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:40.275991 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.278165 21178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2782) took 1032 ms. Trace:
I20260709 12:18:40.278497 21178 rpcz_store.cc:276] 0709 12:18:39.245326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.249447 (+  4121us) service_pool.cc:224] Handling call
0709 12:18:39.249735 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:39.878206 (+628471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.277963 (+399757us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b540024e0d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:40.278120 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329293184}
I20260709 12:18:40.278945 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.279433 21179 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:40.275050 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.280679 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.281816 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:40.271657 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.251360 26200 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:40.283157 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.290674 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.260519 26021 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.267370 26156 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.288131 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.267786 25866 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:40.288545 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.275851 26122 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.272854 26189 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.234411 25894 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.274019 26192 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:40.336970 21738 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:40.276644 25947 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.282411 26161 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.288116 26194 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:40.339779 26197 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.339919 26186 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:40.340408 26198 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:40.340608 25574 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.341025 26181 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:40.341367 26195 log.cc:927] Time spent T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:18:40.274148 26152 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:40.266932 25482 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.330945 26021 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.243434 26176 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.500288 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.495590 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.511005 21184 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:40.511113 21746 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:40.495744 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:40.502662 21711 connection.cc:256] RPC call timeout handler was delayed by -1.0938919059999535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 12:18:40.504303 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.493508 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.347613 26009 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.347152 26108 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:40.363298 26194 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.514724 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.349656 26192 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.270560 26086 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.519287 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.512447 21177 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:40.407688 26186 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.363780 26158 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.328698 26188 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.355897 26189 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.503436 26152 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:40.532436 21741 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:18:40.501547 26179 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.495604 26191 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.342234 26156 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.367944 26161 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.527315 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.504055 26196 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.359036 25947 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.519894 21184 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:40.497843 25994 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.519894 26108 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.530664 26186 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:40.358326 26200 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.517097 26194 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.527290 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.540920 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.551885 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.552433 21184 raft_consensus.cc:2410] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:18:40.501402 26199 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.554139 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.544562 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.532334 26080 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.536193 26152 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.517715 26009 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.498526 26198 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.554303 21110 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:40.558540 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.558827 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 1988) took 1241 ms. Trace:
I20260709 12:18:40.541405 26106 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.561556 21180 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:40.562151 26173 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.562513 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.563097 21180 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:40.563899 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.564302 26198 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.564865 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.565883 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.566380 21180 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:40.559499 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.551493 26183 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.571094 21184 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:40.520455 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.552834 26190 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.575021 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.561508 21034 rpcz_store.cc:276] 0709 12:18:39.314962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.315079 (+   117us) service_pool.cc:224] Handling call
0709 12:18:39.351878 (+ 36799us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:39.431380 (+ 79502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.431409 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:39.455061 (+ 23652us) log.cc:844] Serialized 52 byte log entry
0709 12:18:39.791548 (+336487us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:39.919452 (+127904us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.924835 (+  5383us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.926701 (+  1866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.926767 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.556648 (+629881us) raft_consensus.cc:1685] finished
0709 12:18:40.556668 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.556779 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116039,"prepare.queue_time_us":773866,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":33900,"raft.run_cpu_time_us":13812,"raft.run_wall_time_us":161604,"spinlock_wait_cycles":23256960,"thread_start_us":435714,"threads_started":2,"wal-append.queue_time_us":444995}
I20260709 12:18:40.556022 26166 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.574015 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.573745 21177 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:40.532333 26158 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.575632 21180 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:40.539772 26179 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.589342 21181 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:18:40.589733 21181 pending_rounds.cc:85] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 7
I20260709 12:18:40.590005 21181 pending_rounds.cc:107] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:18:40.590301 21181 raft_consensus.cc:2889] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:40.544559 26196 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.551052 26177 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.544016 26191 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.598145 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.599146 21183 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:40.593070 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.587327 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.594762 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2783) took 1328 ms. Trace:
I20260709 12:18:40.574651 26182 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.610381 21181 rpcz_store.cc:276] 0709 12:18:39.264029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.264172 (+   143us) service_pool.cc:224] Handling call
0709 12:18:39.264442 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:40.210592 (+946150us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b540021d7a0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f90bdc0 00007fcb9f9961c0 00007fcb9f997231 00007fcb9f993d8f 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c
0709 12:18:40.592421 (+381829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.592581 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140269312}
I20260709 12:18:40.573282 26199 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:40.615346 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:40.616110 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 284052us
I20260709 12:18:40.616288 21180 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:40.592682 26105 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.603507 25894 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.617080 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.623051 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.623675 21184 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:40.624514 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.625092 21184 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:40.625854 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.621438 20999 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.627108 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.627303 25994 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:40.627666 25994 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.627988 25994 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:40.632071 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.631691 20999 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.633834 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.635100 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.636257 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.637877 21178 raft_consensus.cc:1240] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:40.637429 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 104588us
I20260709 12:18:40.636871 21177 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
W20260709 12:18:40.620512 26155 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:18:40.641026 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.642817 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.620680 26166 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.634181 26177 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:40.644425 21177 raft_consensus.cc:2410] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:40.633400 26188 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.649909 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.651458 21180 raft_consensus.cc:2393] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 14: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:40.652252 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.653329 26193 consensus_queue.cc:1048] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:40.649729 26166 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:40.656147 26164 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:18:40.657841 26166 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.647054 26177 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.658675 26177 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:40.658958 26207 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:40.659402 26207 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.659698 26207 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:40.660938 26156 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.662086 26179 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.663429 26191 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.645421 26189 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.643750 26086 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.663882 26105 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.664799 26199 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.665781 26108 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.667515 21184 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:40.669718 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.670068 26158 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.671105 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45970 (request call id 711) took 3659 ms. Trace:
I20260709 12:18:40.672405 26200 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.671458 21109 rpcz_store.cc:276] 0709 12:18:37.011649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.011907 (+   258us) service_pool.cc:224] Handling call
0709 12:18:37.020606 (+  8699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:37.754426 (+733820us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:37.754819 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.396939 (+1642120us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.397082 (+   143us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.438127 (+ 41045us) log.cc:844] Serialized 26 byte log entry
0709 12:18:39.438254 (+   127us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:39.438285 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.438347 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.670902 (+1232555us) raft_consensus.cc:1685] finished
0709 12:18:40.670923 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.671050 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2927525,"prepare.queue_time_us":1089011,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":17460,"raft.queue_time_us":2295934,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":9235,"thread_start_us":240180,"threads_started":2,"wal-append.queue_time_us":2520412}
I20260709 12:18:40.673368 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.670778 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.676435 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.652992 21177 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:18:40.677088 21184 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:40.677592 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.679176 21177 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:40.675215 21077 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:40.680100 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.684216 26122 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:40.684614 26122 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.684962 26122 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:40.685602 26176 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.686091 25883 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:18:40.686949 25883 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:40.687291 25883 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:40.648957 25482 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.688058 25883 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.689241 25883 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.691145 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.691447 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.692528 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.693060 21103 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:40.693783 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.697692 26122 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.699084 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.703733 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.704252 21180 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:40.705040 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.705569 21180 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:40.707283 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.707617 25901 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.708249 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.708783 21184 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:40.709524 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.710011 21184 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:40.710537 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.776029 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.738361 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.694793 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.756388 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.749285 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.793964 21746 raft_consensus.cc:2410] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:18:40.747967 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.650208 25947 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.735141 25866 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:40.864128 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.864574 25866 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:40.765244 26194 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.865300 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.725126 26111 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.866418 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.711094 26161 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.867755 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.736570 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.868901 21179 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:40.721786 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:40.869689 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:40.869947 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 148240us
I20260709 12:18:40.710783 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.870918 21184 raft_consensus.cc:2410] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:40.863885 21739 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 8.
I20260709 12:18:40.711293 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.872561 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.872813 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.739171 21031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60004 (request call id 1995) took 1204 ms. Trace:
I20260709 12:18:40.873139 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.873895 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.872809 21180 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:40.875679 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.876106 21109 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:40.760728 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.782634 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:18:40.890930 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 108352us
I20260709 12:18:40.753063 26009 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.719589 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.892074 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.861637 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.733546 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.862653 21150 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:40.737928 21077 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:40.752100 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.877965 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.862159 26182 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.871485 25967 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.712668 25994 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.763968 26177 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.887264 26183 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:40.740906 26152 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.923864 25994 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.924646 26152 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.921092 25967 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.887923 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.926203 26177 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.926416 25967 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.888861 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.888715 26111 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:40.889333 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.889652 26122 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:40.712754 26162 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.801s	user 0.005s	sys 0.006s
I20260709 12:18:40.781555 26180 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.737656 26185 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
I20260709 12:18:40.712212 26196 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:40.898099 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 160222us
I20260709 12:18:40.877758 26194 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.935811 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.898705 21741 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:40.873656 21031 rpcz_store.cc:276] 0709 12:18:39.539433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.554370 (+ 14937us) service_pool.cc:224] Handling call
0709 12:18:40.738990 (+1184620us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000622d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:40.739089 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444049792}
I20260709 12:18:40.892124 21151 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:40.935619 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:40.937415 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45350.6us
I20260709 12:18:40.938030 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:40.938458 21104 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:40.870998 21075 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:40.890762 21185 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
W20260709 12:18:40.912539 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 49961.4us
I20260709 12:18:40.912397 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.746207 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.911566 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.939529 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.941087 21186 raft_consensus.cc:2410] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:40.941459 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:40.718359 26186 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.917462 26182 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.942809 21109 raft_consensus.cc:2368] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:40.691108 26014 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.944646 21108 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:40.744136 26192 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.944090 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.945864 21109 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:18:40.946148 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:40.946669 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.940555 26009 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:40.947067 21181 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:40.949579 21150 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:40.902832 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.918262 21106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56400 (request call id 2175) took 1171 ms. Trace:
I20260709 12:18:40.918566 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.918787 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.919499 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.741940 25825 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:40.921950 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.954138 21110 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:40.920148 25482 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:40.955862 25482 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.956255 25482 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:40.922884 26183 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:40.890544 26153 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.947625 25967 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:40.960188 25967 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.959055 26183 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:40.961020 21178 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:40.944700 26108 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:18:40.963140 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.964212 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:40.964628 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.965340 21186 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:40.965643 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.971287 26192 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:40.971912 26192 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:40.972255 26192 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.931551 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.917219 25947 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:40.972827 25947 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:40.912077 25883 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:40.972918 21184 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:40.975854 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.934562 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.951752 21177 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:40.966636 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:40.952533 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 81609.2us
I20260709 12:18:40.951725 21106 rpcz_store.cc:276] 0709 12:18:39.730626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.770092 (+ 39466us) service_pool.cc:224] Handling call
0709 12:18:40.902242 (+1132150us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400229a54. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:40.902379 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975641472}
I20260709 12:18:40.954504 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.946920 26209 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:40.982146 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.987813 21105 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:40.955351 21103 raft_consensus.cc:2368] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15.
I20260709 12:18:40.959210 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.988451 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:40.717821 26021 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.988657 21712 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:40.973919 25967 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.975057 26189 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:40.944124 26182 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.996039 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.965247 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.996860 21103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c68b72acae564588a3a276b7b233d977"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:40.973388 25883 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:41.001523 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.936486 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.989269 21075 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:41.003425 26194 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:41.003829 26194 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:41.004173 26194 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:40.972625 26192 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:40.976708 21077 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.989537 21107 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:18:40.992389 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.010710 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.011116 21181 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:41.011478 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:40.959017 26122 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:40.993294 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:40.894835 26207 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:40.991058 26152 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:41.018911 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.019276 21108 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:41.019937 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:40.994180 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:40.974931 26183 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.031246 21739 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:40.990939 26209 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:41.031780 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.032644 21109 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:40.932282 20932 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:40.997466 21110 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:40.997562 21103 raft_consensus.cc:606] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:40.987124 26009 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:40.998402 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:40.999768 26014 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:40.990701 25947 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:41.010032 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:41.041605 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:41.042431 21077 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:40.988078 21185 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:41.019390 26111 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:41.052304 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:41.034235 21103 raft_consensus.cc:614] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:41.020663 21177 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:41.035161 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:41.054328 21177 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:41.002642 25883 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.000782 26204 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:40.951059 26180 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.039570 21180 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:41.039650 21102 raft_consensus.cc:2410] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:41.039971 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:41.013815 21111 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:41.013805 21709 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.046031 21181 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:41.010622 26189 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:41.039631 26209 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.013491 26122 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:41.030880 26152 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:41.032001 26186 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.060659 21077 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:41.072734 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 422979us
I20260709 12:18:41.057439 26153 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:41.124357 21738 raft_consensus.cc:2410] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 15 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:18:41.049758 26182 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:18:41.083833 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 70097.4us
W20260709 12:18:41.140703 21029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.006s	sys 0.018s
W20260709 12:18:41.153457 21029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.006s	sys 0.019s
W20260709 12:18:41.141291 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 497394us
I20260709 12:18:41.056097 26111 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:41.061889 26099 consensus_queue.cc:1059] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:18:41.143357 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.061031 26204 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:41.077908 26122 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:41.073149 26152 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:41.157750 21002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.007s	sys 0.018s
W20260709 12:18:41.159934 21002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.007s	sys 0.018s
I20260709 12:18:41.161490 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:41.153883 21709 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.082899 25971 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:41.072503 26185 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:41.163458 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:41.057174 25829 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:18:41.125313 26193 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:41.162110 21185 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:41.167100 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.169021 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:41.142575 26153 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.172852 26153 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.173652 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.174191 21180 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:41.168678 20999 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:41.156488 26182 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.158059 26111 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:41.172281 21002 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.125187 26087 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:18:41.159236 26204 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.180634 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:41.111419 26190 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:18:41.164324 26185 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:41.187412 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.191653 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:41.191812 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 448701us
W20260709 12:18:41.192588 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.195115 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.177666 26199 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:41.202090 20999 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:41.181207 26108 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:41.211443 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.212287 21002 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.215932 21180 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:41.209365 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.216828 21738 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:41.203440 25901 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:41.218704 25901 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:41.219588 25901 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.220656 25901 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:41.228971 26196 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:41.164408 26009 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.186131 26208 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:41.237231 26208 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:41.237622 26208 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.238924 26021 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.183353 25971 raft_consensus.cc:3055] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:41.239856 25971 raft_consensus.cc:740] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:41.240697 25971 consensus_queue.cc:260] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.241899 25971 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:41.204603 25825 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.243736 26189 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.178171 26128 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:18:41.173892 26116 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:18:41.202881 25482 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.181208 26182 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:41.252717 21179 raft_consensus.cc:2393] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:41.249470 26207 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:41.266558 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 54341.9us
I20260709 12:18:41.251739 26165 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:41.269011 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.193635 26185 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:41.273495 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 62109.1us
I20260709 12:18:41.244400 26108 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:41.276926 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.274742 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.249035 26180 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.205473 26199 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:41.269796 25911 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.282238 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.282264 21747 raft_consensus.cc:2368] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12.
I20260709 12:18:41.243376 26183 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.286465 21178 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:41.275439 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:41.268088 26213 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:41.292740 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.319032 26213 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:41.299536 25866 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.319516 26213 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.321049 21105 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:41.286415 26116 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.322249 25866 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.323495 26153 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.324962 25967 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.325588 26153 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.327685 26194 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.329634 26194 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.272863 26165 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:41.335165 21000 leader_election.cc:336] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Timed out: RequestConsensusVote RPC to 127.19.108.4:35157 timed out after 1.599s (SENT)
I20260709 12:18:41.335646 21000 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.335997 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.337220 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.339196 25994 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:41.339375 26207 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:41.339664 25994 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.340796 25994 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.341084 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.342221 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.342803 25883 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.344815 25883 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:41.345384 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 57795us
I20260709 12:18:41.347548 25994 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.349372 25994 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.285970 26199 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.355930 25947 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.357439 21184 raft_consensus.cc:2410] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:18:41.357935 25947 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:41.279474 26108 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:41.359696 26122 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.361326 26111 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.305297 26192 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:41.339211 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 46836us
I20260709 12:18:41.343349 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.363577 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.364780 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:41.362788 25482 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.379086 26207 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:41.378557 21000 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Timed out: RequestConsensusVote RPC to 127.19.108.4:35157 timed out after 1.630s (SENT)
I20260709 12:18:41.379626 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:41.380215 21000 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.335098 26165 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:41.388334 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:41.389227 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:41.395224 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:41.395862 21109 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:41.398622 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:41.397547 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:41.400702 21103 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:41.397954 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:41.402181 21111 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.399794 21000 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:41.406277 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:41.408366 21106 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 17: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:41.373574 25967 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.411389 21103 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:18:41.410666 21108 raft_consensus.cc:1240] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 17. Current term is 18. Ops: []
W20260709 12:18:41.423470 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 59977.2us
I20260709 12:18:41.425604 26213 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.384394 26207 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:41.442260 21109 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:41.447424 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.397235 26177 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:41.453969 21002 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.401417 26214 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:41.460124 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 259743us
I20260709 12:18:41.406814 25911 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:41.363929 26182 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.397095 26208 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.499462 21149 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.504907 21111 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 16.
I20260709 12:18:41.449326 26207 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:41.508373 25482 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.512910 26185 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.513865 26108 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.509714 26192 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.455823 26177 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:41.515123 26207 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.514882 26165 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.502099 26205 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:41.502336 20932 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 9 to 12, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 12 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:41.516332 26205 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.516731 26205 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:41.516891 26165 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.506091 26116 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:41.510804 26209 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.511230 26152 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.502719 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:41.518208 20932 catalog_manager.cc:5697] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:41.521627 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:41.506147 26214 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:41.510511 26199 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.540696 21107 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 16. Current term is 17. Ops: []
W20260709 12:18:41.536368 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 382504us
I20260709 12:18:41.538178 21186 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:41.540987 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:41.521150 26177 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.538967 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:41.519975 26122 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.548517 21709 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.550580 21709 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:41.551919 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:41.561107 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:41.562204 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:41.568466 21179 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:41.564097 26173 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:41.538928 26214 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:41.539499 26185 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.577821 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:41.582090 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:18:41.583050 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 504299us
I20260709 12:18:41.560437 26193 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:41.565171 26111 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:41.595268 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 95833.3us
I20260709 12:18:41.598323 21077 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:41.604707 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.610414 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 210692us
I20260709 12:18:41.613590 21149 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.582377 26182 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.613188 21077 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:41.617306 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 163419us
I20260709 12:18:41.588234 26173 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.602569 26128 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:41.621515 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.602756 26214 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:41.624893 21149 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:41.625799 21002 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.629385 21149 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.629961 21002 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.630774 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:41.635746 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.630489 21149 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.628976 21077 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:41.639442 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.644855 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:41.644627 21002 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.645726 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.644786 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:41.649236 21149 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.652141 21000 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.655330 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.653141 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.653999 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.654117 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.615700 26196 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:18:41.659229 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:41.626444 26173 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:41.622040 26228 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:41.654692 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.638866 26122 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:41.626581 26128 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:41.660233 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:41.661185 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:41.662098 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.660432 21000 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.638638 26116 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.671495 21186 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.657289 21036 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:41.638648 26165 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:41.687892 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.672874 21076 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:41.656185 25947 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:41.618686 26176 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 12:18:41.673696 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.697124 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.642277 26111 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:41.628165 26227 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:41.671216 26228 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.647964 26192 raft_consensus.cc:2764] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:18:41.684535 21030 raft_consensus.cc:1275] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:41.644351 25825 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:41.658097 26194 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.658222 26219 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:41.672890 26200 consensus_queue.cc:1059] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:18:41.687350 26128 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.688557 21029 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:41.697396 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.685328 26167 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:41.658810 26213 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.672111 26153 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:41.658336 26221 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:41.709957 26209 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.814590 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.702922 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.711380 26111 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:41.712942 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.672309 26215 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:18:41.718232 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:41.819065 25883 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:41.719151 26219 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.819717 25883 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.822058 25883 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.700654 26239 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:41.811851 26165 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:41.819146 21030 raft_consensus.cc:1240] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:41.714206 25825 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:41.695453 26208 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.691073 26122 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.812230 26199 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.722327 26228 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.973906 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:41.805395 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 156199us
I20260709 12:18:41.711722 25994 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:41.977808 21149 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.718783 25866 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:41.810876 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.978632 21182 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.671316 26108 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:41.806247 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 114036us
I20260709 12:18:41.979014 21149 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.701442 26152 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:41.813926 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:41.982409 21029 raft_consensus.cc:2376] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8. Re-sending same reply.
I20260709 12:18:41.681030 25971 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:41.984282 21149 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:41.811347 26222 consensus_queue.cc:1059] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:18:41.889227 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.890872 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.891491 21033 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:18:41.807226 25947 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:41.609685 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:41.904923 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.905213 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.904753 20932 catalog_manager.cc:5697] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 7 to 11, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 11 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:41.905831 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.906543 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:41.907824 26219 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.909101 26205 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:41.995784 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:41.996205 21031 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 12: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:41.996070 26207 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.997066 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:41.997602 26205 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:41.913193 20928 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49666 (request call id 200) took 24968 ms (client timeout 15000 ms). Trace:
I20260709 12:18:41.918203 21109 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:41.919320 26203 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:41.998277 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:41.923192 26246 log.cc:927] Time spent T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.080s	user 0.000s	sys 0.002s
W20260709 12:18:41.923584 26231 log.cc:927] Time spent T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:18:41.998903 21029 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:41.930157 26208 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:41.999624 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:41.999886 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.000371 21032 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 14: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:41.998560 26203 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:42.000907 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.001549 21029 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.001407 26203 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.002115 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.002482 26203 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.003115 21027 raft_consensus.cc:2393] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 14: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.003257 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.004334 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.005456 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.006407 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:41.838990 26221 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:42.007550 26221 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.838788 25825 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:42.008183 21029 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:42.009027 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.009976 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:41.935241 21711 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.936285 26200 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:42.011382 26200 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:42.012255 26200 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.013329 26200 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:41.834640 26111 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:41.936709 26238 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 12:18:41.936980 26226 log.cc:927] Time spent T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:18:41.941931 20999 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:42.036798 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 94944.4us
I20260709 12:18:41.806792 26235 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:18:41.889740 26204 consensus_meta.cc:287] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.000s
W20260709 12:18:41.788065 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 93681us
I20260709 12:18:41.971357 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:41.672376 26193 consensus_queue.cc:1059] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:18:41.806327 21186 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:42.041070 21186 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:41.979373 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.982733 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.828137 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.992686 21030 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 16: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:41.993218 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:41.993417 21149 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:41.998437 26207 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:41.999987 26208 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:41.931533 21034 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:42.019416 26222 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:42.020061 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:42.023134 26128 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.054011 21032 raft_consensus.cc:1240] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:42.047178 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.024650 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:41.984380 26225 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:41.962646 26186 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.987478 26108 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:41.978196 25994 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:42.025848 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 90697.4us
I20260709 12:18:42.080546 21711 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:42.026459 26196 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:42.027148 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:42.025862 20932 catalog_manager.cc:5697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 4 to 5, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 5 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:41.934657 26177 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.035281 21182 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:41.942808 26214 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.046748 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.047098 21109 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:42.047777 21102 raft_consensus.cc:1240] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:42.090904 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 51568.1us
I20260709 12:18:42.091229 21031 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
W20260709 12:18:42.048749 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 55456us
I20260709 12:18:42.048058 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.071568 21107 raft_consensus.cc:2393] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:42.070166 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.075246 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:42.092981 21741 raft_consensus.cc:1240] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:42.077798 21179 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:42.078322 21185 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:42.094164 21711 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.095271 20999 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:42.094477 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.096134 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:42.082409 21033 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.082728 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:42.084017 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.051852 26240 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.044799 21027 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 17: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.087842 21077 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.091760 21103 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:18:42.038743 26235 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:42.102754 21108 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 14: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:42.051384 26222 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:42.111580 21034 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:42.112949 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:42.113197 21028 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:18:42.113411 26220 log.cc:927] Time spent T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:42.114411 26214 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.164932 21032 raft_consensus.cc:1240] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:42.166052 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 71963.7us
I20260709 12:18:42.170066 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:42.166515 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 56733.8us
W20260709 12:18:42.166749 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 70686.4us
I20260709 12:18:42.084424 25994 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:42.175446 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 83517.5us
I20260709 12:18:42.089815 26192 raft_consensus.cc:2764] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:18:42.172659 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 84893.5us
I20260709 12:18:42.183427 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.051254 26204 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.172749 21035 raft_consensus.cc:2393] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.167486 26215 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.167448 26236 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:42.185827 26204 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.187256 21739 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:42.117327 26207 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 12:18:42.095836 26165 consensus_queue.cc:1059] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:18:42.189639 26165 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:42.189991 26165 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:42.056424 26234 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.180998 21149 leader_election.cc:400] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:42.191165 21746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32994 (request call id 903) took 1170 ms. Trace:
I20260709 12:18:42.202509 21149 leader_election.cc:403] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:42.167310 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 75809.9us
I20260709 12:18:42.192775 21077 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:42.168337 21743 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
W20260709 12:18:42.197780 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 79793.2us
I20260709 12:18:42.079701 26186 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.204290 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.205482 21002 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:42.205439 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 545020us
I20260709 12:18:42.209167 21000 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.169225 26116 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:42.118158 26235 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.173328 26193 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.175092 26185 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.215723 21739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 691) took 1051 ms. Trace:
I20260709 12:18:42.118531 25911 consensus_queue.cc:1059] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 12:18:42.208285 26196 consensus_queue.cc:1059] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:18:42.219008 26152 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:18:42.220916 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 44855us
I20260709 12:18:42.221382 26203 raft_consensus.cc:3055] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:42.221539 26225 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:42.224129 26213 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.252873 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:42.225600 26173 consensus_meta.cc:287] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.001s
I20260709 12:18:42.229477 25825 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.230317 26194 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:42.231233 26222 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.199467 20932 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 9 to 10, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 10 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.202589 21746 rpcz_store.cc:276] 0709 12:18:41.008828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.008924 (+    96us) service_pool.cc:224] Handling call
0709 12:18:41.032246 (+ 23322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.041878 (+  9632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.041909 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.056508 (+ 14599us) log.cc:844] Serialized 26 byte log entry
0709 12:18:41.583513 (+527005us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:41.583556 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.583622 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.178989 (+595367us) raft_consensus.cc:1685] finished
0709 12:18:42.179013 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.179154 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7781,"raft.queue_time_us":7982,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10516,"thread_start_us":439680,"threads_started":1,"wal-append.queue_time_us":528056}
I20260709 12:18:42.242588 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.262480 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:42.215418 26165 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.244931 21739 rpcz_store.cc:276] 0709 12:18:41.164618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.164725 (+   107us) service_pool.cc:224] Handling call
0709 12:18:41.167405 (+  2680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.187653 (+1020248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.215508 (+ 27855us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54006202d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:42.215660 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344897920}
I20260709 12:18:42.248739 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:42.197993 26001 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:42.254879 21177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51896 (request call id 2820) took 1273 ms. Trace:
I20260709 12:18:42.244505 25971 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:42.258466 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 174492us
I20260709 12:18:42.212186 26204 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.267459 21149 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:42.266520 21077 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:42.197762 26236 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:42.287359 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.296394 21149 leader_election.cc:400] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15.
I20260709 12:18:42.297355 21149 leader_election.cc:403] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:42.299065 21036 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:42.276117 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 104809us
I20260709 12:18:42.277132 20932 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.257591 26203 raft_consensus.cc:740] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:42.300235 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.301908 21149 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.279461 26251 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:42.303151 20932 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 5 to 6, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 6 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.251454 26252 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:42.274389 26009 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:42.276679 21177 rpcz_store.cc:276] 0709 12:18:40.981737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.062038 (+ 80301us) service_pool.cc:224] Handling call
0709 12:18:41.062324 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.099495 (+ 37171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.099532 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.100033 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:18:41.501923 (+401890us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:41.501961 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.502024 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.254648 (+752624us) raft_consensus.cc:1685] finished
0709 12:18:42.254670 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.254797 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12264,"raft.queue_time_us":36123,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":29823,"thread_start_us":401592,"threads_started":1,"wal-append.queue_time_us":881798}
I20260709 12:18:42.259362 26105 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:18:42.232087 26239 consensus_queue.cc:1059] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:18:42.272722 26183 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:42.273305 26152 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:42.314016 20932 catalog_manager.cc:5697] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 6 to 10, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 10 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:42.335637 20932 catalog_manager.cc:5697] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.251291 25994 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.331564 26264 consensus_queue.cc:1059] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:42.299566 26185 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:42.337968 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.305096 25482 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15.
I20260709 12:18:42.305787 26225 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:42.309954 26213 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:42.274674 26173 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.320786 26251 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:42.327785 26252 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:42.345625 25866 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:42.311959 26108 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:42.312121 25911 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:42.306258 26259 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.343708 21103 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:42.318902 26222 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.395967 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:42.296134 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 126139us
I20260709 12:18:42.399588 21711 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:42.400693 21711 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:42.401963 21711 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:42.402769 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.403403 21035 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
W20260709 12:18:42.350495 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 63234.4us
W20260709 12:18:42.344575 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 44440.5us
I20260709 12:18:42.345127 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.404913 21108 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.405385 26196 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:42.405784 26196 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:42.406128 26196 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:42.361300 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 100228us
I20260709 12:18:42.327286 26009 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:42.411163 26009 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:42.412079 26253 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.412770 26253 consensus_queue.cc:1048] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:42.414094 26253 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.414443 26253 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:42.415890 26215 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:42.416194 21108 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:42.417091 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.418128 26215 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:42.364073 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.419869 21105 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:42.421063 21105 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:42.418563 26215 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:42.364800 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.365954 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:42.358132 21029 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 15: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.367682 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.368763 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:42.425720 21106 raft_consensus.cc:2368] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 15. Current term is 16.
I20260709 12:18:42.425931 21109 raft_consensus.cc:2410] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:42.369268 21107 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:42.371833 21104 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:42.348521 26208 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.377657 26203 consensus_queue.cc:260] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.428000 26203 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:42.414795 26253 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.383397 26116 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:42.418139 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.431105 21111 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:42.431273 21108 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.431464 26116 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.418553 26009 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.433895 26009 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:42.384060 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 213137us
W20260709 12:18:42.437049 21712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.385442 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 136776us
I20260709 12:18:42.438182 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:42.391254 21076 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.439184 21108 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:42.438599 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:42.441901 21712 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:42.443046 26266 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.443428 21177 raft_consensus.cc:1240] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer a1b891e53adc40a6a1ae813238321e93 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:42.438740 21178 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.422191 26215 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.454380 26203 consensus_queue.cc:1059] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:42.455441 26215 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:42.460843 21178 raft_consensus.cc:2468] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:42.348533 26225 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.462267 25911 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:42.347596 26234 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:18:42.462718 25911 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:42.462963 25825 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:42.489828 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 97371.6us
I20260709 12:18:42.348441 26213 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:42.375583 26252 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.376456 26251 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.361583 26128 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.522106 25825 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:42.381556 26185 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:42.380671 26209 raft_consensus.cc:3055] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:18:42.523285 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 118351us
I20260709 12:18:42.523559 26209 raft_consensus.cc:740] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:42.524072 26275 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:42.524475 26275 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:42.524901 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:42.525255 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:42.525668 21741 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 12: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:18:42.522531 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 84273.4us
I20260709 12:18:42.526576 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:42.526767 21712 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:18:42.462733 26257 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:18:42.536357 21149 leader_election.cc:400] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 15. Current term is 16.
I20260709 12:18:42.536691 21149 leader_election.cc:403] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:18:42.462213 26225 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:42.518178 25994 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.518615 26277 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:18:42.519263 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 120123us
I20260709 12:18:42.555840 21149 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:42.462978 26111 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.520987 26009 consensus_queue.cc:1059] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:18:42.521658 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 67734.2us
I20260709 12:18:42.380936 26108 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
W20260709 12:18:42.524694 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 133506us
I20260709 12:18:42.529038 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:42.529294 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:42.544379 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 44478us
I20260709 12:18:42.589587 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:42.518065 26260 log.cc:927] Time spent T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 12:18:42.549960 26256 log.cc:927] Time spent T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:18:42.549808 26208 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:42.551069 26183 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:42.492851 26177 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:42.605579 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 49206.9us
I20260709 12:18:42.467314 26259 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:42.518760 26258 log.cc:927] Time spent T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 12:18:42.555260 21711 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.559634 26105 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:42.550588 26222 raft_consensus.cc:2804] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:42.589476 21177 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:42.589454 21746 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:42.594086 21076 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.557276 26277 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:42.525312 26275 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.559267 25482 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:42.610971 21000 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:42.611368 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:42.596441 26228 consensus_meta.cc:287] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.002s
I20260709 12:18:42.592085 26108 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:42.617497 26222 raft_consensus.cc:697] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:42.036262 20928 rpcz_store.cc:269] 0709 12:18:17.014993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.126255 (+111262us) service_pool.cc:224] Handling call
0709 12:18:17.576030 (+449775us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b5400002490. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c870640 00007fcba5747846 00007fcba585190e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc 00007fcba3d11392 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:41.912970 (+24336940us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:35.421400 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:35.430358 (+  8958us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:35.430402 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:18:35.430419 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:35.456365 (+ 25946us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:35.456441 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:35.456466 (+    25us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:18:35.457626 (+  1160us) tablet.cc:701] Row locks acquired
0709 12:18:35.457661 (+    35us) write_op.cc:260] PREPARE: finished
0709 12:18:35.457770 (+   109us) write_op.cc:270] Start()
0709 12:18:35.457863 (+    93us) write_op.cc:276] Timestamp: P: 1783599515457725 usec, L: 0
0709 12:18:35.457873 (+    10us) op_driver.cc:348] REPLICATION: starting
0709 12:18:35.458365 (+   492us) log.cc:844] Serialized 7887 byte log entry
0709 12:18:35.920121 (+461756us) op_driver.cc:464] REPLICATION: finished
0709 12:18:36.268233 (+348112us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b1800406d20. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:18:36.268415 (+   182us) write_op.cc:301] APPLY: starting
0709 12:18:36.268506 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:36.439202 (+170696us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:36.439237 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:37.047204 (+607967us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:37.047600 (+   396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:18:37.047646 (+    46us) write_op.cc:312] APPLY: finished
0709 12:18:37.048154 (+   508us) log.cc:844] Serialized 180 byte log entry
0709 12:18:37.063234 (+ 15080us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:37.063620 (+   386us) write_op.cc:454] Released schema lock
0709 12:18:37.063690 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:37.064131 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:37.064163 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4711045,"reported_tablets":52,"spinlock_wait_cycles":16475392,"child_traces":[["op",{"apply.queue_time_us":68831,"apply.run_cpu_time_us":37779,"apply.run_wall_time_us":795669,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87687,"num_ops":20,"prepare.queue_time_us":173739,"prepare.run_cpu_time_us":24734,"prepare.run_wall_time_us":351587,"raft.queue_time_us":79848,"raft.run_cpu_time_us":13720,"raft.run_wall_time_us":68752,"replication_time_us":462022,"spinlock_wait_cycles":83537792,"thread_start_us":592195,"threads_started":5,"wal-append.queue_time_us":313573,"wal-append.run_cpu_time_us":34464,"wal-append.run_wall_time_us":2119638}]]}
I20260709 12:18:42.619073 26250 consensus_queue.cc:1059] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:18:42.619544 26122 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.559412 26240 consensus_queue.cc:1059] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:18:42.627720 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:42.658154 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:42.628484 26275 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:42.559523 26239 consensus_queue.cc:1059] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:18:42.631398 26111 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.636783 26173 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.637267 26185 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.637832 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:42.639870 25911 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.558784 26236 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.616294 25971 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:42.524426 26209 consensus_queue.cc:260] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.649574 26105 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:42.557638 26152 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.614251 26259 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.653287 21107 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:18:42.603181 26153 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:18:42.656082 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 44816.3us
I20260709 12:18:42.662716 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:42.650410 26235 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.617158 26193 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:42.663757 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:42.656615 26200 consensus_meta.cc:287] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.641s	user 0.004s	sys 0.007s
I20260709 12:18:42.689540 26272 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:42.691134 21747 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:42.693815 25911 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.664470 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.671273 21177 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:42.675325 21103 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:42.655452 26208 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:42.700838 26208 raft_consensus.cc:697] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:42.701732 26208 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.594587 26213 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.685854 21031 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 12: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.669131 25994 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:42.687306 26262 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:18:42.669500 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 121137us
I20260709 12:18:42.683570 21076 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.656872 26228 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.651487 26277 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.709640 21177 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:42.685945 26239 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:42.725888 21076 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.731593 21741 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 18.
I20260709 12:18:42.657096 26253 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.671514 26251 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.733906 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.739410 21103 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:42.739054 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.745970 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.727460 26209 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.724776 25994 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:42.746836 26111 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.729893 25883 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.729804 26239 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:42.726596 26262 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:42.753217 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.748768 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:42.764976 21002 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:42.765667 25883 consensus_queue.cc:1059] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:42.767030 26274 raft_consensus.cc:3055] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:42.769801 26284 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:18:42.772992 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.752398 25911 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.754547 26277 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.754935 26183 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.743227 26196 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.760082 26108 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.792927 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.791682 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:42.793671 26283 consensus_queue.cc:1175] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 14 status { last_received { term: 14 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 14 index: 8 } }
I20260709 12:18:42.794272 26108 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:42.794976 26269 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.795377 26269 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.795699 26269 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.798050 26251 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:42.798282 21108 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 18: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:42.728137 26250 consensus_queue.cc:1059] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:18:42.753403 26105 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.736049 26272 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.761304 25994 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.715205 26252 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.781823 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.809067 21031 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.786028 25866 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.784365 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.783751 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.785538 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.779836 21077 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:42.788326 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:42.791474 21033 raft_consensus.cc:1240] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:18:42.813684 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.814174 21028 raft_consensus.cc:2368] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:42.767766 26111 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:42.800952 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.767408 26274 raft_consensus.cc:740] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:42.753620 21150 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:42.809748 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.747931 26222 consensus_queue.cc:237] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.782148 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.794735 26285 raft_consensus.cc:3055] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:42.815363 21027 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.816398 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.841952 21031 raft_consensus.cc:2368] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15.
I20260709 12:18:42.812299 25482 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 15. Current term is 16.
W20260709 12:18:42.852311 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 98748.4us
I20260709 12:18:42.852422 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.855098 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.841490 26183 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:42.864089 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.815506 25866 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.858196 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.868162 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.870743 25866 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.841785 26285 raft_consensus.cc:740] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:42.874130 21032 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 12: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.885216 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:42.886459 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.892529 21034 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:42.893391 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.896404 26196 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:42.900398 26224 raft_consensus.cc:3055] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:42.900844 26224 raft_consensus.cc:740] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:42.901650 26224 consensus_queue.cc:260] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:42.907295 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:42.908315 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.909168 26224 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:42.865734 26183 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:42.911480 21741 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:18:42.912889 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.914238 26292 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 12:18:42.849119 26262 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:42.921226 26279 log.cc:927] Time spent T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:18:42.921911 26285 consensus_queue.cc:260] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:42.812131 26239 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:42.927018 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 151794us
I20260709 12:18:42.889075 26235 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:42.927119 26228 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:42.912813 26299 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:42.946583 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:42.961766 21741 raft_consensus.cc:2393] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:42.948087 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.948009 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:42.923951 26183 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:42.967855 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 154272us
I20260709 12:18:42.969488 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:42.968010 21076 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.970139 21185 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:42.977054 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.977499 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:42.977964 21180 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.982144 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.982733 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.983366 21035 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.989027 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:42.990502 21076 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:42.976949 26285 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.968952 26272 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:42.969357 26299 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:42.997315 21180 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:42.997776 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.001876 21029 raft_consensus.cc:1240] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:42.995020 26221 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:43.007706 21029 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:43.008431 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:43.009076 26165 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:43.013166 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:43.021515 21035 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:43.022626 21711 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:42.996716 26301 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:18:43.024631 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.024703 26308 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:18:43.033581 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.024634 26299 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.035941 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.027833 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.036629 21103 raft_consensus.cc:2393] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:43.028898 21111 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:43.029178 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:43.037752 26300 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:18:43.031430 21109 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:43.031812 26196 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:43.032534 21741 raft_consensus.cc:1240] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:43.038763 26153 consensus_queue.cc:1059] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:43.035238 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.039780 26153 raft_consensus.cc:3055] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:43.038911 26196 raft_consensus.cc:697] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 13 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:43.041114 26196 consensus_queue.cc:237] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.040095 21106 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 12: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:42.996263 26259 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.051338 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.023296 25866 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:43.045898 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.048316 21709 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.043717 21077 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:43.004791 26252 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:43.058224 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.055881 21077 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:43.058889 21033 raft_consensus.cc:2368] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:43.057106 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:43.060220 21150 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:43.040140 26153 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:43.063238 26153 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.064461 26153 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.065523 26225 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.067627 26192 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:43.068152 26192 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 17 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:43.068661 26290 consensus_queue.cc:1059] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:43.070044 21183 raft_consensus.cc:2393] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:43.069481 26305 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:18:43.071875 26219 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:43.072039 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.072489 26290 raft_consensus.cc:3055] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:43.072861 26290 raft_consensus.cc:740] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.073587 26290 consensus_queue.cc:260] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.074644 26290 raft_consensus.cc:3060] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.075799 21746 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:43.025501 26111 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:18:43.057964 26295 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:18:43.068959 26192 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.082037 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.084524 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.058383 26180 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.061256 26269 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.072403 26219 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:43.070606 26199 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:18:43.184392 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.187875 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.187273 21742 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:43.214768 21030 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:43.220364 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:43.226173 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.226521 26302 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:43.260381 21000 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:43.216779 26199 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:43.227593 21028 raft_consensus.cc:1240] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13. Ops: []
W20260709 12:18:43.247997 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.248483 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 213760us
W20260709 12:18:43.227524 26310 log.cc:927] Time spent T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:18:43.254779 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.083423 25866 consensus_queue.cc:1059] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.136s
I20260709 12:18:43.043088 26271 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:18:43.257344 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.263813 21106 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:43.264684 21029 raft_consensus.cc:2368] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15.
I20260709 12:18:43.266631 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.271034 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.260541 26302 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.271788 26302 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:43.272235 21032 raft_consensus.cc:2393] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:43.272495 21742 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:43.261698 26277 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:43.276793 21747 raft_consensus.cc:1240] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:43.271806 26219 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.278264 26186 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.279592 26264 raft_consensus.cc:3055] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:43.279947 26264 raft_consensus.cc:740] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.280723 26264 consensus_queue.cc:260] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.276604 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.283147 21032 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:43.267946 26259 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.271353 26290 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:18:43.293795 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.295943 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.296654 21032 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:43.261554 26199 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.286324 26277 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.300990 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.291911 26313 raft_consensus.cc:3055] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:43.305709 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.290031 25994 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:18:43.308599 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.306025 26313 raft_consensus.cc:740] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:43.291730 26252 consensus_queue.cc:1059] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:18:43.311569 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.323487 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:43.323781 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:43.324210 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:43.324506 21180 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 14: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:43.325030 21182 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:43.325893 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.326591 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.327152 21182 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 12: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:43.327530 21186 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:43.325059 21185 raft_consensus.cc:2376] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11. Re-sending same reply.
I20260709 12:18:43.328748 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.328956 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.329864 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.333097 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.333462 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.333753 21181 raft_consensus.cc:2393] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:43.335131 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.336484 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:43.339247 26315 log.cc:927] Time spent T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:18:43.345599 21177 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 16.
I20260709 12:18:43.349447 21177 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:18:43.357189 26302 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.343073 26269 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.371493 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:43.371981 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.383831 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.385996 21036 raft_consensus.cc:2410] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 12:18:43.390580 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 127513us
I20260709 12:18:43.391264 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:43.392129 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.393040 21178 raft_consensus.cc:2410] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 12:18:43.393234 26307 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.330s	user 0.000s	sys 0.003s
I20260709 12:18:43.382649 26302 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.350397 26277 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.434753 21185 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:43.429728 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.422508 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.427765 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.428337 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.404230 21076 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:43.442023 21179 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:43.471376 21182 raft_consensus.cc:2393] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:43.471387 21179 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:43.433183 21181 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:43.429893 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:43.475409 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 71284.9us
W20260709 12:18:43.479971 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 50157.2us
I20260709 12:18:43.409814 26189 raft_consensus.cc:3055] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:43.400916 26324 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:43.485085 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.423159 26234 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:43.491046 25825 raft_consensus.cc:3055] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:43.491479 25825 raft_consensus.cc:740] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.479115 26219 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:43.402688 26183 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.481803 26167 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:43.495527 21002 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.480048 21179 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.501801 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:43.502986 21179 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:43.484565 26189 raft_consensus.cc:740] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:43.415426 26323 consensus_queue.cc:1059] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:18:43.487104 26165 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.492946 26208 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:43.480700 26299 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:18:43.424014 26274 consensus_queue.cc:260] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.506553 21002 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.506707 21107 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:43.512251 26274 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:43.500273 26236 consensus_queue.cc:1059] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:18:43.514951 26283 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:43.515406 26236 raft_consensus.cc:3055] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:43.485144 26324 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.501559 26167 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:43.509624 26240 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:43.515794 26236 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.516026 26240 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:43.516587 26236 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.516950 26240 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.517977 26167 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:43.519366 26240 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:43.498188 26234 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.522984 26324 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:43.523748 26234 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.510339 26213 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:43.502948 25994 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.531271 26189 consensus_queue.cc:260] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.505976 26277 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.533819 26183 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.492344 25825 consensus_queue.cc:260] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.534711 21002 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.535210 26240 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:43.508906 26165 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.536207 21177 raft_consensus.cc:1275] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:43.517753 26236 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.536552 26324 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.532457 26189 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:43.553773 26230 consensus_queue.cc:1048] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:43.539484 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.555277 26213 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:43.556422 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.556562 25994 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:43.557206 25994 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:43.557502 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.541452 26283 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:43.558471 26208 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:43.559082 21002 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.561688 26167 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.539166 26299 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:43.567178 21179 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:43.569162 26252 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:43.570807 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.571523 26252 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.574040 21186 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:43.574358 21186 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:43.575028 21186 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.575868 21186 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.578421 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:43.579134 21185 raft_consensus.cc:2393] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 10: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:43.585912 26165 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.586735 26299 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.587790 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:43.588027 26239 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:43.588482 21179 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:43.588642 26299 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:43.563035 26283 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:43.569267 25825 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:43.541548 26240 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.602773 26240 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:43.603250 26306 log.cc:927] Time spent T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.540s	user 0.000s	sys 0.003s
I20260709 12:18:43.608783 26167 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:43.615226 21152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.616400 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:43.617007 21179 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:43.618271 26225 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:43.626559 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.627105 21027 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:43.634886 21027 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:43.640080 26324 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.642683 21179 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:18:43.646550 26313 consensus_queue.cc:260] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.647922 26313 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:43.651224 25947 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:18:43.657024 21107 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:43.657338 26183 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:43.657822 26183 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.660724 26228 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.661158 26183 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.665385 25947 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:43.665908 25947 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.667275 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:43.686652 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.689273 26213 consensus_queue.cc:1059] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:18:43.670666 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.680946 25911 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:43.677162 26009 raft_consensus.cc:3055] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:43.699589 26009 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:43.699330 25911 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.700431 26009 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.701579 26009 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.702415 25911 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.705017 26253 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:43.673398 21110 raft_consensus.cc:1240] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:43.671015 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:43.707890 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:43.708804 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:43.708909 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.709602 21110 raft_consensus.cc:2393] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:43.667944 25947 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:43.699115 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:43.711247 21108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 2361) took 1185 ms. Trace:
I20260709 12:18:43.711809 21109 raft_consensus.cc:2393] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:43.670060 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.711615 21108 rpcz_store.cc:276] 0709 12:18:42.525640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.526347 (+   707us) service_pool.cc:224] Handling call
0709 12:18:43.711067 (+1184720us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400190fd4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:43.711194 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623179008}
I20260709 12:18:43.671433 21105 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:43.715468 21103 raft_consensus.cc:2393] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 16: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:43.684173 26290 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:18:43.717386 26290 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:43.717708 26290 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.718405 26290 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.719789 26290 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:43.735870 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.680210 21178 raft_consensus.cc:1240] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:18:43.741973 21105 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:18:43.742743 26262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.004s	sys 0.004s
I20260709 12:18:43.743085 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.661158 26228 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.743814 26009 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:43.746140 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.746289 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.746699 21030 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:43.747380 26228 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:43.747655 21029 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:18:43.747982 21028 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:18:43.743108 26262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.004s	sys 0.004s
I20260709 12:18:43.750718 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.750962 21034 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:43.751456 21032 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 10: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:43.757274 26262 consensus_queue.cc:1059] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:43.758322 26277 raft_consensus.cc:3055] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:43.758890 26277 raft_consensus.cc:740] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.759742 26277 consensus_queue.cc:260] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.760205 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.760675 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:43.668020 21107 raft_consensus.cc:2393] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 17: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:43.710480 21110 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:43.758252 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:43.760649 26277 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:43.763499 21709 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.764228 26224 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:43.767055 26213 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:43.768154 26308 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:43.768491 26308 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.769266 26308 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.771689 26308 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:43.779699 20932 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 117) took 16300 ms (client timeout 15000 ms). Trace:
I20260709 12:18:43.713462 21109 raft_consensus.cc:1240] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:43.673727 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:43.714753 21104 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:43.683398 26305 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:43.672837 21111 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:43.678695 21739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33006 (request call id 707) took 1155 ms. Trace:
I20260709 12:18:43.723850 26264 raft_consensus.cc:3060] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.725241 26186 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:18:43.726017 26222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.001s	sys 0.011s
I20260709 12:18:43.714694 21108 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:43.730131 21747 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 13 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
W20260709 12:18:43.734666 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.786995 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.735958 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.736996 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.780730 21102 raft_consensus.cc:2368] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11.
I20260709 12:18:43.789552 25947 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:43.790247 25947 consensus_queue.cc:1243] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:18:43.790684 25947 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:43.791026 25947 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:43.791833 25947 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.792903 25947 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:43.795060 21150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.781193 21739 rpcz_store.cc:276] 0709 12:18:42.523640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.526261 (+  2621us) service_pool.cc:224] Handling call
0709 12:18:42.551075 (+ 24814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.061685 (+510610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:43.061714 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:43.061757 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:43.061785 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.678495 (+616710us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400791154. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:43.678537 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.678642 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173894528}
I20260709 12:18:43.787099 26262 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:18:43.785327 21002 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.786180 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.799188 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:43.800930 21036 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 9.
I20260709 12:18:43.802971 21102 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:43.803231 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.803792 21027 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
W20260709 12:18:43.787324 26222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.001s	sys 0.011s
I20260709 12:18:43.786609 26186 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:43.809095 21033 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:43.787107 26009 consensus_queue.cc:1059] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:18:43.810215 21742 raft_consensus.cc:1240] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:43.784117 26305 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.824307 26305 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:43.805616 26290 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:43.780373 20932 rpcz_store.cc:269] 0709 12:18:27.479540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.479910 (+   370us) service_pool.cc:224] Handling call
0709 12:18:43.779610 (+16299700us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:42.726712 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:42.888309 (+161597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:42.914781 (+ 26472us) write_op.cc:435] Acquired schema lock
0709 12:18:42.914807 (+    26us) tablet.cc:662] Decoding operations
0709 12:18:42.915876 (+  1069us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:42.915972 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:42.916000 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:18:42.916838 (+   838us) tablet.cc:701] Row locks acquired
0709 12:18:42.916883 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:18:42.917034 (+   151us) write_op.cc:270] Start()
0709 12:18:42.917179 (+   145us) write_op.cc:276] Timestamp: P: 1783599522916973 usec, L: 0
0709 12:18:42.917203 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:18:42.917814 (+   611us) log.cc:844] Serialized 4016 byte log entry
0709 12:18:43.277837 (+360023us) op_driver.cc:464] REPLICATION: finished
0709 12:18:43.387614 (+109777us) write_op.cc:301] APPLY: starting
0709 12:18:43.389556 (+  1942us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:43.468582 (+ 79026us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:43.484964 (+ 16382us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:43.561307 (+ 76343us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:43.561540 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:18:43.561583 (+    43us) write_op.cc:312] APPLY: finished
0709 12:18:43.562389 (+   806us) log.cc:844] Serialized 97 byte log entry
0709 12:18:43.582863 (+ 20474us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:43.583013 (+   150us) write_op.cc:454] Released schema lock
0709 12:18:43.583057 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:43.583473 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:43.583500 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3525381,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":104905,"apply.run_cpu_time_us":13614,"apply.run_wall_time_us":198584,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45907,"num_ops":10,"prepare.queue_time_us":187226,"prepare.run_cpu_time_us":22541,"prepare.run_wall_time_us":327489,"raft.queue_time_us":29897,"raft.run_cpu_time_us":16741,"raft.run_wall_time_us":69760,"replication_time_us":360496,"thread_start_us":259773,"threads_started":4,"wal-append.queue_time_us":164250}]]}
I20260709 12:18:43.828405 21030 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:43.827905 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:43.829334 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.801631 26262 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:43.830653 25911 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:18:43.831354 21030 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:43.813391 21036 raft_consensus.cc:1240] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:18:43.814985 21029 raft_consensus.cc:2468] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:43.815497 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:43.832639 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 44232.3us
I20260709 12:18:43.809252 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:43.816008 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
W20260709 12:18:43.833191 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.816391 25967 consensus_queue.cc:1059] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:43.834147 21028 raft_consensus.cc:1240] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:18:43.834290 26239 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.834815 26239 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.836585 21742 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:43.836931 26239 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:43.838351 21149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.817976 21027 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:18:43.838883 21027 pending_rounds.cc:85] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting all ops after (but not including) 8
I20260709 12:18:43.818240 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:43.819376 26009 raft_consensus.cc:3055] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:43.819706 21031 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:43.828888 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.833027 21033 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:43.815709 26186 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.841307 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:43.839299 21035 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:43.839830 21027 pending_rounds.cc:107] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:18:43.839926 21032 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:43.838989 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:43.842291 21027 raft_consensus.cc:2889] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:43.841492 21109 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:43.844813 21106 raft_consensus.cc:2468] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 15.
I20260709 12:18:43.845773 21179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51888
I20260709 12:18:43.846305 21179 raft_consensus.cc:606] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Received request to transfer leadership
I20260709 12:18:43.846587 21179 raft_consensus.cc:614] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:43.848284 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.848443 21151 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:43.851737 25967 consensus_queue.cc:1243] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer a1b891e53adc40a6a1ae813238321e93 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:18:43.840914 26009 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:43.850520 26189 consensus_queue.cc:1059] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:18:43.853111 26225 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:43.847738 26105 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:18:43.857259 21002 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.858381 21035 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:43.856244 21151 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:43.860906 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:43.861531 26299 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:43.862311 21709 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:43.866003 21151 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.859951 26186 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.861462 26275 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:43.868062 26275 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.868367 26275 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.868883 26222 raft_consensus.cc:2804] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:43.868602 26009 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.869374 26222 raft_consensus.cc:697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 15 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:43.870604 26313 raft_consensus.cc:3055] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:43.870214 26222 consensus_queue.cc:237] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.871716 26152 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:43.872193 26152 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.868772 26286 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:43.861652 26262 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:18:43.874135 26152 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:43.870990 26313 raft_consensus.cc:740] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:43.871737 21033 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:43.867466 26167 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:18:43.875303 26313 consensus_queue.cc:260] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:43.876518 26313 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:43.877352 21151 leader_election.cc:400] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:43.878444 21151 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:43.872641 21739 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:18:43.878304 20931 catalog_manager.cc:5697] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 5 to 6, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 6 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:43.879290 26286 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:43.880991 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.881500 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:43.883265 26225 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:43.884837 20999 leader_election.cc:400] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11.
I20260709 12:18:43.886495 20999 leader_election.cc:403] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:43.886557 21739 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 14: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:43.886945 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.874590 26299 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:43.894160 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.883791 26009 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.895030 26286 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:43.896938 26286 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:43.898113 21151 leader_election.cc:400] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15.
I20260709 12:18:43.898883 21151 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.900627 26213 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:43.901113 26213 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.901934 26213 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.891883 26105 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:43.903261 26286 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:43.904456 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.859226 26239 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:18:43.907557 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.899175 26167 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:43.909698 26167 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:43.910501 26167 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:43.916940 21151 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.921206 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.925129 26299 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:43.928843 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.907126 26286 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.919710 26262 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11.
I20260709 12:18:43.938239 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:43.928107 26105 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.932981 26308 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:18:43.940938 21185 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:43.941596 26302 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:43.942186 26305 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:43.947829 26167 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.949787 21106 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:43.952589 21076 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:43.955024 21076 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:43.956694 26324 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:43.956784 26185 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:43.936770 26264 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:43.968556 21033 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:43.962105 21151 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.969118 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.971902 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:43.959416 26204 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:18:43.979998 26225 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:43.991598 21035 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:43.993285 21076 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:43.995568 21151 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:43.957267 26324 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:43.959175 26228 raft_consensus.cc:2804] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:43.973747 26105 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:43.971588 26221 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.993883 25825 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:43.957659 26313 consensus_queue.cc:1059] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:18:44.059469 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 52054.5us
W20260709 12:18:44.059383 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 66136.6us
W20260709 12:18:44.059695 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 64531.2us
I20260709 12:18:43.960500 25883 consensus_queue.cc:1059] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:18:44.063702 21151 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:43.996083 26182 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:43.999073 26183 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.991376 26194 consensus_queue.cc:1059] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:18:44.068954 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.052639 26228 raft_consensus.cc:697] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:44.070775 26001 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:18:44.065056 26323 raft_consensus.cc:2804] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:44.066316 26189 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:44.096704 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.067878 26299 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.109342 26299 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.091388 26225 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:44.101786 25947 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:44.103960 26324 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:44.108439 26343 log.cc:927] Time spent T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:18:44.067914 26196 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.083662 26272 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:18:44.110402 26275 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.095597 25482 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:44.062780 26221 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.084712 26183 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.119422 26313 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:44.121083 26105 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:44.138962 26196 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:44.143288 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.145606 21151 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.123437 26323 raft_consensus.cc:697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:44.152949 21151 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.153964 21033 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:18:44.156780 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.126756 26009 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:18:44.123754 26239 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:18:44.167338 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:44.164852 26266 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:44.168561 26266 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.170022 26196 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:44.168941 26344 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:18:44.175246 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:44.175825 21742 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:44.170436 26266 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.178187 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.178771 21183 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:44.180733 21712 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:44.178195 21075 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:44.181351 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.153888 26225 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:44.184629 26183 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:44.186060 26275 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.187896 26196 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:44.168857 26240 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:44.189050 26323 consensus_queue.cc:237] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.171896 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.172441 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.190768 21109 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:44.190953 21108 raft_consensus.cc:2393] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 12: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:44.193182 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:44.193691 21178 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:44.196413 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:44.197885 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:44.188268 26196 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:44.199182 26196 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:44.151885 26209 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.199501 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:44.148236 26105 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:44.202775 21178 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:44.199985 26204 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:44.161134 26299 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:44.145352 25482 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.170406 26221 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:44.212996 21742 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:44.147334 26313 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:44.223397 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 56103.3us
I20260709 12:18:44.227943 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:44.228473 21178 raft_consensus.cc:3060] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:44.202203 26009 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.203858 26152 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:44.232326 21031 raft_consensus.cc:1240] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:44.202370 26189 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:44.205294 26105 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:44.238093 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:44.213270 26204 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.240262 21178 raft_consensus.cc:2468] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:44.221169 26185 consensus_queue.cc:1059] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:18:44.230450 26299 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:44.235862 26352 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:44.154320 26228 consensus_queue.cc:237] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.245692 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:44.236402 26152 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.205140 26209 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.248399 21178 raft_consensus.cc:2410] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:18:44.250531 26353 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.250906 26271 consensus_queue.cc:1059] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:44.251801 26299 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:44.252434 25482 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:18:44.258409 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:44.242738 26204 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:44.264396 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.267141 21109 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:44.271914 26180 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.272348 26299 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.272388 26180 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.274636 26180 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.276322 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.268277 21149 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:44.277547 21179 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:44.277738 26122 raft_consensus.cc:3055] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:44.278164 26353 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.236115 26009 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.278913 25482 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:44.280186 25482 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:44.280680 26009 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:44.236608 26182 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:44.281466 26272 raft_consensus.cc:3055] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:44.301687 21712 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:44.301889 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.303148 26001 raft_consensus.cc:3055] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:44.259946 26152 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:44.240947 26189 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.312752 21181 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:44.280500 26286 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:44.278703 26122 raft_consensus.cc:740] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:44.280571 25482 raft_consensus.cc:3060] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:44.319226 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.315026 25911 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:18:44.330543 26222 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:44.318167 26001 raft_consensus.cc:740] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:44.331488 26209 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:44.332310 26152 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.360251 26001 consensus_queue.cc:260] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.361363 26152 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:44.361629 26180 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.334599 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:44.362126 26180 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.363255 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:44.364187 26180 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.335388 21002 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.347422 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.318260 26272 raft_consensus.cc:740] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:44.366269 21109 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:44.369601 21030 raft_consensus.cc:1275] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:44.374334 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.374910 21030 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:44.368033 21149 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:44.358987 26351 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:18:44.376001 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.368844 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.381681 21030 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 8.
I20260709 12:18:44.382122 21034 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:44.357041 26222 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.386828 21027 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:44.361409 26001 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:44.390128 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.390705 21185 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:44.397576 21031 raft_consensus.cc:3060] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:44.382963 26277 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:44.403828 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.404016 21183 raft_consensus.cc:1240] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:44.389117 26222 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:44.416270 21712 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:44.385951 26286 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:44.429526 21183 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:44.389369 26180 consensus_queue.cc:1048] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:18:44.403122 26302 raft_consensus.cc:3055] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:44.435958 21031 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:18:44.437026 26357 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:18:44.441076 21183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:44.443351 21183 raft_consensus.cc:606] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.443684 21183 raft_consensus.cc:614] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:44.444281 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.423588 26286 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.428653 26253 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:44.447105 26204 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.396500 26182 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.434252 26302 raft_consensus.cc:740] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:44.401410 26122 consensus_queue.cc:260] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.445645 26189 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:44.457125 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:44.457769 21741 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 15: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:18:44.458417 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 83269.6us
I20260709 12:18:44.446931 26286 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:44.457072 21183 raft_consensus.cc:1240] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: []
W20260709 12:18:44.461421 26361 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:44.463919 26277 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:44.464776 26277 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:44.465307 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.467425 26359 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:18:44.467810 26266 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:44.468276 26266 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.469081 25482 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.471462 26266 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:44.472677 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.479566 25482 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723)
I20260709 12:18:44.476575 26308 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.476985 25911 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.449177 26253 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.486649 21742 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:44.451006 26313 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:44.492646 21182 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:44.497409 21183 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:44.498049 21105 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 18: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:44.427523 26272 consensus_queue.cc:260] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.507907 26272 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:44.509382 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.502393 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:44.510516 21177 raft_consensus.cc:606] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.503844 26302 consensus_queue.cc:260] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.510033 21186 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:44.514966 21180 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:44.511452 21177 raft_consensus.cc:614] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:44.514794 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:44.516723 21183 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:44.514153 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.520702 21182 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:18:44.521427 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.522099 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.523734 21180 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:44.506943 25911 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.529508 25911 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:44.479272 26105 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.532639 21183 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:44.506333 26253 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:44.540867 21105 raft_consensus.cc:1275] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:44.547396 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.548454 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.550935 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:44.505841 26308 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.551575 21033 raft_consensus.cc:2393] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 12: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:44.591696 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:44.619020 21105 raft_consensus.cc:3060] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:44.583240 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:44.621060 21027 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:44.579882 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:44.595042 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.625977 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:44.571105 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.624636 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.536470 25482 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.644286 21106 raft_consensus.cc:2468] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:44.646348 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.558678 26302 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:44.647871 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.651260 21033 raft_consensus.cc:2393] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:44.649080 21032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:44.649545 21035 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:44.572394 26204 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.571151 26363 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.539985 26303 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 12:18:44.573911 26225 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:44.651808 21032 raft_consensus.cc:606] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.573390 26353 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.572387 26105 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:44.656201 21105 raft_consensus.cc:2468] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 15.
I20260709 12:18:44.563758 26319 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 12:18:44.661855 21709 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:44.662907 21178 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:44.665987 26380 log.cc:927] Time spent T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.002s
I20260709 12:18:44.669435 26308 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:44.644719 25482 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.672008 25482 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:44.680415 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.681135 26374 raft_consensus.cc:2804] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:44.681674 26374 raft_consensus.cc:697] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 15 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:44.660048 26363 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.685200 26363 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.589146 26222 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.692528 26222 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.693005 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:44.693374 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:44.693606 21746 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 17.
I20260709 12:18:44.693895 21185 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:44.695847 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.696554 21000 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:44.697324 25825 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:44.697670 25825 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.697969 25825 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:44.702301 21185 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:44.703321 21712 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:44.704079 26222 raft_consensus.cc:2804] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:18:44.704558 25947 consensus_meta.cc:287] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.001s
I20260709 12:18:44.704520 26222 raft_consensus.cc:697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:44.706333 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.706028 26222 consensus_queue.cc:237] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.682520 26374 consensus_queue.cc:237] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.711676 26266 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:44.712391 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:44.713258 21106 raft_consensus.cc:2393] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:44.714571 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.715164 21109 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:44.717317 21149 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:44.686329 26286 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.718127 26189 raft_consensus.cc:2804] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:44.718704 26189 raft_consensus.cc:697] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:44.719523 21032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:44.719765 21184 raft_consensus.cc:2368] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15.
I20260709 12:18:44.720625 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:44.721601 25947 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:44.724635 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:44.712796 26266 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.725208 21028 raft_consensus.cc:3060] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:44.726827 26266 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.727546 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.728116 21029 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:44.729750 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.734669 21032 raft_consensus.cc:606] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.735066 21032 raft_consensus.cc:614] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:44.737962 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:44.736202 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:44.738903 21106 raft_consensus.cc:2393] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:44.737739 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.719525 26189 consensus_queue.cc:237] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.745144 21149 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.748426 26209 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:44.744939 26009 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:44.749119 26009 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.749455 26009 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:44.753710 26313 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.754226 26221 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.755084 26152 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.755548 26152 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.757473 26152 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.754719 26221 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.761222 26221 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:44.761891 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.762627 21035 raft_consensus.cc:2393] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 9: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:44.754184 26313 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.765480 26313 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:44.771193 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:44.773900 21106 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:44.774744 21076 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:44.777525 21746 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:44.773980 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:44.783005 21075 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:44.787916 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.727555 26286 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:44.791108 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:44.800288 21077 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:44.801388 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:44.798655 21106 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 18.
I20260709 12:18:44.804055 21030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:44.804600 21030 raft_consensus.cc:606] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.810925 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.811545 21032 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:44.813840 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.814397 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:44.814699 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.816529 21151 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.811586 21035 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:44.817314 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:44.823103 21178 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:44.786675 26221 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:44.786506 26204 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.827495 21029 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:44.828608 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.830107 21030 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:44.835461 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.839056 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:44.839125 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:44.839753 21036 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:44.808622 26353 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:44.789048 26319 consensus_queue.cc:1048] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:18:44.805234 26324 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:44.829437 26196 consensus_meta.cc:287] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
W20260709 12:18:44.848141 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 47939us
I20260709 12:18:44.829643 26221 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.799775 25825 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.845463 26200 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:44.842692 26239 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:44.859509 26200 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.845201 26286 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:44.851918 26355 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:44.865818 21033 raft_consensus.cc:2368] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 18. Current term is 19.
I20260709 12:18:44.856940 26221 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:44.859966 25883 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:44.880191 21105 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:18:44.879917 21028 raft_consensus.cc:2468] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 14.
I20260709 12:18:44.839247 26204 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.868140 26355 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.854005 26196 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.885464 26355 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:44.871536 26272 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:18:44.887615 26183 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.917346 21747 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:44.916210 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.892139 26253 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:44.890975 26324 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.941440 21747 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:44.944516 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:44.945132 21180 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:44.943238 26253 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:44.942968 26387 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:18:44.948035 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 112646us
I20260709 12:18:44.948614 21151 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:44.930409 26324 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:44.925868 26183 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:45.020910 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 215014us
I20260709 12:18:45.022373 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:45.042887 21180 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
W20260709 12:18:45.064777 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 211741us
I20260709 12:18:45.027969 25825 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 19 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:45.020047 26200 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.062239 26392 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.065075 26393 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.093482 21077 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:45.097761 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:45.096549 26302 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:18:45.095515 26196 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.101223 26009 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.102754 26009 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:45.096833 26228 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:18:45.099618 26152 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:45.108363 26152 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.108697 26152 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:45.111056 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.112501 21077 leader_election.cc:400] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15.
I20260709 12:18:45.112747 26221 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.115471 26398 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:45.115895 26398 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:45.116245 26398 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.092814 26393 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:45.119704 26302 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:45.112780 21077 leader_election.cc:403] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:45.135156 26396 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.135660 26396 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.137629 26396 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.143399 26204 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.146159 26324 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.144202 26360 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15.
I20260709 12:18:45.149947 26183 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:45.123513 26302 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:45.151170 26302 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:45.153165 26355 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.153900 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:45.167459 21746 raft_consensus.cc:2410] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 12:18:45.159371 26397 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:45.160136 26393 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.126925 26221 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.169705 26392 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.170387 26355 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.175742 26152 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:45.177773 26152 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:45.174269 26398 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:45.178726 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:45.179427 21746 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:45.187817 21746 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:45.188814 21075 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.189150 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:45.189955 21746 raft_consensus.cc:2393] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 15: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
W20260709 12:18:45.191350 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.190522 26398 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:45.191263 26152 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:45.192677 26152 raft_consensus.cc:697] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:45.193499 26152 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:45.203084 26264 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.203557 26264 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.207921 26264 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.191555 26302 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.213179 26353 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.213608 26353 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:45.215308 26302 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.217993 26302 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.231858 26353 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:45.233017 26401 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
I20260709 12:18:45.244354 26353 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:18:45.245303 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 361772us
I20260709 12:18:45.247313 25482 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:45.250391 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:45.251082 21109 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:45.250360 26189 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.251715 26189 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.251982 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:45.253505 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 304946us
I20260709 12:18:45.253885 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.254163 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:45.254590 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:45.255151 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:45.255147 21179 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 9.
I20260709 12:18:45.253322 21712 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:45.255261 21184 raft_consensus.cc:2368] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 12. Current term is 13.
I20260709 12:18:45.256325 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:45.256421 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:45.256975 21105 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:45.257082 21102 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 18.
I20260709 12:18:45.255963 26240 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:45.261950 26266 raft_consensus.cc:2804] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:45.262099 26240 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.262480 26266 raft_consensus.cc:697] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:45.263312 26266 consensus_queue.cc:237] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:45.267239 21109 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:45.269409 21712 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:45.270671 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:45.270165 21746 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:45.271202 21742 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:18:45.273645 21185 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:45.277765 21149 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.278771 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.278151 21712 leader_election.cc:400] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 12. Current term is 13.
I20260709 12:18:45.279389 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.279690 21712 leader_election.cc:403] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:18:45.279948 21183 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:45.283746 26222 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:45.277526 26199 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.284112 21742 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 19.
I20260709 12:18:45.259203 26009 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:45.284505 26199 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.285171 26240 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:45.287878 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:45.286430 21075 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.292383 21105 raft_consensus.cc:2393] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 13: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:45.270166 26313 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.277486 25947 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:45.298274 26199 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:45.284188 26222 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.302156 26122 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.304836 26222 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:45.305107 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:45.301331 26189 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:45.299974 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:45.300803 25825 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:18:45.303589 26404 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 12. Current term is 13.
I20260709 12:18:45.286289 26392 raft_consensus.cc:2764] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:18:45.306129 26213 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.293264 26356 raft_consensus.cc:2804] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:45.298579 26272 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:45.307430 21002 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:45.310499 26213 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.310883 26272 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:45.311125 26303 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:45.311616 26303 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.311944 26303 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:45.311800 26272 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:45.312477 26213 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.309190 26313 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:45.315035 20982 auto_rebalancer.cc:893] Removing replace marker failed: Replica 694635cc4a20455fbbec925e0a84a1ee is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:18:45.315465 20982 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:18:45.315739 20982 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:18:45.319957 26302 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:45.316926 26356 raft_consensus.cc:697] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:45.322968 26356 consensus_queue.cc:237] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.324990 26303 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.363801 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:45.364362 26303 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.364977 26303 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:45.366643 26277 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:45.368444 21076 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.370031 21076 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.278179 25482 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.297088 26286 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:18:45.384411 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:45.385033 21110 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:45.326161 26302 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:45.385598 26302 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.332522 21108 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:45.338238 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.340730 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:45.387228 21739 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 19: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:45.386626 21180 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:45.387712 26302 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.388407 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:45.388912 21180 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.383919 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:45.319394 25947 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:45.344000 26200 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.344386 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.398039 21185 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:45.398826 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:45.399329 21185 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:45.345327 21178 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:45.402137 21180 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:45.347584 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:45.402968 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.348379 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.403537 21180 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:45.404098 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.348209 20932 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:45.344063 21179 raft_consensus.cc:1275] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:45.357439 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.405555 21182 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:45.405679 21029 raft_consensus.cc:1275] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:45.358616 21111 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:45.407169 21029 raft_consensus.cc:1275] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:45.402067 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:45.408205 21178 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:45.403299 21712 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.308461 21105 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:45.360554 26213 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.362017 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:45.411623 21027 raft_consensus.cc:3060] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:45.362650 25911 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.368609 26277 raft_consensus.cc:993] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:45.308861 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:45.372610 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:45.373145 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:45.373364 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.380311 25482 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.381146 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:45.481796 21028 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:45.482679 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:45.481789 21181 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:45.484102 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.484651 21181 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:45.485371 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.381623 26398 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:45.481055 21109 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:18:45.382530 26152 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:45.383998 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:45.385816 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:45.342538 26313 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.488188 21110 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:45.389086 21711 leader_election.cc:400] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 18. Current term is 19.
I20260709 12:18:45.495000 21711 leader_election.cc:403] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:45.404274 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.496184 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:45.494215 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:45.412994 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:45.497726 21036 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:18:45.497856 21030 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:45.412142 21149 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.413932 21002 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:45.414804 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:45.498921 21179 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:45.415660 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:45.481505 21031 raft_consensus.cc:2368] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14.
I20260709 12:18:45.487561 21103 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:45.500144 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:45.497375 21180 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.490090 20932 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 11 to 13, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 13 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:45.501571 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:45.487293 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 51502us
I20260709 12:18:45.502318 21030 raft_consensus.cc:2393] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 14: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:45.500679 21031 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.497550 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:45.416834 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:45.487037 26152 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.503831 26152 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:45.481408 26392 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:45.507405 26392 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.507747 26392 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:45.487881 26398 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.512305 26398 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:45.412758 26399 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 12:18:45.494472 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:45.514956 21035 raft_consensus.cc:3060] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:45.500376 21077 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.502234 20932 catalog_manager.cc:5697] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 9 to 10, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 10 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:45.518558 21029 raft_consensus.cc:3060] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:45.517443 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 105361us
I20260709 12:18:45.518823 20932 catalog_manager.cc:5697] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 5 to 8, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 8 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:45.523394 21178 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:45.523857 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:45.503369 21032 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:45.524852 21030 raft_consensus.cc:2393] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 19: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:45.525622 21027 raft_consensus.cc:2468] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:45.520696 21077 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:18:45.526885 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 154983us
I20260709 12:18:45.530577 21185 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:45.520340 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.537406 21180 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:45.544689 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:45.481057 26308 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.545652 21180 raft_consensus.cc:1275] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:45.547124 21104 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:45.531948 26189 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:45.416641 26299 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 12:18:45.421782 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:45.491954 26302 consensus_queue.cc:1048] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:18:45.533030 21186 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:45.519557 26374 consensus_queue.cc:1048] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:18:45.548163 26189 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.555732 26189 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.556351 21177 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:45.532552 26355 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:45.557444 26355 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:45.558257 26355 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.480674 25911 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.534268 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.562222 25911 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.562379 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:45.563150 26221 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:45.563525 26221 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.563875 26221 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:45.567591 21077 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.568209 26302 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:45.567906 26189 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.570662 26189 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:45.417601 25947 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:45.523492 20932 catalog_manager.cc:5697] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:45.574358 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 54085.9us
I20260709 12:18:45.574517 21032 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:45.587008 21032 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:45.590132 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:45.593816 21031 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:45.584991 21179 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:45.606125 21035 raft_consensus.cc:2468] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:18:45.583910 20932 catalog_manager.cc:5697] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:45.608753 21029 raft_consensus.cc:2468] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:45.603662 21103 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:45.609220 20932 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 6 to 8, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 8 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:45.416617 26353 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 12:18:45.613832 20932 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 10 to 11, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 11 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:45.485809 26213 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.545027 26116 raft_consensus.cc:1081] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:45.531847 26266 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for earlier term 18. Current term is 19.
I20260709 12:18:45.546001 26199 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.481192 26404 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.131s
I20260709 12:18:45.579386 26236 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:45.416739 26200 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:45.668087 21104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56406 (request call id 2389) took 1043 ms. Trace:
I20260709 12:18:45.682036 21104 rpcz_store.cc:276] 0709 12:18:44.624218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.624371 (+   153us) service_pool.cc:224] Handling call
0709 12:18:45.667909 (+1043538us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b540016f3d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:45.668027 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102145920}
I20260709 12:18:45.578962 26272 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:45.618291 20932 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 10 to 11, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:45.619278 21077 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:45.617892 26183 raft_consensus.cc:2804] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:45.699035 21028 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:18:45.606861 26189 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:45.702495 21149 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:45.695298 20932 catalog_manager.cc:5697] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 10 to 13, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 13 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:45.705003 20932 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 6 to 8, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 8 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:18:45.706802 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 204050us
I20260709 12:18:45.618716 26286 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:45.581465 26308 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.573745 26221 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.709683 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:45.699404 26305 raft_consensus.cc:993] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:45.618538 26360 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 12:18:45.680855 26236 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:45.743314 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 124101us
I20260709 12:18:45.694314 26272 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:45.736892 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 322996us
I20260709 12:18:45.725328 26189 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.751111 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:45.787616 21151 leader_election.cc:400] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14.
I20260709 12:18:45.788394 21151 leader_election.cc:403] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:45.730832 25883 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.809751 26272 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.812147 21033 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:18:45.678629 26324 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:18:45.690805 26228 consensus_queue.cc:1048] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:18:45.744661 26209 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:45.680598 26199 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.736989 26009 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:45.760763 26236 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.752345 26400 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:45.806623 26183 raft_consensus.cc:697] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:45.808840 26189 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:45.811667 26240 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:45.741587 26286 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.919093 26116 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.828843 26324 consensus_queue.cc:1243] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:18:45.905294 26407 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
W20260709 12:18:45.915472 26412 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:18:45.951509 26413 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:18:45.958151 26408 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:18:45.834791 26209 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:45.960464 26275 raft_consensus.cc:1081] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:45.826237 25883 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.916818 26264 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:45.903846 25482 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:45.935626 26213 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.943872 26221 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.936805 26308 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.938086 26200 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:45.921017 26303 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:46.003480 26116 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.001878 26400 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:46.008459 26222 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.692s	user 0.006s	sys 0.002s
I20260709 12:18:45.807585 25947 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:45.946943 26009 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.012651 26209 raft_consensus.cc:3060] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:46.022603 26398 consensus_meta.cc:287] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.510s	user 0.018s	sys 0.005s
I20260709 12:18:45.986742 26240 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.063915 26303 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:45.909191 26393 consensus_queue.cc:1048] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.190s
I20260709 12:18:46.111404 26299 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14.
I20260709 12:18:46.118031 25883 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.073421 26222 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.093323 26398 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.059058 26183 consensus_queue.cc:237] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:46.130072 26152 consensus_meta.cc:287] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.002s
I20260709 12:18:46.125747 26400 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:46.147058 26422 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:18:46.148635 26423 log.cc:927] Time spent T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:18:46.171710 20931 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49666 (request call id 199) took 50988 ms (client timeout 15000 ms). Trace:
W20260709 12:18:46.172739 20931 rpcz_store.cc:269] 0709 12:17:54.840372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.841826 (+  1454us) service_pool.cc:224] Handling call
0709 12:18:45.828449 (+50986623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:44.263110 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:44.325573 (+ 62463us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:44.325608 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:18:44.325625 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:44.325940 (+   315us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:44.325989 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:44.326017 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:44.326185 (+   168us) tablet.cc:701] Row locks acquired
0709 12:18:44.326201 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:18:44.326343 (+   142us) write_op.cc:270] Start()
0709 12:18:44.326447 (+   104us) write_op.cc:276] Timestamp: P: 1783599524326298 usec, L: 0
0709 12:18:44.326467 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:18:44.327086 (+   619us) log.cc:844] Serialized 538 byte log entry
0709 12:18:44.422557 (+ 95471us) op_driver.cc:464] REPLICATION: finished
0709 12:18:44.652017 (+229460us) write_op.cc:301] APPLY: starting
0709 12:18:44.656934 (+  4917us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:44.665728 (+  8794us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:44.665825 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:44.666525 (+   700us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:44.666716 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:18:44.666764 (+    48us) write_op.cc:312] APPLY: finished
0709 12:18:44.703050 (+ 36286us) log.cc:844] Serialized 25 byte log entry
0709 12:18:44.703215 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:44.703323 (+   108us) write_op.cc:454] Released schema lock
0709 12:18:44.703360 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:44.703751 (+   391us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:44.703777 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":211982,"apply.run_cpu_time_us":3171,"apply.run_wall_time_us":55917,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":88686,"prepare.run_cpu_time_us":2467,"prepare.run_wall_time_us":80736,"replication_time_us":95935,"thread_start_us":123565,"threads_started":2}]]}
I20260709 12:18:46.205178 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.206521 21184 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 11.
I20260709 12:18:46.208699 21182 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:46.208950 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.209795 21178 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 15.
W20260709 12:18:46.124720 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 218000us
I20260709 12:18:46.214380 21742 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:46.215338 26152 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.220624 21712 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:46.132061 26303 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.226469 26436 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.227421 26436 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.228626 26009 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:46.232096 26436 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:46.232609 26398 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.236881 26222 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 19 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.237821 26222 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:46.240065 26404 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:46.240651 26404 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.241104 26404 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:46.281605 26152 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.134938 26286 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:46.317955 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:46.320320 21077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.000s
W20260709 12:18:46.320730 21076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.004s	sys 0.000s
W20260709 12:18:46.322970 21034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.001s	sys 0.005s
I20260709 12:18:46.323319 26116 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.323582 26199 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:46.324503 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:46.334420 21076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.005s	sys 0.001s
W20260709 12:18:46.334803 21077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.004s	sys 0.000s
W20260709 12:18:46.337924 21001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.003s
W20260709 12:18:46.338111 21074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.005s
W20260709 12:18:46.338356 21001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.004s	sys 0.003s
W20260709 12:18:46.337983 21075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.007s	sys 0.000s
W20260709 12:18:46.338927 21027 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.005s	sys 0.000s
W20260709 12:18:46.339311 21027 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.005s	sys 0.000s
W20260709 12:18:46.343204 21151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.006s
W20260709 12:18:46.343643 21151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.000s	sys 0.006s
W20260709 12:18:46.345337 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 557820us
W20260709 12:18:46.346053 26407 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.324s	user 0.000s	sys 0.008s
W20260709 12:18:46.351600 20932 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.016s	sys 0.020s
W20260709 12:18:46.351990 20932 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.016s	sys 0.020s
W20260709 12:18:46.355268 21075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.000s
W20260709 12:18:46.337293 21034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.001s	sys 0.005s
W20260709 12:18:46.338558 20999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.013s	sys 0.021s
I20260709 12:18:46.362496 21739 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:46.363106 26116 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:46.363796 26116 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.365928 26116 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:46.370671 20999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.013s	sys 0.021s
W20260709 12:18:46.363827 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 70395.1us
I20260709 12:18:46.370127 26419 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:46.373245 21000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.003s	sys 0.002s
W20260709 12:18:46.373632 21000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.003s	sys 0.002s
W20260709 12:18:46.371527 21074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.002s	sys 0.006s
I20260709 12:18:46.382092 21747 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:46.385203 26240 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:46.388662 26275 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.324406 26272 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.389585 26275 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.412343 26308 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:46.413141 26308 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.373567 26419 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.431890 21150 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:46.433063 26419 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:46.434899 26418 log.cc:927] Time spent T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.321s	user 0.000s	sys 0.002s
I20260709 12:18:46.436542 21742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32986 (request call id 717) took 1109 ms. Trace:
W20260709 12:18:46.422117 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 671011us
I20260709 12:18:46.437475 21742 rpcz_store.cc:276] 0709 12:18:45.327576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.328317 (+   741us) service_pool.cc:224] Handling call
0709 12:18:45.328840 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:46.215000 (+886160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.436272 (+221272us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400288554. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f994e01 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:46.436469 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035074816}
I20260709 12:18:46.445832 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:46.447286 21033 raft_consensus.cc:1275] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:46.447890 26305 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:46.448864 25825 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.448661 26305 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.451272 26305 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:46.454864 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35652 (request call id 706) took 1053 ms. Trace:
I20260709 12:18:46.456262 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:46.456400 26443 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:46.457006 26443 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.457494 26443 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:46.459977 26430 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.460696 26430 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.451416 26209 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.464653 26209 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:46.464915 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.467060 26432 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:46.467501 26432 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.467873 26432 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:46.455268 21034 rpcz_store.cc:276] 0709 12:18:45.401606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.401706 (+   100us) service_pool.cc:224] Handling call
0709 12:18:45.401953 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:45.417184 (+ 15231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:45.417213 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:45.417643 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:18:46.388755 (+971112us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:46.389247 (+   492us) log.cc:844] Serialized 14 byte log entry
0709 12:18:46.389608 (+   361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.389728 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:46.452193 (+ 62465us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b18000ca240. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:18:46.454435 (+  2242us) raft_consensus.cc:1685] finished
0709 12:18:46.454555 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:46.454749 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29924,"raft.queue_time_us":84680,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":22658,"spinlock_wait_cycles":19048576,"thread_start_us":942968,"threads_started":1,"wal-append.queue_time_us":957343}
I20260709 12:18:46.473745 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:46.456139 25883 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.475593 25883 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.477013 26275 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.477789 25883 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.449442 25825 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.479465 21109 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:46.481988 26430 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.483024 26240 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:46.483572 21747 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:46.484011 26240 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:46.484387 26240 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:46.484596 26122 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.485286 26122 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.485747 26240 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.487180 26429 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.487895 21742 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:18:46.488001 26429 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.489494 26240 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:46.490310 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 143964us
I20260709 12:18:46.498601 26152 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.499495 26152 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.502660 26122 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.503029 21181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51896 (request call id 2889) took 1087 ms. Trace:
I20260709 12:18:46.504889 21181 rpcz_store.cc:276] 0709 12:18:45.415295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.485168 (+ 69873us) service_pool.cc:224] Handling call
0709 12:18:46.502591 (+1017423us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400387054. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f9982fa 00007fcba4959b17 00007fcb9ded46d4 00007fcb9ded4662 00007fcb9ded4591 00007fcb9ded450c 00007fcb9ded37c2 00007fcb9dccf48c 00007fcb9dcce8c6 00007fcb9dcce26f
0709 12:18:46.502796 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093821696}
W20260709 12:18:46.510221 26407 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:18:46.511668 21102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 2399) took 1252 ms. Trace:
W20260709 12:18:46.511925 26445 log.cc:927] Time spent T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:18:46.455529 26355 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:46.559854 26236 consensus_meta.cc:287] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.008s
I20260709 12:18:46.560433 26236 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.567075 26308 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.567829 26355 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.576278 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:46.577184 26398 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:46.577983 21076 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:46.578800 26398 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:46.579195 26398 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.579531 26398 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:46.584889 26272 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:46.588330 26392 consensus_meta.cc:287] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 1.080s	user 0.011s	sys 0.021s
I20260709 12:18:46.588827 26392 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.588326 26398 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.591324 21023 tablet_service.cc:1558] Processing DeleteTablet for tablet f16c07bcae284f65a7c0ee0375e00769 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:59982
I20260709 12:18:46.599468 26152 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:46.600121 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 46835.1us
I20260709 12:18:46.605569 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.606312 21109 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:46.512115 21102 rpcz_store.cc:276] 0709 12:18:45.258582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.258698 (+   116us) service_pool.cc:224] Handling call
0709 12:18:45.258994 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:45.259310 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:18:45.259578 (+   268us) log.cc:844] Serialized 14 byte log entry
0709 12:18:45.296420 (+ 36842us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:45.308943 (+ 12523us) log.cc:844] Serialized 52 byte log entry
0709 12:18:45.309097 (+   154us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:18:45.309277 (+   180us) log.cc:844] Serialized 14 byte log entry
0709 12:18:45.309412 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.309457 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:46.345289 (+1035832us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b2400169e68. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c72d9c4 00007fcb9c72bacb 00007fcb9c8e6dc9 00007fcb9c8e6a55 00007fcb9c8e609d 00007fcb9f51810e 00007fcb9f52f88c 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221
0709 12:18:46.511127 (+165838us) raft_consensus.cc:1685] finished
0709 12:18:46.511147 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:46.511456 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3130,"prepare.queue_time_us":521,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":5588,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":1960,"spinlock_wait_cycles":4729984,"thread_start_us":33308,"threads_started":1,"wal-append.queue_time_us":254612}
I20260709 12:18:46.611608 21036 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:46.603400 21709 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:46.614049 21027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59998 (request call id 3002) took 1204 ms. Trace:
I20260709 12:18:46.619666 21027 rpcz_store.cc:276] 0709 12:18:45.409497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.545707 (+136210us) service_pool.cc:224] Handling call
0709 12:18:45.546363 (+   656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:45.546774 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:46.339785 (+793011us) log.cc:844] Serialized 14 byte log entry
0709 12:18:46.517390 (+177605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:46.540327 (+ 22937us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:46.545252 (+  4925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.555834 (+ 10582us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:46.613969 (+ 58135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50625,"prepare.queue_time_us":74814,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":55487,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"thread_start_us":808669,"threads_started":2}
I20260709 12:18:46.634007 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.634688 21178 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:46.640758 26204 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:46.617276 26152 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:18:46.658358 26433 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.658980 26433 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.661037 26433 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.662470 26429 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:46.619273 26236 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.622030 26308 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.616925 26122 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:18:46.677067 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:46.663060 25825 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.687237 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.634958 26428 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:18:46.678128 26429 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.684938 26398 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.709545 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.712381 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:46.717352 26355 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.719726 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:46.720474 21109 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:46.725006 26434 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.725725 26434 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.727941 26434 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.695960 26308 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:46.740584 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 161735us
I20260709 12:18:46.698926 26432 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:46.759353 21151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.761440 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.762125 21104 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:18:46.763254 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.764425 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.765015 21179 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:46.765852 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:46.766103 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:46.766666 21183 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:46.768812 26199 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.769469 26199 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.771482 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:46.772130 21178 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:18:46.772768 21186 pending_rounds.cc:85] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Aborting all ops after (but not including) 8
I20260709 12:18:46.773070 21186 pending_rounds.cc:107] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:18:46.773355 21186 raft_consensus.cc:2889] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:46.779237 21183 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:46.741087 26443 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.781141 21182 raft_consensus.cc:1240] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:46.782344 26443 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:46.783138 26236 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.783759 26236 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.785888 26236 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:46.782924 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.735934 26429 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.787863 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:46.797372 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 95865.3us
I20260709 12:18:46.800096 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:46.788694 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:46.776891 26392 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.810765 21179 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:46.812446 21183 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:46.809437 26236 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.814043 26236 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.814960 26400 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.815598 26400 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.816010 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.816368 26236 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.817409 25482 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.818241 26400 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.818111 25482 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.820416 26429 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.820858 26441 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.824481 21102 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:18:46.824869 21102 pending_rounds.cc:85] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 8
I20260709 12:18:46.826953 21102 pending_rounds.cc:107] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:18:46.827214 21102 raft_consensus.cc:2889] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:46.825289 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.825269 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.832257 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.833447 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.830999 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:46.810518 21104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56400
I20260709 12:18:46.837288 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.838594 26224 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:46.839135 25482 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:46.839494 26189 consensus_meta.cc:287] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.836s	user 0.013s	sys 0.006s
I20260709 12:18:46.839107 26224 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.840535 26432 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.837666 21104 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:46.842314 21104 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:46.850018 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.825423 26398 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:46.855110 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 113552us
I20260709 12:18:46.855342 26199 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:46.857311 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.857940 21108 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 17.
I20260709 12:18:46.859961 26224 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:46.871343 26464 log.cc:927] Time spent T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:18:46.873348 26404 consensus_meta.cc:287] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.006s
I20260709 12:18:46.873746 26404 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.875170 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.875870 26404 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.876225 26199 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:46.876823 26199 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.878183 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:46.878294 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.878808 21036 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:46.877367 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.881008 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.881997 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:46.882251 26199 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:46.883597 21102 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:46.884248 26433 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:46.884792 26433 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:46.887465 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:46.889180 21180 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:46.882730 21185 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:46.891358 21178 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:46.897642 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.902249 21027 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:46.902949 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.939008 21110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56400
I20260709 12:18:46.979523 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.945909 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:46.938185 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:46.825259 26441 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.943637 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:46.852270 26189 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:46.912802 26199 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:46.907222 25825 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:46.926635 21739 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:46.886806 26433 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:46.928813 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:46.937736 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:46.915627 21179 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:46.928406 26308 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:46.931373 26324 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:47.008088 21180 raft_consensus.cc:2468] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 16.
I20260709 12:18:46.975432 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.934091 21109 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:46.931663 26398 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.923151 20920 catalog_manager.cc:5028] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): tablet f16c07bcae284f65a7c0ee0375e00769 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:18:46.943971 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.018057 26443 consensus_queue.cc:1048] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:47.018633 21028 raft_consensus.cc:2368] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:47.019517 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:46.909044 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.910583 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:46.906127 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:46.931138 26430 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:46.951825 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:46.935038 26400 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:47.001500 21029 raft_consensus.cc:2393] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:47.000967 21104 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.003052 21110 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:47.002072 21108 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:47.004794 21102 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 17.
I20260709 12:18:47.007059 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:47.007658 21183 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:46.944964 21002 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:47.009317 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.024336 21181 raft_consensus.cc:2393] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 18: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:47.009714 21712 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:47.010911 25825 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.011649 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:47.011790 26434 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:47.012902 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.013798 21030 raft_consensus.cc:1275] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:47.014199 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.015096 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.016518 26303 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:47.016747 26236 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:47.004838 26432 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.018056 26398 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.020607 21184 raft_consensus.cc:2410] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:47.022951 21034 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:47.023677 21110 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:47.026723 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.026754 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:47.027746 21028 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:47.028188 21182 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 15: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
W20260709 12:18:47.027573 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 82680.8us
I20260709 12:18:47.030936 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.031091 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.031848 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.035879 21183 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
W20260709 12:18:47.032635 20920 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 109634us
I20260709 12:18:47.033241 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:47.029026 26465 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:18:47.040846 21031 raft_consensus.cc:3060] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:47.041042 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.041852 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:47.038874 21036 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:47.048621 21185 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:47.049774 26430 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.051744 21182 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:47.055047 26393 raft_consensus.cc:2804] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:47.055625 21179 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:18:47.056603 26432 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.058939 26303 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.060560 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:47.061213 21106 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:18:47.030508 26308 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:47.063073 26308 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.063422 26308 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.066045 21149 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:47.034575 26116 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:47.067030 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.030418 26236 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.067690 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:47.068215 21104 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.068804 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:47.069267 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:47.069844 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:47.067242 25947 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:47.070420 26400 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:47.067132 26443 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:47.070712 26116 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.071414 26443 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.073387 26443 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:47.073930 26443 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:47.074941 26434 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.077013 26189 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:47.077186 26434 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:47.078608 25825 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:47.079561 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:47.081070 25947 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.081743 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.082304 21029 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.055600 26393 raft_consensus.cc:697] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:47.083580 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:47.084165 26393 consensus_queue.cc:237] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.087117 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.088006 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:47.088171 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.088835 21107 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:47.061215 21102 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:47.089879 21034 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 15: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:47.092607 21110 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.101612 21108 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:47.103331 21029 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:47.103740 21031 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 13.
I20260709 12:18:47.107394 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.104691 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.089648 26400 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.069272 26236 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:47.111112 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:47.112977 21177 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:47.029451 26199 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.114073 21106 raft_consensus.cc:1275] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:47.114653 21031 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:18:47.118139 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.123521 21034 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:47.127174 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:47.129522 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 57150.5us
I20260709 12:18:47.117278 26400 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:47.132360 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:47.132953 21110 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.138939 26430 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.141322 26308 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.136463 21002 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:47.145977 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:47.148305 21107 raft_consensus.cc:2393] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:47.152310 25825 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:47.156021 26429 consensus_queue.cc:1059] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:47.157102 26324 raft_consensus.cc:3055] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:47.157428 26324 raft_consensus.cc:740] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:47.157776 26400 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.158298 26324 consensus_queue.cc:260] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.159469 26324 raft_consensus.cc:3060] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:47.160554 21709 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.144757 26432 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.161463 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.150676 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:47.181011 21030 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 11: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:47.177596 21709 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:47.187028 26222 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:47.187378 26222 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:47.187706 26222 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:47.198498 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 53867.9us
I20260709 12:18:47.197983 21034 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:47.203476 21105 raft_consensus.cc:2468] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:47.146746 26430 consensus_queue.cc:1059] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:18:47.181353 25825 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:47.195021 26303 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:47.199275 26392 raft_consensus.cc:2804] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:47.200675 26433 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:47.234127 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.236879 21111 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:47.231246 21077 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.241858 21034 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:47.241808 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:47.244323 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:47.247761 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.249231 21108 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:47.223454 26236 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:47.240134 26116 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.259270 21035 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:47.232600 26441 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:47.262682 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 95161us
I20260709 12:18:47.262707 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.271449 26199 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:47.277009 21149 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.279458 26189 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:47.279808 26189 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:47.280145 26189 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.284286 26183 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:47.284699 26183 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:47.285553 26183 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.290490 25947 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:47.252941 26429 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:47.294021 21149 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.306329 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.260500 26434 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.307331 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:47.307893 21184 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:47.309005 21182 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:47.309583 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.312748 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:47.315709 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:47.286767 26183 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:47.314245 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.319185 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.318583 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.316663 21149 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:47.318542 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.343643 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.343850 21034 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:47.351217 21035 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:47.310161 26398 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.353538 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.307816 26429 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:47.387846 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.395074 21036 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:47.399488 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.389981 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.329787 26209 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:47.448520 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.322219 26116 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.328969 26441 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:18:47.451536 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 104082us
I20260709 12:18:47.308843 26236 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.453608 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.319535 26434 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.393601 26400 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.455868 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.457145 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:47.462819 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 68743.9us
I20260709 12:18:47.448973 26209 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:47.450062 26308 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.467775 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.470534 21027 raft_consensus.cc:3060] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:47.474021 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 226201us
I20260709 12:18:47.457230 26392 raft_consensus.cc:697] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 13 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:18:47.480223 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.395430 26429 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.480552 21077 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.478552 26116 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.485461 26222 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.467339 25482 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:18:47.468212 26484 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:47.474249 26209 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:47.498986 21151 leader_election.cc:400] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) with higher term. Message: Invalid argument: T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 12. Current term is 13.
I20260709 12:18:47.464650 26441 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:47.535849 26441 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:47.536242 26441 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:47.527999 25825 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:47.508236 21108 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 18.
I20260709 12:18:47.509810 21028 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:47.537004 25825 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.530655 26189 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.540869 26189 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:47.534226 26236 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:47.535369 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 62970us
I20260709 12:18:47.544028 21151 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:47.529040 21036 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:47.544734 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.545612 21180 raft_consensus.cc:1240] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:47.542524 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:47.560869 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 80383.2us
I20260709 12:18:47.561051 21151 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:47.563134 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.565249 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.566558 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:47.549626 26484 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.570413 21151 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:47.574002 21027 raft_consensus.cc:2468] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 18.
I20260709 12:18:47.576268 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:47.577026 21034 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:47.578049 21036 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:47.579032 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:47.582283 21077 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:47.584076 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.585592 26443 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:47.587105 25825 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:47.587749 26491 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:47.588569 26491 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:47.588884 26491 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:47.589619 26491 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.565788 26189 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:47.591107 26189 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:47.591517 26189 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:47.566803 26444 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:47.595260 26444 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:47.595628 26444 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:47.578473 21036 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:47.599866 21027 raft_consensus.cc:1275] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260709 12:18:47.608904 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 127728us
I20260709 12:18:47.611059 21028 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:18:47.600131 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 57672.5us
I20260709 12:18:47.611418 21028 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:18:47.617587 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 162369us
I20260709 12:18:47.558707 26431 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:18:47.559651 25947 consensus_queue.cc:1048] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:18:47.618221 21149 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:18:47.582307 26481 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:18:47.590679 26491 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:47.577657 26324 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:47.575294 26236 raft_consensus.cc:2764] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:18:47.622400 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:47.626555 21077 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:47.600543 26428 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:18:47.619102 26480 log.cc:927] Time spent T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:18:47.617825 26443 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:47.628947 21036 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:47.666046 21074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.623884 21028 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.627214 26490 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:47.713376 21028 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:47.713332 21036 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:47.643178 26433 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:47.664420 26116 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.627552 26183 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 12:18:47.665565 26443 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:47.707872 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 80809.8us
I20260709 12:18:47.731053 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:47.731331 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:18:47.741379 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 78746.4us
I20260709 12:18:47.720297 26490 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:18:47.746114 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 112848us
I20260709 12:18:47.748224 26222 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 18 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.747207 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:47.745400 20999 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:47.714855 26477 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:47.745970 26490 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:47.724030 26428 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:18:47.754230 26189 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.737547 26443 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:47.760833 26431 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.761234 26434 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.761346 26431 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.761798 26434 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:47.763368 26431 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.772579 21036 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:47.781590 21184 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
W20260709 12:18:47.785880 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.786494 21028 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:47.792943 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:47.793679 21180 raft_consensus.cc:2393] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 11: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:47.750231 26492 raft_consensus.cc:2804] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:47.742338 26324 raft_consensus.cc:697] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:47.801229 21742 raft_consensus.cc:1240] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:47.720044 26392 consensus_queue.cc:237] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:47.808471 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.783999 26199 raft_consensus.cc:2764] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:18:47.813231 26471 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:47.813016 26240 consensus_queue.cc:1059] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:47.824107 26209 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.824920 26240 raft_consensus.cc:3055] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:47.825294 26240 raft_consensus.cc:740] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:47.826273 26209 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:47.826876 26489 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:47.827365 26489 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:47.827750 26489 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:47.822137 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:47.826047 26240 consensus_queue.cc:260] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.829142 26240 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:47.842263 21181 raft_consensus.cc:2468] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 18.
I20260709 12:18:47.843344 26433 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.853569 26443 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.855356 26484 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:47.857234 26189 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:47.858325 26324 consensus_queue.cc:237] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.810796 26492 raft_consensus.cc:697] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:47.871654 26492 consensus_queue.cc:237] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.893080 26122 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:47.893702 26122 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:47.894775 26490 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.895764 26122 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:47.898721 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:47.899441 21747 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 19: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:47.901851 21107 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 12:18:47.902150 21107 pending_rounds.cc:85] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 13
I20260709 12:18:47.902357 21107 pending_rounds.cc:107] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:18:47.902565 21107 raft_consensus.cc:2889] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:47.904193 26200 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:47.918326 21180 raft_consensus.cc:1275] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:18:47.917711 21712 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:47.942930 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 316431us
I20260709 12:18:47.850677 26441 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.966328 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.967228 21178 raft_consensus.cc:1240] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:47.949680 21076 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.108.1:42723 timed out after 1.599s (SENT) [suppressed 42 similar messages]
I20260709 12:18:47.967770 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:47.973577 21182 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:47.969101 21185 raft_consensus.cc:1240] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:47.976406 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:47.977072 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.977285 21183 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 13: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:47.979838 21178 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:47.979666 26199 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:47.982877 26199 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:47.984805 26199 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:47.989277 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:47.989833 21185 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 19.
I20260709 12:18:47.999994 21182 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:18:48.003067 26490 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:48.004611 26183 consensus_queue.cc:1059] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:48.006718 26443 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:47.939500 26204 consensus_queue.cc:1048] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 12:18:48.007505 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:47.971894 26486 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:18:47.971851 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:48.023496 21180 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:48.013973 21185 raft_consensus.cc:1240] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:47.982311 26485 raft_consensus.cc:2804] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:48.027874 26485 raft_consensus.cc:697] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 18 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
W20260709 12:18:48.029124 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 281967us
I20260709 12:18:48.030507 21002 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:48.030673 26441 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:48.031507 26434 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:48.028745 26485 consensus_queue.cc:237] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:48.032183 26434 consensus_queue.cc:1059] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:48.033145 26434 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:48.033582 26434 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:48.035882 26495 raft_consensus.cc:3055] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:48.036273 26495 raft_consensus.cc:740] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:48.037071 26495 consensus_queue.cc:260] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.037734 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:48.038164 26495 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:48.038569 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 244959us
I20260709 12:18:48.038798 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:48.039353 21185 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
W20260709 12:18:48.039780 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.039865 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:48.040242 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:48.040997 26509 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:48.041090 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 298625us
I20260709 12:18:48.041767 20999 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:48.043011 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.043174 21178 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:48.043457 26432 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:48.043848 26432 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:48.044203 26432 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:48.045241 20999 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.045064 26509 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:48.046082 26431 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:48.034391 26434 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.047479 20999 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.047667 26489 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.049136 26444 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.013262 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:48.054399 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:18:48.056057 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 437870us
I20260709 12:18:48.059192 21181 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
W20260709 12:18:48.061074 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 48328.5us
I20260709 12:18:48.058739 21149 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.063536 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:48.065095 21151 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:48.066031 21077 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:48.068652 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.072485 21186 raft_consensus.cc:1240] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:48.073307 21149 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:48.091589 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:48.070580 26477 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:48.064766 25947 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:48.094926 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:48.102029 21035 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:48.095623 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:48.070413 26183 consensus_queue.cc:1059] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:18:48.064633 26510 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:48.092792 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:48.057049 21180 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:48.075363 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:48.074457 20999 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.137764 21183 raft_consensus.cc:1240] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:48.072151 26429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.027s	sys 0.062s
W20260709 12:18:48.141284 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 68041.1us
W20260709 12:18:48.151687 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 77298.2us
I20260709 12:18:48.098680 26324 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:48.072629 26303 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:48.105541 26398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.014s
I20260709 12:18:48.163165 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:48.103191 25947 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
W20260709 12:18:48.147186 26429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.027s	sys 0.063s
I20260709 12:18:48.139623 26510 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:48.162341 26116 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:48.172844 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.173609 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:48.163070 26398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.005s	sys 0.030s
I20260709 12:18:48.177793 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.171339 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:48.164170 26443 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:48.164050 26491 raft_consensus.cc:2804] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:48.203733 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:48.203666 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:48.198945 21002 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:48.169531 25947 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:48.175565 26510 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:48.174753 26324 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:48.256510 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 51989us
I20260709 12:18:48.258512 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.165890 26493 consensus_queue.cc:1059] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:18:48.204758 26443 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:48.272850 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:48.261541 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 311861us
I20260709 12:18:48.254987 26303 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:48.177467 26431 consensus_queue.cc:1059] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 12:18:48.347502 21001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.354192 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:48.264093 26430 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:48.356853 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.284353 26443 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:48.413877 21149 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.311797 26303 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.360450 25825 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:48.360874 26522 log.cc:927] Time spent T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:18:48.362287 26493 raft_consensus.cc:3055] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:48.400347 26444 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:48.363517 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:48.366255 26496 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:48.368207 26489 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:48.368500 26512 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:48.368834 26514 consensus_queue.cc:1059] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.209s
I20260709 12:18:48.370122 26516 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.319064 26433 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:48.371313 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:48.375840 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.376561 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.387974 26319 consensus_queue.cc:1048] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.179s
I20260709 12:18:48.390134 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.402504 21033 raft_consensus.cc:2468] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
W20260709 12:18:48.446314 26521 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 12:18:48.447504 26518 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:18:48.450886 26519 log.cc:927] Time spent T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:18:48.455308 26511 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:18:48.456933 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:48.457664 21111 raft_consensus.cc:2393] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 13: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:48.458384 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.462380 26490 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:48.462224 26433 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.462755 26490 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:48.463577 26490 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.464346 26433 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:48.464679 26490 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:48.468886 26489 raft_consensus.cc:3055] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:48.468844 26516 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:48.469393 26489 raft_consensus.cc:740] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:48.470171 26489 consensus_queue.cc:260] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.471349 26489 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:48.422492 26493 raft_consensus.cc:740] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:48.478452 26493 consensus_queue.cc:260] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.479662 26493 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:48.482512 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.483609 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.484515 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:48.485463 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.401386 26324 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.259173 26491 raft_consensus.cc:697] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:48.410221 21110 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 14: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:48.417900 26495 raft_consensus.cc:3055] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:48.418504 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.432729 26429 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:48.420133 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:48.421748 20920 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 40fd334874764b26ba28ac382c4199f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3ed9deaeb4014e9d87aeebbc6384f81f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:18:48.574383 20920 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 152685us
I20260709 12:18:48.269970 26432 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:48.425027 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 203455us
I20260709 12:18:48.416432 26189 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:48.427749 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 64316us
I20260709 12:18:48.411764 26430 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:48.413213 26199 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:48.417366 26303 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:48.443346 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:48.406564 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 229331us
I20260709 12:18:48.542313 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.571441 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.614583 21110 raft_consensus.cc:2410] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:48.579960 21076 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:48.573027 26495 raft_consensus.cc:740] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:48.583313 21111 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:48.438874 26496 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:48.587285 21102 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:48.589485 21109 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:48.596103 21028 raft_consensus.cc:1240] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:48.598968 26199 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.599975 26430 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.427227 25825 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:48.570959 26491 consensus_queue.cc:237] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.579212 26433 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:18:48.611028 21077 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:48.619760 21029 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:48.638075 26355 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:48.629884 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:48.630788 21111 raft_consensus.cc:1240] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:48.633982 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:48.634883 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54994.1us
W20260709 12:18:48.634861 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.635121 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:48.635838 21182 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:48.646806 25825 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:48.626433 26513 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.648401 26513 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.650393 26513 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:48.655794 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:48.656361 21031 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:18:48.660826 21110 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:18:48.664894 21035 consensus_meta.cc:287] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.559s	user 0.016s	sys 0.000s
I20260709 12:18:48.665222 21035 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:48.665977 21030 raft_consensus.cc:1240] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:48.666832 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 55893.2us
I20260709 12:18:48.667532 21076 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:48.679025 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:48.682184 26400 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:48.681871 26433 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.697343 26433 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:48.698014 26116 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:48.698547 26116 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:48.700474 26116 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:48.702116 26199 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:48.708201 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:48.716414 20932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 118) took 4817 ms. Trace:
I20260709 12:18:48.717489 21104 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 16.
I20260709 12:18:48.570399 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:48.720621 21149 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.722901 26496 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:48.680869 26355 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:48.723785 26355 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:48.723697 26495 consensus_queue.cc:260] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.724856 26495 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:48.724722 26355 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.728317 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.729534 21149 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.730865 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.730741 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:48.732216 26441 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:48.732879 26441 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:48.733414 26441 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:48.734249 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.736083 21151 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:48.736649 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.733376 21108 raft_consensus.cc:1275] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:48.737869 26532 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:48.738480 21149 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:48.740125 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.741392 21151 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.742195 26441 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:48.742558 26441 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:48.742921 26441 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:48.743207 26513 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:48.743414 25482 consensus_queue.cc:1059] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:48.744048 26532 raft_consensus.cc:2804] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:48.744427 25482 raft_consensus.cc:3055] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:48.744827 25482 raft_consensus.cc:740] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:48.744889 26513 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:48.742965 26530 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:48.745929 26513 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.745647 26530 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.744881 26434 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:48.746276 25482 consensus_queue.cc:260] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.744557 26532 raft_consensus.cc:697] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:48.747574 25482 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:48.748203 26532 consensus_queue.cc:237] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.749795 26434 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:48.746165 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.751842 21108 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:48.746945 26530 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:48.752700 26434 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:48.716826 20932 rpcz_store.cc:276] 0709 12:18:43.898495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.898645 (+   150us) service_pool.cc:224] Handling call
0709 12:18:48.716306 (+4817661us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:46.518346 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:46.583822 (+ 65476us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:46.583880 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:18:46.583905 (+    25us) tablet.cc:662] Decoding operations
0709 12:18:46.585113 (+  1208us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:46.585202 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:46.585242 (+    40us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:18:46.586478 (+  1236us) tablet.cc:701] Row locks acquired
0709 12:18:46.586528 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:18:46.586730 (+   202us) write_op.cc:270] Start()
0709 12:18:46.612229 (+ 25499us) write_op.cc:276] Timestamp: P: 1783599526586658 usec, L: 0
0709 12:18:46.617554 (+  5325us) op_driver.cc:348] REPLICATION: starting
0709 12:18:46.655870 (+ 38316us) log.cc:844] Serialized 4396 byte log entry
0709 12:18:46.856838 (+200968us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fd571 00007fcb9f98fe28 00007fcba33ca581 00007fcba33c9d58 00007fcba33ce9f1 00007fcba33ce9a9 00007fcba33ce939 00007fcba33ce901 00007fcba33cdb2d 0000000000388634 0000000000388479
0709 12:18:47.049901 (+193063us) op_driver.cc:464] REPLICATION: finished
0709 12:18:47.191947 (+142046us) write_op.cc:301] APPLY: starting
0709 12:18:47.192039 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:47.290662 (+ 98623us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:47.290700 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:47.488657 (+197957us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:47.488986 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:18:47.489047 (+    61us) write_op.cc:312] APPLY: finished
0709 12:18:47.489415 (+   368us) log.cc:844] Serialized 105 byte log entry
0709 12:18:47.489590 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:47.489710 (+   120us) write_op.cc:454] Released schema lock
0709 12:18:47.489768 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:47.490250 (+   482us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:47.490277 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":206625,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":141747,"apply.run_cpu_time_us":15867,"apply.run_wall_time_us":298268,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50085,"num_ops":11,"prepare.queue_time_us":665518,"prepare.run_cpu_time_us":17707,"prepare.run_wall_time_us":441167,"raft.queue_time_us":167917,"raft.run_cpu_time_us":18411,"raft.run_wall_time_us":106406,"replication_time_us":428185,"spinlock_wait_cycles":6180096,"thread_start_us":912395,"threads_started":4,"wal-append.queue_time_us":153515,"wal-append.run_cpu_time_us":7217,"wal-append.run_wall_time_us":1679199}]]}
I20260709 12:18:48.766247 26530 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.768375 26530 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:48.773350 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:48.774245 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:48.775355 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:48.775946 21029 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:48.776014 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:48.773608 21181 raft_consensus.cc:1240] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:48.785454 21181 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:48.787123 26236 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:48.795149 26199 consensus_queue.cc:1048] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:48.803416 21149 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:48.805065 26199 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:48.805500 26199 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:48.805933 26199 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:48.816164 20999 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.817127 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:48.820153 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.821445 20999 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.729269 26398 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:48.817394 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:48.825443 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.829042 21029 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:18:48.829495 26496 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:48.830426 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:48.830945 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.851966 20999 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.821910 26236 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:48.866829 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:48.869359 25947 consensus_meta.cc:287] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.004s
I20260709 12:18:48.869781 25947 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:48.871196 26510 consensus_meta.cc:287] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.603s	user 0.001s	sys 0.013s
I20260709 12:18:48.871625 26510 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:48.848322 21151 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:48.821043 26516 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:48.873653 26510 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:48.874334 26432 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:48.876083 26392 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:48.878135 26434 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:48.824280 26116 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:48.883397 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:48.886953 21742 raft_consensus.cc:2393] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 19: Already voted for candidate a1b891e53adc40a6a1ae813238321e93 in this term.
I20260709 12:18:48.884859 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:48.885984 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:48.893036 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:48.864032 26308 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:48.886421 26240 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:48.907517 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 228548us
I20260709 12:18:48.888897 26189 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:48.929816 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:48.931974 26482 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:48.932425 26443 consensus_meta.cc:287] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.005s
I20260709 12:18:48.932865 26443 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.935618 21000 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:48.936342 21185 raft_consensus.cc:1240] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:48.938853 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:48.867897 26441 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.943229 21184 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:48.947117 26441 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:48.947417 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:48.948029 26510 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:48.949308 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:48.950832 21000 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:48.937363 26443 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:18:48.958453 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 278150us
I20260709 12:18:48.940143 26189 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:48.960024 21000 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:48.953846 26428 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:48.993693 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 125072us
I20260709 12:18:48.949748 26308 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:48.981456 26496 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:48.999250 21076 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
W20260709 12:18:48.992341 26540 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:18:49.029392 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 177475us
I20260709 12:18:49.035899 21103 raft_consensus.cc:3060] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:49.033951 20999 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:48.940886 26240 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:48.948760 26400 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260709 12:18:49.004477 25947 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:49.030627 26324 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:49.033203 26487 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:49.091109 26549 log.cc:927] Time spent T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 12:18:49.068331 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 77823.2us
W20260709 12:18:49.074194 26550 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:18:49.092732 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 58863.5us
I20260709 12:18:49.110908 20999 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.110404 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:49.059401 26545 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:49.109905 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.111050 21183 raft_consensus.cc:1240] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:49.061012 26429 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:18:49.092969 26116 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:49.106868 26199 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.139861 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:18:49.140498 26543 log.cc:927] Time spent T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:18:49.141768 26199 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:49.142385 26199 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.142956 26183 consensus_queue.cc:1059] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:18:49.143312 26544 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.143776 26544 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:49.145803 26544 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:49.118533 21182 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 16.
I20260709 12:18:49.114194 26431 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:49.071480 26189 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:49.136821 26493 consensus_meta.cc:287] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.004s
W20260709 12:18:49.139920 26539 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 12:18:49.150506 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.164796 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 131478us
I20260709 12:18:49.151453 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:49.154206 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:49.166435 21185 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:49.168859 26183 raft_consensus.cc:3055] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:49.169245 26183 raft_consensus.cc:740] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:49.170092 26183 consensus_queue.cc:260] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.171648 26183 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:49.173705 26430 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:49.174185 21186 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 19.
W20260709 12:18:49.162935 26303 consensus_meta.cc:287] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.000s
I20260709 12:18:49.175371 26303 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.177340 26303 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:49.179121 21077 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:49.179982 26493 consensus_queue.cc:1059] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:49.181173 26493 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:49.181514 26493 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.181807 26493 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:49.183130 26563 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:49.183527 26563 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:49.184301 26563 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.185444 26563 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:49.187377 26562 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:18:49.187561 21075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.190589 21184 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:49.148180 26545 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:49.192970 26545 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.165977 21747 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:49.199405 21183 raft_consensus.cc:1240] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:49.203300 26236 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:49.139411 26548 log.cc:927] Time spent T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:18:49.205308 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:49.208005 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:49.208552 21036 raft_consensus.cc:3060] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:49.211138 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:49.211652 26493 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:49.213655 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:49.214334 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:49.214496 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:49.214910 21109 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:49.213946 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:49.142777 26199 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.193328 21077 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:49.160560 21103 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:18:49.224403 21105 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:49.230171 21036 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:49.237576 21104 raft_consensus.cc:2468] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:49.232697 21076 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.237463 21149 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.112226 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.236717 21151 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:18:49.243484 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 190449us
W20260709 12:18:49.244720 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 51492.5us
I20260709 12:18:49.243935 21110 raft_consensus.cc:2468] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
W20260709 12:18:49.248310 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 136141us
I20260709 12:18:49.249054 20999 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.110335 26487 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:49.226243 26431 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.250885 20999 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.265169 21149 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:49.265954 21183 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:18:49.269757 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:49.287447 21183 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:49.271368 20999 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.289700 21105 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:49.289947 21076 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.250109 26429 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:49.292600 21177 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:49.239167 26308 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:18:49.266899 26482 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:49.258953 26496 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:49.304196 21109 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
W20260709 12:18:49.290978 26319 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.009s	sys 0.006s
I20260709 12:18:49.272540 26183 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.287688 26432 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:49.286062 26513 raft_consensus.cc:2804] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:49.315255 21076 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.308995 26444 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:49.295156 26538 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:49.255016 26303 consensus_queue.cc:1059] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 12:18:49.326114 26319 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.010s	sys 0.007s
I20260709 12:18:49.286585 26431 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.350978 26513 raft_consensus.cc:697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:49.351420 26303 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:49.351827 26303 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:49.292459 26486 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:18:49.352720 26444 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:49.353160 26493 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:49.351675 26431 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:49.353590 26444 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.354326 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:49.354898 21742 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:49.356113 21034 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:49.357227 21030 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:49.357681 26491 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:49.358321 26541 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
W20260709 12:18:49.361264 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 46415.5us
I20260709 12:18:49.361689 26489 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:49.361984 21076 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.325862 26429 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:49.363008 26563 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:49.363582 26429 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:49.364481 21742 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:49.322268 26398 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:49.365778 21075 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:49.321491 21183 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:49.421083 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:49.424752 21036 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
W20260709 12:18:49.422619 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 56072us
I20260709 12:18:49.323716 26532 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 12:18:49.428678 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 62979.4us
I20260709 12:18:49.331296 25825 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:49.426944 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 155656us
I20260709 12:18:49.426775 21076 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.295833 26554 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 12:18:49.426265 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 155997us
W20260709 12:18:49.427893 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 60990.3us
I20260709 12:18:49.365006 26240 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:49.439898 21149 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:49.446403 26199 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:49.447516 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:49.461347 26303 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.466279 21002 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:49.472293 26579 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:49.472882 26579 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:49.475113 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:49.481604 21184 raft_consensus.cc:2410] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:18:49.482750 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 222001us
I20260709 12:18:49.482775 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:49.351923 26513 consensus_queue.cc:237] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.438483 26493 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:49.441699 26514 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:49.490341 26444 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:49.490774 26444 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.491179 26444 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:49.491477 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:49.492106 21036 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
W20260709 12:18:49.484740 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 46921us
I20260709 12:18:49.438520 26443 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:18:49.484202 26209 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:49.499239 26209 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:49.500126 26209 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.489259 25825 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:49.489607 26486 consensus_queue.cc:1059] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:49.501533 26486 consensus_queue.cc:1243] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:49.502043 26486 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:49.502348 26486 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:49.438436 26400 consensus_queue.cc:1048] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:18:49.496282 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:49.503155 26486 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.497726 26579 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.506656 26486 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:49.513918 25825 consensus_queue.cc:1059] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:18:49.517347 25825 raft_consensus.cc:3055] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:49.517733 25825 raft_consensus.cc:740] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:49.518621 25825 consensus_queue.cc:260] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.520056 25825 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:49.521176 26572 log.cc:927] Time spent T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
I20260709 12:18:49.506927 26493 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:49.528390 26493 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:49.541492 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:49.538677 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:49.558521 21109 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:18:49.544246 21180 raft_consensus.cc:1275] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:18:49.559722 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:49.560561 21183 raft_consensus.cc:2410] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:18:49.550002 21149 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:18:49.553690 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.556557 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:49.568347 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.590868 21712 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.569866 26199 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:49.576467 26491 raft_consensus.cc:2804] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:49.571329 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:18:49.598884 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.581998 26236 raft_consensus.cc:2749] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:49.601303 20999 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.612577 21107 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:49.595468 26199 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.616796 26199 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:49.617645 26303 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:49.616519 21077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.591811 26575 consensus_queue.cc:1048] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:18:49.593653 26200 raft_consensus.cc:2749] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:49.624442 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:49.625159 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:49.605981 26579 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:49.619910 26491 raft_consensus.cc:697] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:49.632706 26487 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:49.634770 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:49.609484 26583 raft_consensus.cc:2764] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:18:49.654278 26236 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:49.663666 25825 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.664242 25825 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.665405 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:49.674685 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:49.665997 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:49.668377 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:49.669052 21035 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:49.673627 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:49.671483 26432 raft_consensus.cc:493] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:49.678584 21028 raft_consensus.cc:1240] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:49.662431 26579 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:49.680235 21029 raft_consensus.cc:1240] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:18:49.665112 26308 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.680944 21027 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:49.683543 25825 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:49.684196 21029 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:49.695561 21036 raft_consensus.cc:2468] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:49.698292 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.699739 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.700670 26493 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:49.700870 26429 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:49.701540 26429 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:49.663426 26236 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.681707 26432 raft_consensus.cc:515] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:49.734198 26589 log.cc:927] Time spent T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:49.712738 26579 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:49.686866 26308 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.762144 26583 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.783363 26199 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:49.784162 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 77075us
I20260709 12:18:49.683944 26491 consensus_queue.cc:237] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.795439 21033 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:49.799212 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:49.811483 21183 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:18:49.800844 21076 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.803665 25825 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:49.813067 21033 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:18:49.813733 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.822729 26189 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:49.829085 26308 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:49.830997 21032 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:49.831837 21032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:49.832391 21032 raft_consensus.cc:606] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.832691 21032 raft_consensus.cc:614] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:49.837217 21031 raft_consensus.cc:2376] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15. Re-sending same reply.
I20260709 12:18:49.838778 26236 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:49.804276 26568 consensus_queue.cc:1059] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:18:49.839864 26568 raft_consensus.cc:3055] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:49.840229 26568 raft_consensus.cc:740] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:49.840945 21183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:49.841591 21183 raft_consensus.cc:606] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.841921 21183 raft_consensus.cc:614] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:49.846203 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45441.3us
I20260709 12:18:49.787714 20929 catalog_manager.cc:5697] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 3 to 9, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 9 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:49.851585 26563 raft_consensus.cc:2804] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:49.861029 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:49.852895 26579 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:49.815832 26583 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.855044 26432 leader_election.cc:290] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:49.855688 21110 raft_consensus.cc:1275] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:49.841015 26568 consensus_queue.cc:260] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.861370 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:49.866878 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 53199us
I20260709 12:18:49.873536 20999 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.875552 21027 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:18:49.805889 26428 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:18:49.805446 26324 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:18:49.859627 20929 catalog_manager.cc:5697] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 11 to 12, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 12 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:49.909737 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:49.911041 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:49.914768 25825 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:49.915226 25825 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.915544 25825 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:49.917691 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:49.920678 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 47221.8us
I20260709 12:18:49.934463 21184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fa56a6078064852ac53dd912136460b"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:49.935055 21184 raft_consensus.cc:606] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.935503 21184 raft_consensus.cc:614] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:49.876119 26563 raft_consensus.cc:697] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:49.937206 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:49.907692 26116 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:49.941602 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:49.944223 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:49.942826 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2747202c22c64b3cb3fb096f2f65e662" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:49.933135 26434 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:49.952700 25825 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:49.954541 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:49.956254 21104 raft_consensus.cc:2393] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:49.907215 26240 consensus_queue.cc:1048] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:18:49.938316 26568 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:49.956954 20999 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:49.973057 21076 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:49.986922 25825 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:49.914491 26493 consensus_queue.cc:1175] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "694635cc4a20455fbbec925e0a84a1ee" responder_term: 15 status { last_received { term: 15 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 15 index: 8 } }
W20260709 12:18:50.064252 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 112918us
I20260709 12:18:50.065833 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:49.929224 25482 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:18:50.066439 21034 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:50.067868 26549 log.cc:927] Time spent T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:18:50.087576 21183 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:50.090111 21184 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:18:50.072669 26591 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
W20260709 12:18:50.083518 26590 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:18:50.088428 26602 log.cc:927] Time spent T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:18:50.070526 26553 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:18:50.112936 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 139944us
I20260709 12:18:50.089287 26430 raft_consensus.cc:2764] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 12:18:50.108466 26486 consensus_meta.cc:287] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Time spent flushing consensus metadata: real 0.581s	user 0.000s	sys 0.012s
W20260709 12:18:50.107678 26444 consensus_meta.cc:287] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.003s
I20260709 12:18:50.131771 21105 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:18:50.132169 21105 pending_rounds.cc:85] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 5
I20260709 12:18:50.132370 21105 pending_rounds.cc:107] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:18:50.132581 21105 raft_consensus.cc:2889] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:50.105129 26199 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:50.108944 26553 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:50.140030 21034 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:50.095422 26569 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.188s
I20260709 12:18:50.145222 21151 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
W20260709 12:18:50.149106 26600 log.cc:927] Time spent T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 12:18:50.145164 26601 log.cc:927] Time spent T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:50.096086 26563 consensus_queue.cc:237] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.137190 26433 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:18:50.191097 20929 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 8 to 12, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 12 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:50.195747 26553 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.197218 26553 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:50.146030 26430 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:18:50.139631 26444 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.204051 21185 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:50.205087 26444 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:50.207046 26611 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 12:18:50.173028 26583 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:50.173707 26240 raft_consensus.cc:2804] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:50.210954 26240 raft_consensus.cc:697] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:50.211874 26240 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.219870 20929 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.226886 21742 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:50.234836 21036 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:50.235993 26619 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.236496 26619 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.236001 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:50.239576 21035 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:50.240943 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 284055us
I20260709 12:18:50.241539 25825 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:50.244560 21032 raft_consensus.cc:1240] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:18:50.244664 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:50.246994 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:50.248095 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:50.250633 21035 raft_consensus.cc:2468] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
I20260709 12:18:50.251160 21033 raft_consensus.cc:1240] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:50.255405 21027 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:18:50.259569 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 344804us
I20260709 12:18:50.261130 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:50.262259 21076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:50.234578 26605 log.cc:927] Time spent T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:18:50.265761 21110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:50.281718 21036 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:18:50.284032 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:50.284619 21106 raft_consensus.cc:3060] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.286106 21107 raft_consensus.cc:3060] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:50.238811 26619 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:50.292593 21110 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.258677 26568 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:18:50.338446 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:50.339210 21036 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:50.342268 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:50.293911 26516 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:50.348814 21110 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:50.352523 25825 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:50.307438 26303 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:50.370078 21110 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:18:50.319762 26603 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:50.374917 26199 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:50.319867 26429 consensus_queue.cc:1059] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:18:50.380048 26429 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:50.342676 26430 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.380371 26429 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:50.382282 26429 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.387850 26430 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.388002 26603 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.409626 26532 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:50.411566 21105 raft_consensus.cc:1275] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:50.403957 26624 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.418480 21106 raft_consensus.cc:2468] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:50.409469 26430 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:50.372704 26303 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.440332 26583 raft_consensus.cc:2749] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:50.447589 26189 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:18:50.506342 26623 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:18:50.448730 26624 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.519084 26303 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:50.524396 21105 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:50.608198 21107 raft_consensus.cc:1275] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:50.528272 26308 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:50.600425 26623 log.cc:927] Time spent T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:18:50.586776 26611 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:50.700853 21027 raft_consensus.cc:606] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:50.701288 21027 raft_consensus.cc:614] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:50.704407 26625 log.cc:927] Time spent T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:18:50.704241 26504 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.168s
W20260709 12:18:50.705439 26629 log.cc:927] Time spent T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:18:50.707532 26603 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:50.628201 26538 consensus_queue.cc:1048] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 12:18:50.702404 26638 log.cc:927] Time spent T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:50.697959 26611 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.633853 26308 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.719805 26611 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:50.721475 26308 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:50.736583 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:50.737197 21029 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:18:50.735587 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:50.738260 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:50.741839 26563 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:50.742681 26563 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:50.746134 26563 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:50.741232 26493 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.747840 26493 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.750875 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:50.751446 21029 raft_consensus.cc:2468] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:50.751475 26398 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:50.756263 26398 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.761824 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:50.768035 21032 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:50.769129 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:50.769719 21184 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:50.769810 26433 consensus_queue.cc:1059] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:50.770601 26433 consensus_queue.cc:1243] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:50.771900 26400 raft_consensus.cc:3055] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:50.772260 26400 raft_consensus.cc:740] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:50.772732 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:50.773290 21032 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:50.773005 26400 consensus_queue.cc:260] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.774148 26400 raft_consensus.cc:3060] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:50.774050 26610 consensus_queue.cc:1175] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" responder_term: 13 status { last_received { term: 10 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:50.781090 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:50.781875 21105 raft_consensus.cc:2393] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 16: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:50.784004 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:50.784564 21182 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:18:50.769834 26492 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:50.796415 21107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:50.843194 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 60212.8us
W20260709 12:18:50.843278 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 56288.9us
I20260709 12:18:50.795886 21076 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:50.761473 26398 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:50.852594 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 56769.1us
I20260709 12:18:50.856532 26486 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:50.856992 26486 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.857309 26486 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.859866 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:50.794564 26492 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:50.862326 26639 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.150s	user 0.003s	sys 0.001s
W20260709 12:18:50.865278 26641 log.cc:927] Time spent T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:18:50.877502 21182 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:50.884049 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:50.896234 21742 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:18:50.898736 21002 leader_election.cc:304] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:50.879683 26493 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:50.905192 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:50.907732 21182 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:50.909498 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:50.910238 21151 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:50.911085 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:50.913122 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:50.914546 21179 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:50.915895 25482 raft_consensus.cc:2804] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:50.916371 25482 raft_consensus.cc:697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:50.917109 25482 consensus_queue.cc:237] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:50.911836 26510 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:18:50.949862 21182 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:18:50.908411 26189 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.908187 26583 raft_consensus.cc:2749] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:50.954221 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:50.960294 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 81783.8us
I20260709 12:18:50.961524 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:50.954551 26645 log.cc:927] Time spent T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:18:50.968736 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:50.975741 26646 log.cc:927] Time spent T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:50.942188 26209 consensus_queue.cc:1048] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:18:50.950944 25947 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:18:50.957643 26189 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:50.995409 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 75362us
I20260709 12:18:50.984570 26492 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:50.996867 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.001832 21002 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.004390 26496 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:51.005023 26496 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:51.005390 26579 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:51.005955 26579 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:51.011252 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.015647 21002 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.017632 21002 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.019232 21181 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
W20260709 12:18:51.018517 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 57529.4us
I20260709 12:18:51.021603 26432 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:50.996510 26303 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.027444 21111 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:51.008600 26429 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:51.038650 21111 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:51.024201 26603 raft_consensus.cc:3060] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:51.049932 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 128141us
I20260709 12:18:51.057106 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.057492 25482 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:51.059209 21109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56400 (request call id 2345) took 1130 ms. Trace:
I20260709 12:18:51.066116 25482 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:51.006814 26579 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.059551 21109 rpcz_store.cc:276] 0709 12:18:49.928860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.928961 (+   101us) service_pool.cc:224] Handling call
0709 12:18:49.929222 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:49.934804 (+  5582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.934830 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:50.518014 (+583184us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b2c0005c228. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9e28da11 00007fcb9e29d372 00007fcb9f9cfa01 00007fcb9f99443a 00007fcb9f99383e 00007fcba4958419 00007fcb9decfbd4 00007fcb9decfb62 00007fcb9decfa91 00007fcb9decfa0c 00007fcb9dececc2
0709 12:18:50.518439 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:18:50.734582 (+216143us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:50.741550 (+  6968us) log.cc:844] Serialized 14 byte log entry
0709 12:18:50.751235 (+  9685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:50.751301 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:51.050571 (+299270us) raft_consensus.cc:1685] finished
0709 12:18:51.059039 (+  8468us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.059159 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14657,"prepare.queue_time_us":6809,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":20649,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9812,"spinlock_wait_cycles":6157824,"thread_start_us":182890,"threads_started":1,"wal-append.queue_time_us":234981}
I20260709 12:18:51.064357 21151 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:51.031611 26303 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.078284 25482 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:51.078697 25482 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.079027 25482 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.097066 25482 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.102905 25482 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:51.105612 26189 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:51.107887 26611 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.108368 26611 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.109583 26486 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.110316 26611 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.110883 21108 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 16: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:51.076982 26240 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 12:18:51.113169 26631 log.cc:927] Time spent T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.650s	user 0.001s	sys 0.006s
I20260709 12:18:51.113763 26624 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:51.118371 21032 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:18:51.119365 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.119940 21104 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:51.118067 26398 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.122329 20999 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:51.133684 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:51.134374 21033 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
W20260709 12:18:51.140813 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 65018.5us
I20260709 12:18:51.110781 26611 raft_consensus.cc:493] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.143561 26486 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.145138 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:51.146178 21031 raft_consensus.cc:2393] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 16: Already voted for candidate a62242aa80cd4affa87dc4a3cf6b64ec in this term.
I20260709 12:18:51.151576 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:51.137202 26432 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:51.156531 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:51.166406 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 90768.3us
I20260709 12:18:51.169559 21149 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.172668 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:51.168615 21077 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:51.173230 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:51.173779 21031 raft_consensus.cc:3060] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.174574 21184 raft_consensus.cc:3060] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.179893 26618 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:51.180292 26618 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.180826 26398 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.167558 26432 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.182583 26432 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:51.183014 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:51.183561 21036 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:51.185364 21077 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:51.186517 21031 raft_consensus.cc:2468] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:51.187041 26514 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:51.187623 21151 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:51.188561 26514 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:51.189901 26504 raft_consensus.cc:2804] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:51.190392 26504 raft_consensus.cc:697] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:51.191256 26504 consensus_queue.cc:237] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.180611 26618 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:51.193153 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:18:51.195523 26662 log.cc:927] Time spent T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:18:51.197271 26651 log.cc:927] Time spent T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:18:51.191145 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.201349 21109 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:51.186719 21077 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:51.205673 21036 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:51.207934 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:51.223646 26510 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:51.227519 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:51.228289 21028 raft_consensus.cc:2393] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 16: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:51.211220 26116 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:51.149962 26563 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:18:51.234685 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:51.237160 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:51.238011 26303 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.239333 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.151629 26611 raft_consensus.cc:515] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.245205 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:51.245762 21185 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:51.250209 21077 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:51.232709 26621 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:51.244329 26619 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:51.271518 21179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db9d39844048444b8a7293196d1349e9"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:51.276261 26611 leader_election.cc:290] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.277225 26619 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:51.281551 21184 raft_consensus.cc:1275] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:18:51.282241 25482 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:51.283949 21179 raft_consensus.cc:606] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.284358 21179 raft_consensus.cc:614] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:51.286762 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:51.256315 26621 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.243036 26116 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:51.325114 26644 log.cc:927] Time spent T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.613s	user 0.005s	sys 0.000s
I20260709 12:18:51.333133 26603 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:51.287438 26428 raft_consensus.cc:2749] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:51.336174 21185 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:51.319594 26621 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:51.322618 26240 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:51.301959 26398 consensus_queue.cc:1048] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:18:51.349478 21036 raft_consensus.cc:1275] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:51.287552 26619 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.359695 26603 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:51.382943 26672 log.cc:927] Time spent T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:18:51.353194 26240 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.406219 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:18:51.421422 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 81177.1us
I20260709 12:18:51.418107 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b72acae564588a3a276b7b233d977" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:51.422863 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.408558 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:51.431046 21032 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:51.430781 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:51.444638 21076 leader_election.cc:304] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:51.392153 26116 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:51.371658 26618 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.448256 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60004 (request call id 2153) took 1303 ms. Trace:
I20260709 12:18:51.449265 21034 rpcz_store.cc:276] 0709 12:18:50.144736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.146561 (+  1825us) service_pool.cc:224] Handling call
0709 12:18:50.237120 (+ 90559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:50.244359 (+  7239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:50.244387 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:50.244824 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:18:50.627577 (+382753us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:50.700532 (+ 72955us) log.cc:844] Serialized 14 byte log entry
0709 12:18:50.700741 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:50.700820 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:50.746118 (+ 45298us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b180019a5c0. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcba576fab1 00007fcba577c281 00007fcb9c8a73f3 00007fcb9c8a97c1 00007fcb9c8a9779 00007fcb9c8a9709 00007fcb9c8a96d1 00007fcb9c8a89cd 0000000000388634 0000000000388479 00007fcb9c88a83a
0709 12:18:51.324592 (+578474us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:51.448066 (+123474us) raft_consensus.cc:1685] finished
0709 12:18:51.448086 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.448195 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6705,"prepare.queue_time_us":73429,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":6877,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":14097,"spinlock_wait_cycles":30375040,"thread_start_us":382260,"threads_started":1,"wal-append.queue_time_us":467121}
I20260709 12:18:51.394635 26603 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.390609 26432 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.446863 26553 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:18:51.448760 26355 raft_consensus.cc:2749] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:51.466370 20999 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.469215 25825 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:51.477883 21029 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:51.527439 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:51.468719 26553 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:51.539237 26665 log.cc:927] Time spent T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: Append to log took a long time: real 0.369s	user 0.000s	sys 0.003s
I20260709 12:18:51.470780 26676 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:18:51.532955 26640 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.829s	user 0.004s	sys 0.002s
W20260709 12:18:51.556370 26681 log.cc:927] Time spent T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:18:51.563555 26618 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.567059 26240 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:51.572517 21110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56406 (request call id 2479) took 1195 ms. Trace:
I20260709 12:18:51.572914 21110 rpcz_store.cc:276] 0709 12:18:50.376821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.388174 (+ 11353us) service_pool.cc:224] Handling call
0709 12:18:50.388447 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:50.388746 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:50.388773 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:50.389113 (+   340us) log.cc:844] Serialized 26 byte log entry
0709 12:18:50.466987 (+ 77874us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:50.467024 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:50.467086 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:51.453756 (+986670us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4400022b4c. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9c72fdb1 00007fcb9c7cdc85 00007fcb9c7ce6a2 00007fcb9f5401db 00007fcb9f53baaf 00007fcb9f52f86e 00007fcb9f52ebb6 00007fcb9f52e7d8 00007fcb9f538221 00007fcb9f5381d9 00007fcb9f538169
0709 12:18:51.572235 (+118479us) raft_consensus.cc:1685] finished
0709 12:18:51.572259 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.572458 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2715,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":4960,"spinlock_wait_cycles":57733504,"thread_start_us":47768,"threads_started":1,"wal-append.queue_time_us":207196}
I20260709 12:18:51.576367 26603 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.578183 26553 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:51.580178 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:18:51.586583 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.587379 21111 raft_consensus.cc:2368] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 16. Current term is 17.
I20260709 12:18:51.596439 26432 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.617017 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:51.620393 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:51.620965 21035 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:51.628633 21149 leader_election.cc:400] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 16. Current term is 17.
I20260709 12:18:51.628994 21149 leader_election.cc:403] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:51.644160 21002 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.649165 26516 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:51.650965 26538 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:51.655488 21109 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:18:51.655815 21109 pending_rounds.cc:85] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 8
I20260709 12:18:51.656016 21109 pending_rounds.cc:107] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:18:51.656265 21109 raft_consensus.cc:2889] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:51.656033 26621 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.667933 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:51.670620 21108 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:51.674449 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:51.680097 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.684648 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:51.684996 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:51.686443 21179 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:51.688236 21111 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:51.688650 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:51.688238 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:51.694201 21035 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:51.662338 26666 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:18:51.696024 21036 raft_consensus.cc:1275] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:51.701339 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:51.704602 21108 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:18:51.708207 21181 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 15: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:51.700197 21076 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:51.712625 26618 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:51.713114 26618 raft_consensus.cc:697] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:51.713872 26618 consensus_queue.cc:237] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.716053 26581 consensus_queue.cc:1048] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:51.679255 26676 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.681618 26553 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
W20260709 12:18:51.730962 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 57573.2us
I20260709 12:18:51.734176 20999 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.739164 20999 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:51.709344 26603 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:51.750928 26676 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.752156 26658 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:51.759855 25825 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:51.760324 25825 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:51.684206 26516 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:18:51.761047 25825 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.767043 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:51.767642 21033 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:51.770313 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:51.776319 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:51.778158 26428 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:51.778556 26428 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:18:51.778899 26428 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:51.736025 26553 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.783429 26553 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:51.707005 25947 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:18:51.786348 21182 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 17: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:51.788177 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:51.791378 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.803930 21002 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.785300 26398 raft_consensus.cc:476] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 12:18:51.793946 25947 consensus_queue.cc:1243] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Peer a62242aa80cd4affa87dc4a3cf6b64ec log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:51.808827 26303 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:51.821885 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:51.792989 26680 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:18:51.830813 21029 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:51.825161 26666 consensus_queue.cc:1048] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:18:51.866657 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:51.867435 21104 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee in current term 15: Already voted for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in this term.
I20260709 12:18:51.896070 20932 catalog_manager.cc:5697] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 12 to 14, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 14 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.856158 26532 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:18:51.897743 20932 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 12 to 13, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 13 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:51.866875 26621 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:51.908844 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:51.904498 26684 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.915117 26684 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:51.917119 26684 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:51.919337 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:51.919941 21036 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:18:51.921080 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:51.922096 21179 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:51.929435 26538 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643) with higher term. Message: Invalid argument: T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 16. Current term is 17.
I20260709 12:18:51.943539 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:51.944564 26189 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:51.958501 26489 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:18:51.958485 26443 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:51.973101 26443 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.973459 26443 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:51.984750 21180 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:51.980791 26428 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:52.002102 21108 pending_rounds.cc:85] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting all ops after (but not including) 7
I20260709 12:18:52.002439 21108 pending_rounds.cc:107] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:18:52.002672 21108 raft_consensus.cc:2889] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:52.005362 21031 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:52.008354 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:52.004554 21104 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:18:52.011327 26486 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:52.021750 26443 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:52.037355 21103 raft_consensus.cc:1275] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:52.043891 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:52.048861 26443 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:52.053037 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:52.055049 21149 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:52.058424 26664 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:18:52.093894 26698 log.cc:927] Time spent T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:18:52.045192 26581 consensus_queue.cc:1048] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:18:52.133009 21032 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:52.134250 21076 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:52.135640 26493 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:52.136109 26493 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:52.137012 26493 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:52.175964 26563 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.221800 21182 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:52.235297 25825 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:52.212433 26563 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:52.319555 26428 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:52.336133 26563 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:18:52.370693 26703 log.cc:927] Time spent T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:18:52.380959 26583 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.381513 26583 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:52.383450 26583 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:52.477458 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
W20260709 12:18:52.479189 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 78464.1us
I20260709 12:18:52.481494 21029 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:52.509240 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:18:52.569592 26709 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 12:18:52.578926 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:52.633729 20932 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 17 to 19, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 19 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:52.635234 20932 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 9, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 9 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:52.636545 20932 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 11 to 13, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 13 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:52.638387 20932 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 10, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 10 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:52.639794 20932 catalog_manager.cc:5697] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.641332 20932 catalog_manager.cc:5697] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:52.661229 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 112905us
I20260709 12:18:52.683715 20932 catalog_manager.cc:5697] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 12 to 18, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 18 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.685631 20932 catalog_manager.cc:5697] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 7 to 10, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 10 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.687693 20932 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 9 to 13, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 13 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:52.689045 20932 catalog_manager.cc:5697] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 7 to 15, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 15 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.690889 20932 catalog_manager.cc:5697] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 8 to 13, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 13 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.729700 20999 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:52.680711 26568 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:18:52.750243 26516 raft_consensus.cc:2749] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:52.784998 21108 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:52.798878 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:52.808841 21177 raft_consensus.cc:2368] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 17. Current term is 18.
I20260709 12:18:52.818444 21179 raft_consensus.cc:1275] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:52.823697 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:18:52.833401 26709 log.cc:927] Time spent T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: Append to log took a long time: real 0.115s	user 0.004s	sys 0.000s
I20260709 12:18:52.808133 26579 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:18:52.864596 21077 leader_election.cc:400] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Vote denied by peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737) with higher term. Message: Invalid argument: T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 17. Current term is 18.
I20260709 12:18:52.865556 21077 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:52.868862 26398 consensus_queue.cc:1048] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:18:52.867825 26489 raft_consensus.cc:2749] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:52.925238 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 57834.3us
I20260709 12:18:52.910264 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:52.982227 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 132730us
W20260709 12:18:52.991752 20929 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49692 (request call id 199) took 45718 ms (client timeout 15000 ms). Trace:
I20260709 12:18:53.042811 21179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:53.043497 21179 raft_consensus.cc:606] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:53.043996 21179 raft_consensus.cc:614] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:53.055958 21035 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:53.059353 21181 raft_consensus.cc:1240] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:53.060004 26568 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:53.063990 26568 consensus_queue.cc:1059] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:53.064739 26568 raft_consensus.cc:3055] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:53.064975 21032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:53.065601 21032 raft_consensus.cc:606] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:53.065948 21032 raft_consensus.cc:614] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:53.013288 20929 rpcz_store.cc:269] 0709 12:18:07.273558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.291141 (+ 17583us) service_pool.cc:224] Handling call
0709 12:18:09.528904 (+2237763us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fe090 00007fcb9f99cf3a 00007fcba5752e9c 00007fcba585104e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc 00007fcba3d11392 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:52.991650 (+43462746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:50.742490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:50.743063 (+   573us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:50.743099 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:18:50.743115 (+    16us) tablet.cc:662] Decoding operations
0709 12:18:50.743631 (+   516us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:50.743700 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:50.743725 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:18:50.744082 (+   357us) tablet.cc:701] Row locks acquired
0709 12:18:50.744099 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:18:50.744220 (+   121us) write_op.cc:270] Start()
0709 12:18:50.744321 (+   101us) write_op.cc:276] Timestamp: P: 1783599530744181 usec, L: 0
0709 12:18:50.744341 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:18:50.744912 (+   571us) log.cc:844] Serialized 1689 byte log entry
0709 12:18:51.100571 (+355659us) op_driver.cc:464] REPLICATION: finished
0709 12:18:51.368190 (+267619us) write_op.cc:301] APPLY: starting
0709 12:18:51.373546 (+  5356us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:51.404975 (+ 31429us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:51.405081 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:51.478983 (+ 73902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:51.531184 (+ 52201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:18:51.535350 (+  4166us) write_op.cc:312] APPLY: finished
0709 12:18:51.574202 (+ 38852us) log.cc:844] Serialized 49 byte log entry
0709 12:18:51.574376 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.574485 (+   109us) write_op.cc:454] Released schema lock
0709 12:18:51.574528 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:51.619829 (+ 45301us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.619859 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":453459,"reported_tablets":52,"spinlock_wait_cycles":1588787968,"child_traces":[["op",{"apply.queue_time_us":247706,"apply.run_cpu_time_us":7461,"apply.run_wall_time_us":215856,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20839,"num_ops":4,"prepare.queue_time_us":327838,"prepare.run_cpu_time_us":12670,"prepare.run_wall_time_us":141449,"raft.queue_time_us":99168,"raft.run_cpu_time_us":10165,"raft.run_wall_time_us":218122,"replication_time_us":343295,"thread_start_us":536528,"threads_started":4,"wal-append.queue_time_us":142585,"wal-append.run_cpu_time_us":5196,"wal-append.run_wall_time_us":1686052}]]}
I20260709 12:18:53.065033 26568 raft_consensus.cc:740] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:53.072193 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:53.072729 21027 raft_consensus.cc:606] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:53.073088 21027 raft_consensus.cc:614] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:53.071756 26568 consensus_queue.cc:260] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:53.075485 26568 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:53.077138 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:53.077679 21027 raft_consensus.cc:606] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:53.077989 21027 raft_consensus.cc:614] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:53.080241 21036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:53.080747 21036 raft_consensus.cc:606] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:53.081066 21036 raft_consensus.cc:614] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:53.083287 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:53.084975 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:53.108961 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:53.281157 20932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45550 (request call id 119) took 3769 ms. Trace:
I20260709 12:18:53.281566 20932 rpcz_store.cc:276] 0709 12:18:49.511512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.513043 (+  1531us) service_pool.cc:224] Handling call
0709 12:18:53.281065 (+3768022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.048678 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.049227 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.049263 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:18:53.049281 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:53.050384 (+  1103us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.050444 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.050472 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:18:53.070124 (+ 19652us) tablet.cc:701] Row locks acquired
0709 12:18:53.070152 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:18:53.070859 (+   707us) write_op.cc:270] Start()
0709 12:18:53.070987 (+   128us) write_op.cc:276] Timestamp: P: 1783599533070792 usec, L: 0
0709 12:18:53.071010 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.071684 (+   674us) log.cc:844] Serialized 5156 byte log entry
0709 12:18:53.138235 (+ 66551us) op_driver.cc:464] REPLICATION: finished
0709 12:18:53.179338 (+ 41103us) write_op.cc:301] APPLY: starting
0709 12:18:53.179418 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:53.207424 (+ 28006us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:53.207537 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:53.251012 (+ 43475us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:53.251263 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:18:53.251310 (+    47us) write_op.cc:312] APPLY: finished
0709 12:18:53.251614 (+   304us) log.cc:844] Serialized 121 byte log entry
0709 12:18:53.265035 (+ 13421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.265182 (+   147us) write_op.cc:454] Released schema lock
0709 12:18:53.265230 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:53.265632 (+   402us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.265660 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1166635,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":40851,"apply.run_cpu_time_us":15428,"apply.run_wall_time_us":86272,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":103546,"prepare.run_cpu_time_us":10692,"prepare.run_wall_time_us":58768,"raft.queue_time_us":26724,"raft.run_cpu_time_us":28093,"raft.run_wall_time_us":59809,"replication_time_us":67073,"thread_start_us":169483,"threads_started":4,"wal-append.queue_time_us":35668}]]}
I20260709 12:18:53.302202 20934 catalog_manager.cc:5697] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 5 to 6, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 6 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.358345 20929 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 10 to 19, leader changed from a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 19 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:53.360283 20929 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:18:53.431803 20930 catalog_manager.cc:5697] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 8 to 11, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.446993 20930 catalog_manager.cc:5697] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.453621 20934 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet f16c07bcae284f65a7c0ee0375e00769 with cas_config_opid_index 3: aborting the task: latest config opid_index 6; task opid_index 3
W20260709 12:18:53.459153 20934 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49692 (request call id 198) took 74229 ms (client timeout 15000 ms). Trace:
I20260709 12:18:53.459022 20930 catalog_manager.cc:5697] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 6 to 8, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 8 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.461796 20930 catalog_manager.cc:5697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 8 to 11, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.464021 20930 catalog_manager.cc:5697] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.466503 20930 catalog_manager.cc:5697] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 9 to 12, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 12 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.468674 20930 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 12 to 14, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 14 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.470134 20930 catalog_manager.cc:5697] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.472071 20930 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 10 to 11, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.474736 20930 catalog_manager.cc:5697] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 5 to 8, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 8 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:53.459601 20934 rpcz_store.cc:269] 0709 12:17:39.236425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.239114 (+  2689us) service_pool.cc:224] Handling call
0709 12:18:53.458697 (+74219583us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.342941 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.343458 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.343491 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:18:53.343504 (+    13us) tablet.cc:662] Decoding operations
0709 12:18:53.343806 (+   302us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.343859 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.343894 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:53.344068 (+   174us) tablet.cc:701] Row locks acquired
0709 12:18:53.344081 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:18:53.344209 (+   128us) write_op.cc:270] Start()
0709 12:18:53.344347 (+   138us) write_op.cc:276] Timestamp: P: 1783599533344167 usec, L: 0
0709 12:18:53.344365 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.344851 (+   486us) log.cc:844] Serialized 538 byte log entry
0709 12:18:53.346284 (+  1433us) op_driver.cc:464] REPLICATION: finished
0709 12:18:53.346702 (+   418us) write_op.cc:301] APPLY: starting
0709 12:18:53.346776 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:53.347568 (+   792us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:53.347660 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:53.348306 (+   646us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:53.348455 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:18:53.348498 (+    43us) write_op.cc:312] APPLY: finished
0709 12:18:53.348660 (+   162us) log.cc:844] Serialized 25 byte log entry
0709 12:18:53.348798 (+   138us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.348875 (+    77us) write_op.cc:454] Released schema lock
0709 12:18:53.348922 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:53.349246 (+   324us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.349271 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3899961,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":233,"apply.run_cpu_time_us":2495,"apply.run_wall_time_us":2496,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":106,"prepare.run_cpu_time_us":2201,"prepare.run_wall_time_us":2210,"replication_time_us":1797,"spinlock_wait_cycles":1408}]]}
I20260709 12:18:53.476958 20930 catalog_manager.cc:5697] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 11 to 12, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 12 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.478994 20930 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 9 to 10, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 10 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:53.624826 20930 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49692 (request call id 200) took 22252 ms (client timeout 15000 ms). Trace:
W20260709 12:18:53.625201 20930 rpcz_store.cc:269] 0709 12:18:31.372593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.373703 (+  1110us) service_pool.cc:224] Handling call
0709 12:18:53.624725 (+22251022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.488717 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.489223 (+   506us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.489254 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:18:53.489270 (+    16us) tablet.cc:662] Decoding operations
0709 12:18:53.490246 (+   976us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.490301 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.490327 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:18:53.495725 (+  5398us) tablet.cc:701] Row locks acquired
0709 12:18:53.495750 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:18:53.495877 (+   127us) write_op.cc:270] Start()
0709 12:18:53.495991 (+   114us) write_op.cc:276] Timestamp: P: 1783599533495836 usec, L: 0
0709 12:18:53.496014 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.496504 (+   490us) log.cc:844] Serialized 4770 byte log entry
0709 12:18:53.498475 (+  1971us) op_driver.cc:464] REPLICATION: finished
0709 12:18:53.499042 (+   567us) write_op.cc:301] APPLY: starting
0709 12:18:53.499113 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:53.518498 (+ 19385us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:53.518592 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:53.559201 (+ 40609us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:53.559411 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:18:53.559452 (+    41us) write_op.cc:312] APPLY: finished
0709 12:18:53.559731 (+   279us) log.cc:844] Serialized 113 byte log entry
0709 12:18:53.566952 (+  7221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.567090 (+   138us) write_op.cc:454] Released schema lock
0709 12:18:53.567139 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:53.567474 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.567501 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":696096,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":362,"apply.run_cpu_time_us":14198,"apply.run_wall_time_us":68408,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50136,"num_ops":12,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":3704,"prepare.run_wall_time_us":8023,"replication_time_us":2339}]]}
I20260709 12:18:53.641485 20933 catalog_manager.cc:5697] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 9, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 9 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.643226 20933 catalog_manager.cc:5697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.644793 20933 catalog_manager.cc:5697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:53.646018 20933 catalog_manager.cc:5697] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 9 to 10, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 10 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.648711 20933 catalog_manager.cc:5697] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 11 to 12, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 12 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.659580 20933 catalog_manager.cc:5697] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 8 to 9, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 9 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.661244 20933 catalog_manager.cc:5697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.662882 20933 catalog_manager.cc:5697] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 12 to 14, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 14 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:53.664273 20933 catalog_manager.cc:5697] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 7, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 7 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:53.665843 20933 catalog_manager.cc:5697] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 6 to 8, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 8 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.669777 20933 catalog_manager.cc:5697] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 8 to 9, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 9 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.683449 20933 catalog_manager.cc:5697] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 8 to 13, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 13 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:53.685166 20933 catalog_manager.cc:5697] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 4 to 9, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 9 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:53.867179 20933 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49682 (request call id 222) took 20989 ms (client timeout 15000 ms). Trace:
W20260709 12:18:53.867671 20933 rpcz_store.cc:269] 0709 12:18:32.884453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.892967 (+  8514us) service_pool.cc:224] Handling call
0709 12:18:53.867100 (+20974133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.691147 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.691645 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.691677 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:18:53.691690 (+    13us) tablet.cc:662] Decoding operations
0709 12:18:53.692705 (+  1015us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.692754 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.692780 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:18:53.693841 (+  1061us) tablet.cc:701] Row locks acquired
0709 12:18:53.693859 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:18:53.693994 (+   135us) write_op.cc:270] Start()
0709 12:18:53.694112 (+   118us) write_op.cc:276] Timestamp: P: 1783599533693949 usec, L: 0
0709 12:18:53.694135 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.694659 (+   524us) log.cc:844] Serialized 5159 byte log entry
0709 12:18:53.696718 (+  2059us) op_driver.cc:464] REPLICATION: finished
0709 12:18:53.697071 (+   353us) write_op.cc:301] APPLY: starting
0709 12:18:53.697146 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:53.710572 (+ 13426us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:53.710660 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:53.724044 (+ 13384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:53.724270 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:18:53.724314 (+    44us) write_op.cc:312] APPLY: finished
0709 12:18:53.724616 (+   302us) log.cc:844] Serialized 121 byte log entry
0709 12:18:53.743271 (+ 18655us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.743412 (+   141us) write_op.cc:454] Released schema lock
0709 12:18:53.743461 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:53.743823 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.743857 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":14552,"apply.run_wall_time_us":46718,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54314,"num_ops":13,"prepare.queue_time_us":264,"prepare.run_cpu_time_us":3739,"prepare.run_wall_time_us":3740,"replication_time_us":2483}]]}
I20260709 12:18:53.884845 20927 catalog_manager.cc:5697] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 12 to 13, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 13 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:53.918354 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 79794.3us
I20260709 12:18:53.924431 20927 catalog_manager.cc:5697] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:53.931634 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 90169.7us
W20260709 12:18:53.935758 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 74947.1us
I20260709 12:18:53.929991 20927 catalog_manager.cc:5697] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 13 to 14, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 14 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
W20260709 12:18:53.956810 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 102058us
I20260709 12:18:53.948786 20927 catalog_manager.cc:5697] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.972261 20927 catalog_manager.cc:5697] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 10 to 12, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 12 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.974905 20927 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 14 to 15, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:53.976317 20927 catalog_manager.cc:5697] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 8 to 13, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 13 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.977916 20927 catalog_manager.cc:5697] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 8 to 10, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 10 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.980295 20927 catalog_manager.cc:5697] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:53.981818 20927 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:53.985962 20927 catalog_manager.cc:5697] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 10 to 12, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 12 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:53.987493 20927 catalog_manager.cc:5697] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 8 to 9, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 9 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.989063 20927 catalog_manager.cc:5697] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 11 to 12, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 12 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:53.991098 20927 catalog_manager.cc:5697] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 9 to 14, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 14 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.992702 20927 catalog_manager.cc:5697] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 6 to 15, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 15 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.994287 20927 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.024325 26684 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.024829 26684 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:54.064687 26684 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:54.065420 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" is_pre_election: true
I20260709 12:18:54.067668 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:54.068487 21104 raft_consensus.cc:2410] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:18:54.069581 21149 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:54.070605 26684 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:54.160390 20931 catalog_manager.cc:5697] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 13 to 15, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.161899 20931 catalog_manager.cc:5697] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.163455 20931 catalog_manager.cc:5697] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 10 to 11, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 11 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.167531 20931 catalog_manager.cc:5697] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.169023 20931 catalog_manager.cc:5697] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 15 to 17, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 17 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.172842 20931 catalog_manager.cc:5697] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 12 to 15, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 15 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.174311 20931 catalog_manager.cc:5697] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 12 to 13, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 13 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.176158 20931 catalog_manager.cc:5697] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:54.171789 20927 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49666 (request call id 201) took 16844 ms (client timeout 15000 ms). Trace:
W20260709 12:18:54.177187 20927 rpcz_store.cc:269] 0709 12:18:37.327763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.327991 (+   228us) service_pool.cc:224] Handling call
0709 12:18:54.171714 (+16843723us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:54.005725 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:54.006414 (+   689us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:54.006469 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:18:54.006482 (+    13us) tablet.cc:662] Decoding operations
0709 12:18:54.008155 (+  1673us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:54.008209 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:54.008236 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:18:54.009295 (+  1059us) tablet.cc:701] Row locks acquired
0709 12:18:54.009310 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:18:54.009443 (+   133us) write_op.cc:270] Start()
0709 12:18:54.009548 (+   105us) write_op.cc:276] Timestamp: P: 1783599534009399 usec, L: 0
0709 12:18:54.009569 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:18:54.010175 (+   606us) log.cc:844] Serialized 6310 byte log entry
0709 12:18:54.066896 (+ 56721us) op_driver.cc:464] REPLICATION: finished
0709 12:18:54.067658 (+   762us) write_op.cc:301] APPLY: starting
0709 12:18:54.067745 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:54.077592 (+  9847us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:54.077674 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:54.088514 (+ 10840us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:54.088757 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:18:54.088801 (+    44us) write_op.cc:312] APPLY: finished
0709 12:18:54.089126 (+   325us) log.cc:844] Serialized 148 byte log entry
0709 12:18:54.089848 (+   722us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.090012 (+   164us) write_op.cc:454] Released schema lock
0709 12:18:54.090069 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:54.090403 (+   334us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.090429 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3053863,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":552,"apply.run_cpu_time_us":16992,"apply.run_wall_time_us":22696,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66848,"num_ops":16,"prepare.queue_time_us":277,"prepare.run_cpu_time_us":4435,"prepare.run_wall_time_us":5352,"replication_time_us":57159}]]}
I20260709 12:18:54.186054 20931 catalog_manager.cc:5697] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 13 to 15, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.187443 20931 catalog_manager.cc:5697] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 9 to 12, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 12 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.190527 20931 catalog_manager.cc:5697] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 14 to 15, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 15 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.192269 20931 catalog_manager.cc:5697] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 11 to 16, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.196538 20931 catalog_manager.cc:5697] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 13 to 16, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 16 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.202596 20931 catalog_manager.cc:5697] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 7 to 10, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 10 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.208578 20931 catalog_manager.cc:5697] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 14 to 15, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.211808 20931 catalog_manager.cc:5697] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.212987 20931 catalog_manager.cc:5697] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 11 to 13, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 13 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.214483 20931 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 8 to 15, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.216220 20931 catalog_manager.cc:5697] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 12 to 15, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.217713 20931 catalog_manager.cc:5697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 10 to 14, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 14 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.218971 20931 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 12 to 13, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 13 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.247706 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:54.402539 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:54.403148 21104 raft_consensus.cc:606] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:54.416596 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "861699cfca584c7b963879b6d12f2866"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:54.417181 21104 raft_consensus.cc:606] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:54.429392 20931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49692 (request call id 201) took 3461 ms. Trace:
I20260709 12:18:54.429950 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:54.435177 21104 raft_consensus.cc:606] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:54.438786 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:54.439304 21104 raft_consensus.cc:606] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:54.440850 20931 rpcz_store.cc:276] 0709 12:18:50.967644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.969278 (+  1634us) service_pool.cc:224] Handling call
0709 12:18:54.429323 (+3460045us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:54.226725 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:54.227230 (+   505us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:54.227262 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:18:54.227282 (+    20us) tablet.cc:662] Decoding operations
0709 12:18:54.228849 (+  1567us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:54.228906 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:54.228933 (+    27us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:18:54.230359 (+  1426us) tablet.cc:701] Row locks acquired
0709 12:18:54.230374 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:18:54.230512 (+   138us) write_op.cc:270] Start()
0709 12:18:54.230619 (+   107us) write_op.cc:276] Timestamp: P: 1783599534230468 usec, L: 0
0709 12:18:54.230638 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:18:54.231217 (+   579us) log.cc:844] Serialized 8231 byte log entry
0709 12:18:54.233492 (+  2275us) op_driver.cc:464] REPLICATION: finished
0709 12:18:54.234225 (+   733us) write_op.cc:301] APPLY: starting
0709 12:18:54.234295 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:54.309448 (+ 75153us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:54.309533 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:54.339132 (+ 29599us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:54.339415 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 12:18:54.339457 (+    42us) write_op.cc:312] APPLY: finished
0709 12:18:54.339835 (+   378us) log.cc:844] Serialized 188 byte log entry
0709 12:18:54.340678 (+   843us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.348406 (+  7728us) write_op.cc:454] Released schema lock
0709 12:18:54.348466 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:54.367499 (+ 19033us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.367531 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19855,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":553,"apply.run_cpu_time_us":23559,"apply.run_wall_time_us":133236,"cfile_cache_hit":84,"cfile_cache_hit_bytes":87738,"num_ops":21,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":4763,"prepare.run_wall_time_us":4764,"replication_time_us":2733,"spinlock_wait_cycles":1792}]]}
I20260709 12:18:54.459051 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:54.459574 21104 raft_consensus.cc:606] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:54.466703 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:54.468315 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:54.469024 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:54.468631 20928 catalog_manager.cc:5697] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 12 to 15, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 15 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.473449 26731 raft_consensus.cc:993] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:54.478014 26731 raft_consensus.cc:1081] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:54.479554 21177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "861699cfca584c7b963879b6d12f2866"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:18:54.480060 21177 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.480373 21177 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:54.487358 20928 catalog_manager.cc:5697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 11 to 13, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 13 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.492475 20928 catalog_manager.cc:5697] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 14 to 16, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 16 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.495267 26510 raft_consensus.cc:993] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:54.495770 26510 raft_consensus.cc:1081] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:54.499019 21179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:18:54.499523 21179 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.499838 21179 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:54.500567 21177 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.503268 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:54.503834 21104 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:54.504088 21104 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:54.504761 21104 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.505738 21104 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:54.495338 20928 catalog_manager.cc:5697] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 11 to 16, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 16 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.508510 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:54.508364 20928 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.509027 21747 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:54.513381 21104 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 20.
I20260709 12:18:54.514534 21149 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:54.502697 21177 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 20 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:54.515640 26664 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:54.516094 26664 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 20 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:54.516870 26664 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.533267 21179 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:54.534783 20928 catalog_manager.cc:5697] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 13 to 14, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 14 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.536093 20928 catalog_manager.cc:5697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 15 to 16, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.563908 26680 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:54.564440 26680 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:54.538642 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:54.565204 20928 catalog_manager.cc:5697] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.567189 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:18:54.567842 26680 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:54.567170 20928 catalog_manager.cc:5697] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 15 to 16, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 16 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.567653 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:18:54.536803 21747 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 20.
I20260709 12:18:54.568806 21108 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 18.
I20260709 12:18:54.568053 21177 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 18: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:54.562965 21179 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:54.538311 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:54.570645 21036 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:54.566385 21104 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:54.571079 21104 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:54.571857 21104 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:54.569948 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:54.572927 26680 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:54.573266 26680 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:18:54.573608 26680 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:54.583942 26680 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:54.586513 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:54.586681 21104 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:54.591156 21036 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 18.
I20260709 12:18:54.592409 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:54.597091 21104 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 18.
I20260709 12:18:54.601975 21108 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 18.
I20260709 12:18:54.606917 26504 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:54.611438 20999 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:54.620421 26504 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:54.621441 26504 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:54.623519 26680 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:54.624591 26510 raft_consensus.cc:993] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:54.625001 26510 raft_consensus.cc:1081] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:54.629980 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:54.630667 21179 raft_consensus.cc:2393] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ed9deaeb4014e9d87aeebbc6384f81f in current term 18: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:18:54.637547 21036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:18:54.638062 21036 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.638386 21036 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:54.635738 26680 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:54.640674 26680 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:54.641434 26680 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:54.649026 21036 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.657886 21036 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 20 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:54.658768 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:54.659348 21747 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:54.666435 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:54.666986 21108 raft_consensus.cc:3055] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:54.667249 21108 raft_consensus.cc:740] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:54.667943 21108 consensus_queue.cc:260] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.669112 21108 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:54.674326 21747 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 20.
I20260709 12:18:54.675328 21000 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:54.676662 26734 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:54.677732 26734 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:18:54.678658 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 44493.6us
I20260709 12:18:54.680068 21108 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 20.
I20260709 12:18:54.684806 26734 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.708492 26510 raft_consensus.cc:993] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:54.708956 26510 raft_consensus.cc:1081] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:54.710467 21036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:18:54.711009 21036 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.711339 21036 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:54.717974 21036 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.740599 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:54.741163 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:54.741204 21747 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:54.742398 20928 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49682 (request call id 223) took 2776 ms. Trace:
I20260709 12:18:54.742756 20928 rpcz_store.cc:276] 0709 12:18:51.968989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.985049 (+ 16060us) service_pool.cc:224] Handling call
0709 12:18:52.248451 (+263402us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b540012b1d4. stack: 00007fcb9c875343 00007fcb9c875240 00007fcb9c2041d4 00007fcba5f42304 00007fcba5f42299 00007fcb9f8fe090 00007fcb9f99cf3a 00007fcba5752e9c 00007fcba585104e 00007fcba3d122a4 00007fcba3d12232 00007fcba3d12161 00007fcba3d120dc 00007fcba3d11392 00007fcb9dccf48c 00007fcb9dcce8c6
0709 12:18:54.742342 (+2493891us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:54.640511 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:54.641032 (+   521us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:54.641066 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:18:54.641084 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:54.641912 (+   828us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:54.641966 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:54.641993 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:18:54.642659 (+   666us) tablet.cc:701] Row locks acquired
0709 12:18:54.642677 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:18:54.642801 (+   124us) write_op.cc:270] Start()
0709 12:18:54.642940 (+   139us) write_op.cc:276] Timestamp: P: 1783599534642758 usec, L: 0
0709 12:18:54.642962 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:54.644229 (+  1267us) log.cc:844] Serialized 3619 byte log entry
0709 12:18:54.646405 (+  2176us) op_driver.cc:464] REPLICATION: finished
0709 12:18:54.646787 (+   382us) write_op.cc:301] APPLY: starting
0709 12:18:54.646870 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:54.651092 (+  4222us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:54.651178 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:54.685197 (+ 34019us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:54.685407 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:18:54.685452 (+    45us) write_op.cc:312] APPLY: finished
0709 12:18:54.685707 (+   255us) log.cc:844] Serialized 89 byte log entry
0709 12:18:54.688069 (+  2362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.688187 (+   118us) write_op.cc:454] Released schema lock
0709 12:18:54.688231 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:54.697875 (+  9644us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.698171 (+   296us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":278495,"reported_tablets":52,"spinlock_wait_cycles":53167744,"child_traces":[["op",{"apply.queue_time_us":214,"apply.run_cpu_time_us":10920,"apply.run_wall_time_us":44991,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37602,"num_ops":9,"prepare.queue_time_us":188,"prepare.run_cpu_time_us":3274,"prepare.run_wall_time_us":3984,"replication_time_us":3342}]]}
I20260709 12:18:54.745899 20931 catalog_manager.cc:5697] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 9 to 13, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 13 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.747658 21104 raft_consensus.cc:3055] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:54.748026 21104 raft_consensus.cc:740] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:54.751147 21104 consensus_queue.cc:260] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.754894 21104 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:54.761365 21747 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:54.766538 21000 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:54.767400 26734 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:54.768085 26734 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:54.752194 21036 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:54.750932 20931 catalog_manager.cc:5697] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 12 to 16, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.772054 20931 catalog_manager.cc:5697] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.774351 20931 catalog_manager.cc:5697] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 15 to 16, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.776451 20931 catalog_manager.cc:5697] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 10 to 13, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 13 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.773711 26734 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.777871 20931 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.779333 20931 catalog_manager.cc:5697] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } }
I20260709 12:18:54.788648 21104 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:54.917364 20931 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 19 to 20, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 20 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.920395 20931 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 17 to 18, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 18 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.943703 21747 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:18:54.944458 26428 raft_consensus.cc:993] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:54.944917 26428 raft_consensus.cc:1081] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:54.945179 26684 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:18:54.946557 21177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:18:54.947072 21177 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.947376 21177 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:54.957044 21177 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.964339 21177 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:54.964962 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:54.965539 21104 raft_consensus.cc:3055] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:54.965838 21104 raft_consensus.cc:740] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:54.966506 21104 consensus_queue.cc:260] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:54.967533 21104 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:54.988580 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:54.989164 21741 raft_consensus.cc:3060] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:54.995820 21741 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:55.002866 20926 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49666 (request call id 202) took 1964 ms. Trace:
I20260709 12:18:55.003324 20926 rpcz_store.cc:276] 0709 12:18:53.037974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.038216 (+   242us) service_pool.cc:224] Handling call
0709 12:18:55.002742 (+1964526us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133,"reported_tablets":52}
I20260709 12:18:55.008010 21108 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:18:55.010154 26735 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:18:55.023164 21150 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:55.024045 26504 raft_consensus.cc:2804] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:55.024521 26504 raft_consensus.cc:697] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:55.025761 26504 consensus_queue.cc:237] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:55.035426 21104 raft_consensus.cc:2468] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:55.038203 21032 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:55.041556 26684 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:55.055510 20928 catalog_manager.cc:5697] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.057159 20928 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 19 to 20, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 20 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.072656 20926 catalog_manager.cc:5697] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 15 to 16, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.090834 21104 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:18:55.095642 26737 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:18:55.105675 20928 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 13 to 14, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 14 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.118820 21105 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:55.122251 26737 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:18:55.167032 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 64625.9us
I20260709 12:18:55.169854 21741 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:18:55.180771 26737 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:18:55.233258 21104 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:18:55.244112 21104 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:55.245016 26734 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:55.245502 26756 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:55.348338 21179 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:55.351100 26767 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:18:55.348363 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 55839.9us
I20260709 12:18:55.354209 21747 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:18:55.359964 26740 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:55.462683 21741 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:55.464015 26756 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:55.482357 21111 raft_consensus.cc:1275] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:55.489584 26504 consensus_queue.cc:1048] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:55.614120 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:55.774576 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:55.775144 21181 raft_consensus.cc:606] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:55.783035 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:55.783564 21181 raft_consensus.cc:606] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:55.786159 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:55.786655 21181 raft_consensus.cc:606] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:55.791268 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:55.791759 21181 raft_consensus.cc:606] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:55.794190 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:55.794683 21181 raft_consensus.cc:606] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:55.796885 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:55.798444 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:55.811650 26684 raft_consensus.cc:993] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:55.812119 26684 raft_consensus.cc:1081] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:55.813861 21108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:18:55.814350 21108 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.814651 21108 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:55.821398 21108 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:55.823138 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:55.823786 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:55.824088 21108 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:55.824823 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:55.825332 21181 raft_consensus.cc:3055] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:55.825639 21181 raft_consensus.cc:740] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:55.827034 21181 consensus_queue.cc:260] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:55.828214 21181 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:55.824335 21032 raft_consensus.cc:3060] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:55.846113 21032 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:55.847687 21076 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:55.848645 26510 raft_consensus.cc:2804] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:55.849102 26510 raft_consensus.cc:697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:55.849850 26510 consensus_queue.cc:237] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:55.873023 26684 raft_consensus.cc:993] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:55.873572 26758 raft_consensus.cc:1081] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:55.890378 21111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:18:55.891201 21111 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.892668 21111 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:55.900693 26758 raft_consensus.cc:993] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:55.901130 26758 raft_consensus.cc:1081] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:55.904232 21104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:18:55.904721 21104 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.905023 21104 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:55.862465 21181 raft_consensus.cc:2468] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:55.975787 21104 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:56.139735 21104 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:55.981324 21111 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:56.159500 21111 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:56.175077 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:56.175707 21035 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:56.200095 20927 catalog_manager.cc:5697] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 15 to 16, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 16 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.210053 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:56.210693 21182 raft_consensus.cc:3055] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:56.210999 21182 raft_consensus.cc:740] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:56.210925 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:56.213563 21177 raft_consensus.cc:3055] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:56.213858 21177 raft_consensus.cc:740] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:56.221297 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:56.221848 21027 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:56.222805 21035 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:56.214614 21177 consensus_queue.cc:260] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:56.238775 21177 raft_consensus.cc:3060] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:56.211738 21182 consensus_queue.cc:260] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:56.250212 21182 raft_consensus.cc:3060] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:56.264567 21177 raft_consensus.cc:2468] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:18:56.269395 21076 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:56.276516 21027 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:56.282589 21182 raft_consensus.cc:2468] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:18:56.321743 26731 raft_consensus.cc:2804] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:18:56.354334 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 102431us
I20260709 12:18:56.338317 26731 raft_consensus.cc:697] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:18:56.365403 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 77812.3us
W20260709 12:18:56.373996 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 104668us
I20260709 12:18:56.409798 26781 raft_consensus.cc:993] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:56.410392 26791 raft_consensus.cc:1081] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:56.438165 21076 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:56.453820 26775 raft_consensus.cc:2804] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:56.456970 26775 raft_consensus.cc:697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:56.458868 26775 consensus_queue.cc:237] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:56.386813 26731 consensus_queue.cc:237] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:18:56.511196 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 168706us
I20260709 12:18:56.537958 26684 raft_consensus.cc:993] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
W20260709 12:18:56.556188 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 45424.9us
W20260709 12:18:56.563988 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 56243.7us
I20260709 12:18:56.578783 21108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:18:56.579694 21108 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.580178 21108 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:56.583207 26684 raft_consensus.cc:1081] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
W20260709 12:18:56.589449 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 225324us
I20260709 12:18:56.601320 21035 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:56.675053 21108 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:56.680989 21108 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:18:56.681907 21185 raft_consensus.cc:1275] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:56.684690 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:56.699918 21184 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:56.700228 21184 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:56.701175 21184 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:56.702368 21184 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:56.708884 26510 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:56.713670 26510 consensus_queue.cc:1048] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:56.715610 21184 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:56.729043 21077 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:56.729990 26510 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:56.730450 26510 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:56.732863 26510 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:56.741473 20927 catalog_manager.cc:5697] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 15 to 16, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 16 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.750823 20927 catalog_manager.cc:5697] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 16 to 17, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 17 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.759419 21029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:18:56.760036 21029 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.760370 21029 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:56.768697 21029 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:56.787058 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:56.787674 21747 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:56.804913 21747 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:56.816499 21029 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:56.830977 21000 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:18:56.829974 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:56.833773 21035 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:56.835135 21034 raft_consensus.cc:1240] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:56.839545 26734 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:56.839989 26734 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:56.841295 21035 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:18:56.827670 20927 catalog_manager.cc:5697] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 12 to 13, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 13 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.847982 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:56.848560 21184 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:56.848834 21184 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:56.849673 21184 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:56.840898 26734 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:56.850793 21184 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:56.895792 21181 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:56.900059 26731 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:56.905653 21184 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 14.
I20260709 12:18:56.929522 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:56.942230 21036 raft_consensus.cc:1275] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:56.959681 26731 consensus_queue.cc:1048] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:57.120553 21181 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:18:57.127591 26775 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:57.140888 21036 raft_consensus.cc:1275] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:18:57.168151 26731 consensus_queue.cc:1048] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:18:57.272406 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 125188us
I20260709 12:18:57.318046 21184 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:57.329172 26790 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:57.333824 20926 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 13 to 14, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 14 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.412384 21032 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:18:57.456245 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 111786us
I20260709 12:18:57.470705 21182 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:18:57.480840 21742 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:18:57.482565 26740 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:57.505997 26820 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:18:57.508589 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 124326us
I20260709 12:18:57.548532 26830 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:57.987891 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:57.988605 21181 raft_consensus.cc:606] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:18:57.993589 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:18:57.994156 21181 raft_consensus.cc:606] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:18:58.000893 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:58.002758 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:58.003813 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:58.044102 26800 raft_consensus.cc:993] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:58.044682 26800 raft_consensus.cc:1081] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:18:58.050953 21105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:18:58.051488 21105 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.051831 21105 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.060002 21105 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:58.062177 21105 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:58.077356 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:58.078080 21182 raft_consensus.cc:3055] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:58.078424 21182 raft_consensus.cc:740] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:58.080760 21182 consensus_queue.cc:260] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:58.082075 21182 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.113919 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:58.128749 21182 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:18:58.135008 26791 raft_consensus.cc:993] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:58.135531 26805 raft_consensus.cc:1081] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:18:58.151846 21032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:18:58.152503 21032 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.152940 21032 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.158177 21077 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:18:58.159384 26731 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:58.159915 26731 raft_consensus.cc:697] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:58.160835 26731 consensus_queue.cc:237] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:58.171316 21032 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:58.174188 21032 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:58.174440 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:18:58.175614 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:58.175808 21177 raft_consensus.cc:3055] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:58.176074 21741 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.176154 21177 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:58.177058 21177 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:58.178369 21177 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.181382 20926 catalog_manager.cc:5697] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 10 to 11, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 11 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.184294 21741 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:58.185006 21177 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 10.
I20260709 12:18:58.185966 21002 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:58.191370 26803 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:58.192798 26803 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:58.193845 26803 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:58.253818 20931 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 9 to 10, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 10 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.563643 21741 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.571957 21741 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:58.573412 26824 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:58.590919 21177 raft_consensus.cc:1275] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:58.595571 21181 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:58.595759 26834 consensus_queue.cc:1048] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:58.604063 26734 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:58.691143 21742 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:58.692665 26734 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:59.116988 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:59.201805 21036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:18:59.202386 21036 raft_consensus.cc:606] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:59.205144 21109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:18:59.205716 21109 raft_consensus.cc:606] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:18:59.207106 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:59.208894 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:59.209646 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:59.440960 26803 raft_consensus.cc:993] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:59.441498 26803 raft_consensus.cc:1081] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:59.450428 21181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:18:59.451023 21181 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.451368 21181 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:59.493289 21181 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:59.559221 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:59.559803 21035 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:59.560113 21035 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:18:59.560941 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:18:59.560783 21035 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:18:59.561486 21742 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:59.561226 21181 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:18:59.561918 21035 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:59.568578 21035 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:59.569398 21742 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:18:59.570983 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:18:59.572427 26845 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:59.576191 26845 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:59.577139 26845 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:18:59.590065 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 146338us
W20260709 12:18:59.618431 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 156408us
I20260709 12:18:59.625991 26824 raft_consensus.cc:993] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:59.626541 26824 raft_consensus.cc:1081] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:18:59.642637 21177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:18:59.644529 21177 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.645604 21177 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:59.691471 21177 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:59.711964 21177 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:18:59.712939 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:18:59.713555 21105 raft_consensus.cc:3055] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:59.713836 21105 raft_consensus.cc:740] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:18:59.714607 21105 consensus_queue.cc:260] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:59.715687 21105 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:59.722404 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:18:59.723904 21032 raft_consensus.cc:3060] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:59.730718 21105 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:59.736631 20931 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 13 to 14, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 14 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.763383 21149 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:18:59.765316 26845 raft_consensus.cc:2804] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:59.766069 26845 raft_consensus.cc:697] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:18:59.767073 26845 consensus_queue.cc:237] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:18:59.760046 21032 raft_consensus.cc:2468] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:18:59.940904 20931 catalog_manager.cc:5697] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 15 to 16, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.967783 21742 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:18:59.969357 26845 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:00.040679 21035 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:00.042517 26870 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:00.308524 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.391240 21032 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:00.394354 26870 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:00.411705 21105 raft_consensus.cc:1275] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:19:00.514681 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 62947.2us
I20260709 12:19:00.455525 26845 consensus_queue.cc:1048] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
W20260709 12:19:00.581367 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 65849.7us
W20260709 12:19:00.667245 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 48756.2us
W20260709 12:19:00.807924 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 120864us
W20260709 12:19:00.808002 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 73416.9us
I20260709 12:19:00.830935 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:19:00.831559 21177 raft_consensus.cc:606] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:19:00.848786 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 66741.1us
W20260709 12:19:00.855924 26899 log.cc:927] Time spent T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:19:00.895767 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 46335.3us
I20260709 12:19:01.007296 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:01.009078 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:01.009936 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:01.023583 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 125498us
I20260709 12:19:01.104745 26904 raft_consensus.cc:993] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:19:01.105536 26888 raft_consensus.cc:1081] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:19:01.173900 21033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:19:01.174456 21033 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.174815 21033 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:01.183686 21033 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:01.203563 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:01.204190 21181 raft_consensus.cc:3055] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:01.204510 21181 raft_consensus.cc:740] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:01.205231 21181 consensus_queue.cc:260] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:01.247035 21033 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:19:01.247924 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 60814.3us
I20260709 12:19:01.250918 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:01.251559 21741 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:01.261119 21032 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:01.270601 21181 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:01.278576 21741 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:19:01.282584 21746 raft_consensus.cc:1240] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Rejecting Update request from peer 694635cc4a20455fbbec925e0a84a1ee for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:01.286803 21000 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:19:01.290015 26907 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:01.296690 21181 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 15.
I20260709 12:19:01.301494 26907 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:19:01.302431 26907 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:19:01.308596 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 383923us
W20260709 12:19:01.328811 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 317095us
I20260709 12:19:01.438227 20928 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 14 to 15, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 15 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:01.816934 21741 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:19:01.819078 26913 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:01.914237 21181 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:19:01.916342 26740 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:19:02.060928 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 106569us
I20260709 12:19:02.326030 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.537315 21031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:19:02.537932 21031 raft_consensus.cc:606] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:02.539996 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:02.541561 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:02.542279 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.776093 26913 raft_consensus.cc:993] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:02.776623 26913 raft_consensus.cc:1081] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:02.780620 21177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:19:02.782480 21177 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.785562 21177 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:02.971459 21177 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:02.973351 21177 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:03.021405 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:03.060954 21746 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:03.068002 21746 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:19:03.070003 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:03.070683 21034 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:03.071065 21034 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:19:03.071769 21034 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:03.072834 21034 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:03.116039 21150 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:19:03.145430 20999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.173144 21034 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
W20260709 12:19:03.175930 21150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 59966.2us
I20260709 12:19:03.176436 26947 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:03.193822 26947 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:03.194792 26947 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:03.341578 20928 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 14 to 15, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 15 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:03.584578 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 44260.8us
W20260709 12:19:03.654971 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 88433.4us
I20260709 12:19:03.698063 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:03.721478 21746 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:19:03.723158 26958 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:03.798040 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:19:03.798611 21181 raft_consensus.cc:606] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:03.806988 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:03.808634 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:03.809429 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:03.959161 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 103661us
W20260709 12:19:03.964335 21709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 83429.4us
I20260709 12:19:03.980921 21034 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:19:03.999518 26888 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:04.087954 26888 raft_consensus.cc:993] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:19:04.088418 26888 raft_consensus.cc:1081] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:19:04.090298 21034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:19:04.090813 21034 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.091153 21034 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:04.120149 21034 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:04.123484 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:04.124085 21741 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:04.123528 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:04.130432 21181 raft_consensus.cc:3055] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:04.130704 21181 raft_consensus.cc:740] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:04.132272 21181 consensus_queue.cc:260] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:04.133278 21181 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:04.140563 21181 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 16.
I20260709 12:19:04.149595 21002 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:19:04.151243 26974 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:04.151751 26974 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:19:04.152549 26974 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:04.175902 21741 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 16.
I20260709 12:19:04.179983 21034 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:04.184197 20928 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 15 to 16, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 16 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.626271 21741 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:19:04.628140 26974 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:04.671583 21181 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:19:04.673313 26974 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:04.909708 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.119545 21034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:19:05.120146 21034 raft_consensus.cc:606] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:05.121676 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:05.123324 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:05.124090 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.383378 26961 raft_consensus.cc:993] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:05.384042 26961 raft_consensus.cc:1081] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:05.385605 21181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:19:05.386138 21181 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:05.386461 21181 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:05.402464 21181 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:05.406503 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:05.407089 21032 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:05.407370 21032 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:19:05.408057 21032 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:05.409099 21032 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:05.411844 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:05.412402 21108 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:05.421036 21032 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:19:05.427649 21151 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:19:05.428507 26949 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:05.428987 26949 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:05.429754 26949 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:05.436507 21108 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:19:05.408516 21181 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:05.465231 20928 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 13 to 14, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 14 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.914186 21108 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:05.916224 26986 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:05.984839 21032 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:05.988763 26958 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:19:06.199398 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 62586.2us
W20260709 12:19:06.201555 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 170814us
I20260709 12:19:06.248752 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.455391 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:19:06.455988 21181 raft_consensus.cc:606] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:06.470999 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:06.472581 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:06.473325 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.794543 27005 raft_consensus.cc:993] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:06.795388 27005 raft_consensus.cc:1081] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:06.797631 21103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:19:06.798542 21103 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.799044 21103 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:06.826601 21103 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:19:06.831123 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 50598us
I20260709 12:19:06.857745 21103 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:06.857663 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:06.862200 21034 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:06.859270 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:06.867120 21181 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:06.867393 21181 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:06.868227 21181 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:06.869660 21181 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:06.890578 21034 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 19.
I20260709 12:19:06.898871 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:06.900009 26971 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:06.900498 26971 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:06.901464 26971 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:06.912873 21181 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 19.
I20260709 12:19:06.973326 20928 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 18 to 19, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 19 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.395359 21032 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:07.397351 27024 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:07.443204 21177 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:07.445742 27024 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:07.816970 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.978179 21104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:19:07.978825 21104 raft_consensus.cc:606] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:07.984005 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:07.985670 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:07.995133 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:08.539898 27013 raft_consensus.cc:993] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:08.540390 27013 raft_consensus.cc:1081] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:08.542297 21185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:19:08.542861 21185 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:08.543186 21185 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:08.561758 21185 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:08.581305 21032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:08.581885 21032 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:08.593204 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:08.593818 21108 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:08.594070 21108 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:08.595288 21185 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:08.594723 21108 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:08.597579 21108 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:08.606189 21108 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:19:08.608485 21149 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:08.610828 27002 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:08.611322 27002 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:08.612182 27002 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:08.619386 21032 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:19:08.646502 20931 catalog_manager.cc:5697] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 13 to 14, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 14 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:09.115965 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:09.175930 21034 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:09.177609 27035 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:09.274811 21104 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:09.276228 27002 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:09.326745 21185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:19:09.332077 21185 raft_consensus.cc:606] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:09.338368 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:09.348182 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:09.369083 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:09.417948 27045 raft_consensus.cc:993] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:09.418462 27045 raft_consensus.cc:1081] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:09.420828 21108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:19:09.425201 21108 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:09.425540 21108 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:09.433319 21108 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:09.451143 21027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:09.452240 21027 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:09.461010 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:09.461619 21177 raft_consensus.cc:3055] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:09.461907 21177 raft_consensus.cc:740] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:09.462489 21108 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:09.462602 21177 consensus_queue.cc:260] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:09.463752 21177 raft_consensus.cc:3060] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:09.470988 21027 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:19:09.473177 21076 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:09.474907 27007 raft_consensus.cc:2804] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:09.475384 27007 raft_consensus.cc:697] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:09.476256 27007 consensus_queue.cc:237] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:09.485728 21177 raft_consensus.cc:2468] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:19:09.512786 20931 catalog_manager.cc:5697] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 14 to 15, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:09.891404 21027 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:09.902642 26971 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:09.930886 21181 raft_consensus.cc:1275] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:09.935127 27007 consensus_queue.cc:1048] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:19:09.970922 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 63106.1us
I20260709 12:19:10.509523 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:10.637499 21103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36a88ddff51a4bcea630447226c59041"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:19:10.638193 21103 raft_consensus.cc:606] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Received request to transfer leadership to TS 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:10.644140 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:10.645795 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:10.646528 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:10.991067 26971 raft_consensus.cc:993] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:19:10.991525 26971 raft_consensus.cc:1081] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Signalling peer 3ed9deaeb4014e9d87aeebbc6384f81f to start an election
I20260709 12:19:10.996464 21034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36a88ddff51a4bcea630447226c59041"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:19:10.997035 21034 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:10.997366 21034 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:11.004170 21034 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:11.006428 21034 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:11.008459 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:11.015122 21108 raft_consensus.cc:3055] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:11.015463 21108 raft_consensus.cc:740] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:11.016201 21108 consensus_queue.cc:260] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:11.017279 21108 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:11.009981 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:11.019208 21746 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:11.028944 21746 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:19:11.036003 21000 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:19:11.036995 27033 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:11.032428 21108 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 9.
I20260709 12:19:11.140928 27033 raft_consensus.cc:697] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Becoming Leader. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:19:11.174611 27033 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:11.245371 20927 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f reported cstate change: term changed from 8 to 9, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1). New cstate: current_term: 9 leader_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:11.572161 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 95811.7us
W20260709 12:19:11.639019 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 127195us
I20260709 12:19:11.662819 21103 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:11.665151 27066 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:11.729156 21746 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Refusing update from remote peer 3ed9deaeb4014e9d87aeebbc6384f81f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:11.730860 27033 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:11.756915 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:11.925089 21027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc"
dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:41174
I20260709 12:19:11.925657 21027 raft_consensus.cc:606] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:11.927306 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:11.928944 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:11.932166 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:12.300731 27068 raft_consensus.cc:993] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:12.301246 27068 raft_consensus.cc:1081] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:12.311273 21177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:19:12.311838 21177 raft_consensus.cc:493] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:12.312170 21177 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:12.366755 21177 raft_consensus.cc:515] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:12.411533 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:12.412350 21108 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:12.481635 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dc46ba93c94432f85502db4f2496cfc" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:12.482262 21034 raft_consensus.cc:3055] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:12.482554 21034 raft_consensus.cc:740] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:19:12.483271 21034 consensus_queue.cc:260] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:12.484328 21034 raft_consensus.cc:3060] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:12.495515 21034 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
W20260709 12:19:12.507342 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 165131us
I20260709 12:19:12.511411 21177 leader_election.cc:290] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:12.568783 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 228998us
I20260709 12:19:12.569723 21151 leader_election.cc:304] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:19:12.571812 27045 raft_consensus.cc:2804] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:12.572719 27045 raft_consensus.cc:697] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:12.573607 27045 consensus_queue.cc:237] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:12.657631 21108 raft_consensus.cc:2468] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:19:12.684370 20931 catalog_manager.cc:5697] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 13 to 14, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 14 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:12.723855 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 62468.9us
W20260709 12:19:12.796247 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 60828.4us
I20260709 12:19:13.046054 21105 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:13.047930 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:13.060667 27045 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:13.137135 21031 raft_consensus.cc:1275] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:13.140040 27085 consensus_queue.cc:1048] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:13.282232 21181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "861699cfca584c7b963879b6d12f2866"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:19:13.282823 21181 raft_consensus.cc:606] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 20 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:13.284735 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:13.287047 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:13.287798 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:13.305281 27073 raft_consensus.cc:993] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:13.305781 27073 raft_consensus.cc:1081] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 20 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:13.307288 21103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "861699cfca584c7b963879b6d12f2866"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:19:13.307791 21103 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.308156 21103 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:13.316290 21103 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:13.326763 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:13.329537 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:13.330127 21181 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:19:13.330394 21181 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:13.330806 21746 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:13.331195 21181 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:13.332309 21181 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:13.340260 21746 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 21.
I20260709 12:19:13.341473 21075 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:13.341895 21103 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 election: Requested vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:13.342447 27088 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:13.343211 27088 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:13.344538 27088 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:13.351729 21181 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 21.
I20260709 12:19:13.366815 20931 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 20 to 21, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 21 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.794617 21185 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 21 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:19:14.370491 27116 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:19:14.394011 21741 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 12:19:14.442204 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 620895us
I20260709 12:19:14.461333 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:14.503886 27119 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:19:14.657964 21108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:19:14.658591 21108 raft_consensus.cc:606] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:14.659983 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:14.661654 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:14.662470 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:14.816504 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800062ca0 after lost signal to thread 19891
W20260709 12:19:14.817656 21057 debug-util.cc:398] Leaking SignalData structure 0x7b080038ce00 after lost signal to thread 20968
W20260709 12:19:14.818886 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800286100 after lost signal to thread 21060
W20260709 12:19:14.819973 21057 debug-util.cc:398] Leaking SignalData structure 0x7b0800322c80 after lost signal to thread 21136
W20260709 12:19:14.825851 21057 debug-util.cc:398] Leaking SignalData structure 0x7b080035d000 after lost signal to thread 21211
W20260709 12:19:14.827450 21057 debug-util.cc:398] Leaking SignalData structure 0x7b08003192c0 after lost signal to thread 21771
I20260709 12:19:14.895730 27119 raft_consensus.cc:993] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:14.896369 27116 raft_consensus.cc:1081] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:14.910785 21180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:19:14.911376 21180 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:14.911720 21180 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.921213 21180 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:14.941071 21180 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:14.946815 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:14.947491 21033 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.949438 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:14.949993 21108 raft_consensus.cc:3055] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:14.954538 21108 raft_consensus.cc:740] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:14.955360 21108 consensus_queue.cc:260] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:14.957391 21108 raft_consensus.cc:3060] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.962030 21033 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:19:14.965919 21151 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:19:14.966711 27085 raft_consensus.cc:2804] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:14.967214 27085 raft_consensus.cc:697] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:14.968010 27085 consensus_queue.cc:237] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:14.974834 21108 raft_consensus.cc:2468] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 12.
I20260709 12:19:15.043664 20928 catalog_manager.cc:5697] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 11 to 12, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 12 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:15.353686 21033 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:15.355482 27073 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:15.438496 21108 raft_consensus.cc:1275] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:15.440034 27109 consensus_queue.cc:1048] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:15.849968 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:16.046708 21180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:19:16.047305 21180 raft_consensus.cc:606] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:16.049226 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:16.056816 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:16.057626 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:16.400349 27085 raft_consensus.cc:993] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:16.400820 27085 raft_consensus.cc:1081] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:16.403769 21105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:19:16.404300 21105 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:16.404666 21105 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:16.413815 21105 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:16.415726 21105 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:16.423460 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:16.416899 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:16.426586 21034 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:16.426997 21180 raft_consensus.cc:3055] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:16.427285 21180 raft_consensus.cc:740] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:16.427999 21180 consensus_queue.cc:260] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:16.429004 21180 raft_consensus.cc:3060] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:16.433481 21034 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
I20260709 12:19:16.438759 21076 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:16.440649 27119 raft_consensus.cc:2804] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:16.441130 27119 raft_consensus.cc:697] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:16.441952 27119 consensus_queue.cc:237] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:16.510214 21180 raft_consensus.cc:2468] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 17.
W20260709 12:19:16.635907 21002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 47107.1us
W20260709 12:19:16.652660 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 74980.9us
I20260709 12:19:16.659596 20931 catalog_manager.cc:5697] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 16 to 17, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 17 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:16.685839 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 50474.5us
I20260709 12:19:16.883795 21184 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:19:16.895447 27116 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:16.973975 21034 raft_consensus.cc:1275] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:19:16.980755 27119 consensus_queue.cc:1048] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:17.173537 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:17.309957 21103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:19:17.310793 21103 raft_consensus.cc:606] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:17.312901 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:17.314538 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:17.315531 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:17.330442 27151 raft_consensus.cc:993] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:17.331032 27151 raft_consensus.cc:1081] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:17.334254 21185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:19:17.334823 21185 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:17.335214 21185 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:17.400182 21185 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:17.402928 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:17.403584 21034 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:17.430102 21034 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:19:17.431018 21185 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:17.431972 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:17.433372 21103 raft_consensus.cc:3055] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:17.433734 21103 raft_consensus.cc:740] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:17.432776 21151 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:19:17.435418 27106 raft_consensus.cc:2804] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:17.435922 27106 raft_consensus.cc:697] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 17 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:17.436806 27106 consensus_queue.cc:237] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:17.441237 21103 consensus_queue.cc:260] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:17.442898 21103 raft_consensus.cc:3060] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:17.512459 21103 raft_consensus.cc:2468] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:19:17.532173 20931 catalog_manager.cc:5697] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 16 to 17, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 17 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:17.847342 21000 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 95749.1us
I20260709 12:19:17.864509 21103 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:19:17.865916 27106 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:18.009338 21027 raft_consensus.cc:1275] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:19:18.037945 27085 consensus_queue.cc:1048] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:18.434486 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:18.554489 21185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
mode: GRACEFUL
new_leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:58580
I20260709 12:19:18.555198 21185 raft_consensus.cc:606] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Received request to transfer leadership to TS a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:18.556963 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:18.558643 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:18.559401 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:18.668910 27085 raft_consensus.cc:993] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: : Instructing follower a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:18.669391 27085 raft_consensus.cc:1081] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Signalling peer a62242aa80cd4affa87dc4a3cf6b64ec to start an election
I20260709 12:19:18.671252 21108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
 from {username='slave'} at 127.0.0.1:56406
I20260709 12:19:18.671766 21108 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:18.672097 21108 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.680693 21108 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:18.683508 21033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:18.683773 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:18.684080 21033 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.686343 21184 raft_consensus.cc:3055] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:18.686674 21184 raft_consensus.cc:740] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:18.687479 21184 consensus_queue.cc:260] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:18.688549 21184 raft_consensus.cc:3060] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.693336 21033 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:19:18.694587 21076 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:18.697365 27151 raft_consensus.cc:2804] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:18.697842 27151 raft_consensus.cc:697] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:18.703577 27151 consensus_queue.cc:237] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:18.683589 21108 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:18.715088 21184 raft_consensus.cc:2468] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:19:18.732401 20931 catalog_manager.cc:5697] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 14 to 15, leader changed from 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.166267 21184 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:19.167742 27151 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:19:19.300791 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 157306us
I20260709 12:19:19.331995 21027 raft_consensus.cc:1275] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:19.347080 27119 consensus_queue.cc:1048] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:19:19.670601 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:19.776219 21103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:19:19.777024 21103 raft_consensus.cc:606] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:19.778821 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:19.780529 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:19.781318 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:20.939146 27199 raft_consensus.cc:993] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:20.939716 27199 raft_consensus.cc:1081] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:20.985713 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:20.991204 21184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:19:20.991835 21184 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.992187 21184 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:20.999872 21184 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:21.001811 21184 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:21.002588 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:21.002892 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:21.003279 21036 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:21.003394 21105 raft_consensus.cc:3055] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:21.003751 21105 raft_consensus.cc:740] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:21.004544 21105 consensus_queue.cc:260] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:21.005712 21105 raft_consensus.cc:3060] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:21.010200 21036 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:19:21.012269 21151 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:19:21.013180 27085 raft_consensus.cc:2804] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:21.013607 27085 raft_consensus.cc:697] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:21.014343 27085 consensus_queue.cc:237] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:21.016610 21105 raft_consensus.cc:2468] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:19:21.029251 20927 catalog_manager.cc:5697] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 15 to 16, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:21.035030 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08002d34a0 after lost signal to thread 19891
W20260709 12:19:21.036123 20965 debug-util.cc:398] Leaking SignalData structure 0x7b0800357f20 after lost signal to thread 20968
W20260709 12:19:21.037355 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6d80 after lost signal to thread 21060
W20260709 12:19:21.038434 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08003980a0 after lost signal to thread 21136
W20260709 12:19:21.039533 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08000772a0 after lost signal to thread 21211
W20260709 12:19:21.040683 20965 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc980 after lost signal to thread 21771
I20260709 12:19:21.090736 21105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263"
dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
mode: GRACEFUL
new_leader_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:40408
I20260709 12:19:21.091409 21105 raft_consensus.cc:606] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Received request to transfer leadership to TS 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:21.095721 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:21.100255 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:21.101101 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:21.215375 27192 raft_consensus.cc:993] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: : Instructing follower 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:21.215991 27192 raft_consensus.cc:1081] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Signalling peer 694635cc4a20455fbbec925e0a84a1ee to start an election
I20260709 12:19:21.226486 21184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263"
dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
 from {username='slave'} at 127.0.0.1:51896
I20260709 12:19:21.227084 21184 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:21.227429 21184 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:21.374701 21746 consensus_queue.cc:237] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:21.315706 21184 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:21.404217 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:21.404815 21105 raft_consensus.cc:3055] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:21.405110 21105 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:21.405821 21105 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:21.406863 21105 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:21.408097 21184 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 20 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:21.409518 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f"
I20260709 12:19:21.410108 21036 raft_consensus.cc:3060] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:21.413960 21184 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:21.416467 27092 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:21.428810 21036 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 20.
I20260709 12:19:21.426827 21105 raft_consensus.cc:2468] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 20.
I20260709 12:19:21.435230 21151 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:19:21.443089 21027 raft_consensus.cc:1275] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:21.444403 27092 consensus_queue.cc:1048] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:21.443243 27085 raft_consensus.cc:2804] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:21.451534 27085 raft_consensus.cc:697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 20 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:21.452546 27085 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:21.485509 20927 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 19 to 20, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 20 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.490490 27092 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 3 to 9, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:21.505761 21184 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 3 to 9, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:21.534507 20919 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 40fd334874764b26ba28ac382c4199f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 12:19:21.538395 20927 catalog_manager.cc:5697] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index 3 to 9, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New cstate: current_term: 13 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:21.540807 21036 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:21.544238 21027 raft_consensus.cc:2955] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 3 to 9, VOTER a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:21.576027 27085 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:21.602820 21095 tablet_service.cc:1558] Processing DeleteTablet for tablet 40fd334874764b26ba28ac382c4199f8 with delete_type TABLET_DATA_TOMBSTONED (TS a62242aa80cd4affa87dc4a3cf6b64ec not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60786
I20260709 12:19:21.615317 27222 tablet_replica.cc:333] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:21.624414 27222 raft_consensus.cc:2243] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:21.625429 27222 raft_consensus.cc:2272] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:21.628561 27222 ts_tablet_manager.cc:1916] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:21.633903 21105 raft_consensus.cc:1275] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:21.635391 27207 consensus_queue.cc:1048] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:21.652946 27222 ts_tablet_manager.cc:1929] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.8
I20260709 12:19:21.653633 27222 log.cc:1199] T 40fd334874764b26ba28ac382c4199f8 P a62242aa80cd4affa87dc4a3cf6b64ec: Deleting WAL directory at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/wals/40fd334874764b26ba28ac382c4199f8
I20260709 12:19:21.655668 20918 catalog_manager.cc:5028] TS a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): tablet 40fd334874764b26ba28ac382c4199f8 (table test-workload [id=be2ad3e3ce894a82a975c238cf3b7bb0]) successfully deleted
I20260709 12:19:21.875463 21105 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:21.878310 27207 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:21.898185 21027 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:21.899895 27203 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:22.172806 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
I20260709 12:19:22.281165 19888 tablet_server.cc:179] TabletServer@127.19.108.1:0 shutting down...
W20260709 12:19:22.287914 21076 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:19:22.310312 21076 consensus_peers.cc:597] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:22.313539 21076 consensus_peers.cc:597] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:22.332103 21151 consensus_peers.cc:597] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:22.335445 21076 consensus_peers.cc:597] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:22.355829 21711 consensus_peers.cc:597] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.135574 21076 consensus_peers.cc:597] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.248169 27232 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.249054 27232 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.251750 27232 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.323719 27230 raft_consensus.cc:493] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.324609 27230 raft_consensus.cc:515] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.342134 27232 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.342952 27232 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.345659 27232 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.346272 27232 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.346778 27232 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.348940 27232 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.406570 27236 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.407351 27236 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.410869 27236 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.411540 27236 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.412063 27236 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.438122 27234 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.515177 27234 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.517320 27234 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.518512 27251 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.448736 27233 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.519023 27251 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.519203 27233 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.456666 27238 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:19:23.457499 21711 consensus_peers.cc:597] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.521301 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 63870.6us
W20260709 12:19:23.521895 21711 consensus_peers.cc:597] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.462638 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:23.523304 27240 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.524132 19888 tablet_replica.cc:333] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:23.470393 27247 raft_consensus.cc:493] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.475005 27197 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.476752 27235 raft_consensus.cc:493] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.528026 27240 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.524873 27238 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.528644 27235 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.530968 19888 raft_consensus.cc:2243] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.531967 27235 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.531533 27197 raft_consensus.cc:515] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.531690 19888 raft_consensus.cc:2272] T c68b72acae564588a3a276b7b233d977 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.492973 27241 raft_consensus.cc:493] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.493108 27230 leader_election.cc:290] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.494124 27244 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.497051 27246 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.497786 27250 raft_consensus.cc:493] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.501127 27237 raft_consensus.cc:493] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.501642 27243 raft_consensus.cc:493] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.502753 27231 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.562080 27231 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.503324 27092 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.563360 27092 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.528108 27233 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.532963 27238 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.488386 27245 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.548646 27257 raft_consensus.cc:493] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.559230 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.561655 19888 tablet_replica.cc:333] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
W20260709 12:19:23.568222 21711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 45811.5us
I20260709 12:19:23.568507 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.571497 27237 raft_consensus.cc:515] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.572947 27257 raft_consensus.cc:515] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:19:23.573441 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 58640us
I20260709 12:19:23.565281 27246 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.554425 27241 raft_consensus.cc:515] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.576918 27241 leader_election.cc:290] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.577124 27246 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.577625 27233 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.578114 27233 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.565395 27250 raft_consensus.cc:515] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.580104 27233 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.580324 27250 leader_election.cc:290] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.580796 27245 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.573243 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.581862 21741 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 10.
I20260709 12:19:23.571390 27092 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.575201 27257 leader_election.cc:290] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.530936 27240 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.572139 21747 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 21.
I20260709 12:19:23.599457 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.582836 27245 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.607604 19888 raft_consensus.cc:2243] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.610037 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.545539 27247 raft_consensus.cc:515] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.554749 27244 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.614096 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.614403 21150 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:19:23.614409 27262 raft_consensus.cc:493] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.615648 27262 raft_consensus.cc:515] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.616689 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:19:23.597008 27237 leader_election.cc:290] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:19:23.614357 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 58621.3us
I20260709 12:19:23.618140 21104 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 13.
W20260709 12:19:23.619978 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 483737us
I20260709 12:19:23.589104 27243 raft_consensus.cc:515] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.622506 27263 raft_consensus.cc:493] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.623051 27263 raft_consensus.cc:515] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.623992 27243 leader_election.cc:290] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.621145 27233 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:19:23.624680 27233 raft_consensus.cc:493] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 21 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.620703 27240 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:23.625404 27240 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.625746 27240 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:23.630133 27262 leader_election.cc:290] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.632256 27231 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.606653 27260 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.622505 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.637881 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.639797 27251 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.640540 19888 raft_consensus.cc:2272] T 2747202c22c64b3cb3fb096f2f65e662 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.641002 27260 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.643121 27260 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.625768 27236 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.625032 27233 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:23.646251 27197 leader_election.cc:290] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.621304 27230 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.625020 27263 leader_election.cc:290] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.713003 27267 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.713591 27267 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.715966 27267 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.717515 27255 raft_consensus.cc:493] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.718128 27255 raft_consensus.cc:515] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.688501 27262 raft_consensus.cc:493] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.719157 27262 raft_consensus.cc:515] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.721095 27262 leader_election.cc:290] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.722003 27266 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.724611 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.725194 21105 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:19:23.689323 27236 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.693339 27230 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.675757 27237 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:19:23.726047 21712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 77117.4us
I20260709 12:19:23.712313 27235 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.739177 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.717258 27251 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.732760 27254 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.742920 27251 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.743983 27244 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.732937 27234 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.740315 27263 raft_consensus.cc:493] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.745021 27234 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.744930 27251 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.722910 27266 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.732712 27236 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.747107 27234 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.747617 27266 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.745399 27263 raft_consensus.cc:515] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.750433 27263 leader_election.cc:290] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.750638 27255 leader_election.cc:290] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.755661 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.756721 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.756806 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.761237 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:19:23.760454 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 158399us
I20260709 12:19:23.762036 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.762316 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.750356 19888 tablet_replica.cc:333] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:23.764845 27270 raft_consensus.cc:493] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.765372 27270 raft_consensus.cc:515] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.744088 27237 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.767427 27270 leader_election.cc:290] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.747633 27236 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.767721 27237 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.770052 27233 raft_consensus.cc:515] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.757658 27240 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.775067 21177 raft_consensus.cc:1240] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:23.750759 27235 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.775565 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.768652 19888 raft_consensus.cc:2243] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.776795 19888 raft_consensus.cc:2272] T 2dc46ba93c94432f85502db4f2496cfc P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.777071 27235 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.777957 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.778561 21183 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 10.
I20260709 12:19:23.779747 19888 tablet_replica.cc:333] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:23.763669 27254 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.781384 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.772976 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.781688 27254 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.744021 27247 leader_election.cc:290] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.773168 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6491ed44ddd40e88e8100b87d9eac5e" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.782617 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2794b9a38ad54e088a7b3f884de8ef3d" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.745464 27230 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.784790 21185 raft_consensus.cc:2393] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1b891e53adc40a6a1ae813238321e93 in current term 11: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:19:23.782529 19888 raft_consensus.cc:2243] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.786252 19888 raft_consensus.cc:2272] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.786355 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.787159 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c217b90c5a4022be2281765e591c5a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.788559 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.789880 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fd334874764b26ba28ac382c4199f8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.791181 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.795245 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.795853 21184 raft_consensus.cc:2468] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 17.
I20260709 12:19:23.795310 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.782006 27240 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.796357 27254 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.797786 27254 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.798420 27233 leader_election.cc:290] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 22 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.798988 27255 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.799515 27255 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.799808 27254 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.801427 27255 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.802510 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.803948 27254 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.804476 27254 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.809585 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.814467 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.815462 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.817662 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:23.818861 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.819247 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:23.819769 21746 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:23.823904 27254 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.827178 27249 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.827046 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.827498 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f86692ab0d642a990d934ba6bd6493f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.827790 27249 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.829954 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.829903 27249 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.831099 27233 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.837927 27233 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.839884 27233 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.827136 27272 raft_consensus.cc:493] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.832281 27263 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.840731 19888 tablet_replica.cc:333] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:23.840912 27230 raft_consensus.cc:493] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.840652 27263 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.841461 27246 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.841468 27230 raft_consensus.cc:515] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.841975 27246 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.834007 27254 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.843226 27254 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.843770 27230 leader_election.cc:290] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.841711 27273 raft_consensus.cc:493] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.844594 27273 raft_consensus.cc:515] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.845165 27258 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.845669 27258 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.846110 19888 raft_consensus.cc:2243] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.846519 27273 leader_election.cc:290] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.840550 27272 raft_consensus.cc:515] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.835922 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.847743 27258 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.851190 27255 raft_consensus.cc:493] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.851792 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.842742 27263 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.836974 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.849704 27254 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.846885 19888 raft_consensus.cc:2272] T 0e4624827ee54eb0ba008c640f0ffb6b P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.854257 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.844079 27246 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.857066 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.851719 27255 raft_consensus.cc:515] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.858071 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.859103 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.859499 27255 leader_election.cc:290] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.854830 27230 raft_consensus.cc:493] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.860105 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.860311 27230 raft_consensus.cc:515] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.861053 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc9e2a2fa444400287e8c1f7e71cbf5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.862224 27269 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.862730 27269 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.863689 27272 leader_election.cc:290] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.864194 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90da36dbc3d409db5612d97106ad05a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.864506 27263 raft_consensus.cc:493] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.865401 27263 raft_consensus.cc:515] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.866221 27258 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.866564 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3372843b9d8457e9e243e1b6e33141a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.867247 27263 leader_election.cc:290] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.866706 27258 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.864852 27274 raft_consensus.cc:493] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.869105 27274 raft_consensus.cc:515] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.869410 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bc4c9f937ef4713ba45ba63b0602a7a" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.869926 27258 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.870812 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b547f01ae7e54c0c870de561008eb7e0" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.871165 27274 leader_election.cc:290] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.871711 27255 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.872394 21746 raft_consensus.cc:2468] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 22.
I20260709 12:19:23.872355 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.872272 27247 raft_consensus.cc:493] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.874398 27255 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.874818 27247 raft_consensus.cc:515] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.876371 27255 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.876750 27247 leader_election.cc:290] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.877133 27274 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.877274 27247 raft_consensus.cc:493] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.864794 27269 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.862160 27230 leader_election.cc:290] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.873489 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "747d6b1df3604e0ab07ec5ad8fa568cf" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.879428 21747 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 22 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:19:23.881031 19888 tablet_replica.cc:333] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:23.881891 19888 raft_consensus.cc:2243] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.877768 27247 raft_consensus.cc:515] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.882449 19888 raft_consensus.cc:2272] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.883019 27274 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.883795 27247 leader_election.cc:290] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.884920 27274 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:19:23.877830 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:23.887640 21149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 129509us
W20260709 12:19:23.890048 21000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.890705 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.891043 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.891301 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9fa6d1b68a474195f679c548dd3e4f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.893519 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4f0fe95c524d56a1d1a832a802a359" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.896174 21712 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:19:23.896955 27269 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:23.897286 27269 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:23.897570 27269 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:23.899597 27230 raft_consensus.cc:493] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.900107 27230 raft_consensus.cc:515] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } attrs { replace: true } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.903595 27269 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.905248 27269 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.905642 19888 tablet_replica.cc:333] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:23.906554 19888 raft_consensus.cc:2243] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.907120 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:23.905503 27230 leader_election.cc:290] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.908970 21149 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:23.909816 27272 raft_consensus.cc:493] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:23.910109 27240 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:23.910521 27240 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.910769 27272 raft_consensus.cc:515] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.911350 27240 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:23.912918 27272 leader_election.cc:290] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:23.913741 21108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.914054 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.910939 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55836eaff314a2ebc52f7e3a6801d96" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.919056 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:23.919785 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e78d4839734d8d87724fa056914153" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.920655 27253 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:23.921083 27253 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:23.921445 27253 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:23.921751 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.926556 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:23.928720 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.929379 19888 raft_consensus.cc:2272] T 8c9e0f35d22542d19db11ce7085af404 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.930334 27240 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.933007 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:23.933804 27236 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:23.933640 21150 leader_election.cc:304] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:19:23.933274 27240 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:23.935685 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861699cfca584c7b963879b6d12f2866" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:23.935881 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.936439 21109 raft_consensus.cc:2468] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
W20260709 12:19:23.936823 21711 consensus_peers.cc:597] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.937098 27236 raft_consensus.cc:2804] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:19:23.937649 27236 raft_consensus.cc:697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 22 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
W20260709 12:19:23.937886 21711 consensus_peers.cc:597] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.938781 21711 consensus_peers.cc:597] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.938398 27236 consensus_queue.cc:237] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.940115 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.940366 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f6c7d44dcf4a5787879c202071e5ba" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.928679 27253 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:23.942945 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:19:23.943528 21711 consensus_peers.cc:597] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.943804 27253 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:23.944360 21711 consensus_peers.cc:597] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.945124 21711 consensus_peers.cc:597] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.932082 19888 tablet_replica.cc:333] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:23.945935 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d4361c1e5c40639a84f16f00228b6f" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.946318 19888 raft_consensus.cc:2243] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.953493 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:19:23.954509 21711 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:19:23.958710 20982 auto_rebalancer.cc:629] Failed to schedule move for tablet db9d39844048444b8a7293196d1349e9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:23.958144 20931 catalog_manager.cc:5697] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 21 to 22, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 22 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.959776 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:23.961145 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:19:23.962530 20982 auto_rebalancer.cc:629] Failed to schedule move for tablet 2fb2ddbea74b45ee881e46a2349d3cc9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:23.964728 19888 raft_consensus.cc:2272] T b6f88dd1e21043668981ccdd8686a159 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.966405 27274 consensus_queue.cc:1059] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:23.966759 21002 leader_election.cc:304] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:23.967372 19888 tablet_replica.cc:333] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:23.967411 27247 raft_consensus.cc:3055] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:23.967978 27247 raft_consensus.cc:740] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
I20260709 12:19:23.968446 19888 raft_consensus.cc:2243] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.968740 27247 consensus_queue.cc:260] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:23.969328 19888 raft_consensus.cc:2272] T 79b5e6970bf54d93a119ce3444c25c6a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.970700 27230 raft_consensus.cc:493] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:23.970781 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.971231 27230 raft_consensus.cc:515] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:19:23.972092 21711 leader_election.cc:336] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:23.972499 21711 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:23.972854 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:23.973191 27230 leader_election.cc:290] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:23.973744 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:23.974480 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2065378b47e42a29f6e7eb69f39f47c" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.970134 27247 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:23.975135 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.975129 21104 raft_consensus.cc:2468] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 12.
I20260709 12:19:23.976428 19888 tablet_replica.cc:333] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:23.976790 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.977437 19888 raft_consensus.cc:2243] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.978229 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.978466 27230 raft_consensus.cc:2749] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:23.979610 21002 leader_election.cc:304] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:23.979924 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.980337 27269 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:23.980230 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.980531 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.985177 21180 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:19:23.987267 27269 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:23.987510 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:23.988150 21111 raft_consensus.cc:2468] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed9deaeb4014e9d87aeebbc6384f81f in term 13.
I20260709 12:19:23.978188 19888 raft_consensus.cc:2272] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:23.993301 21711 leader_election.cc:336] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:19:23.998260 21711 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.001319 27230 raft_consensus.cc:2749] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:24.001950 27255 raft_consensus.cc:493] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:24.004632 27255 raft_consensus.cc:515] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:24.006721 27255 leader_election.cc:290] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:24.003007 21002 leader_election.cc:304] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:19:24.003501 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 81724.1us
I20260709 12:19:24.007814 19888 tablet_replica.cc:333] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.009088 19888 raft_consensus.cc:2243] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:24.009014 27272 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
W20260709 12:19:24.009630 21076 consensus_peers.cc:597] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.009686 27272 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:24.010888 27255 raft_consensus.cc:2749] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:24.012082 27272 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:24.012382 21002 leader_election.cc:304] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:19:24.013221 21711 leader_election.cc:336] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.013617 21711 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:24.014307 27269 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:24.017814 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.020417 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.021899 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16c07bcae284f65a7c0ee0375e00769" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.027004 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.028767 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.030951 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.032424 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.033588 27255 raft_consensus.cc:2749] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:24.033743 19888 raft_consensus.cc:2272] T a039020e2b434452bdc6cf055df7cc8a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:24.035852 21711 leader_election.cc:336] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.036185 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:24.036433 19888 tablet_replica.cc:333] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.036772 27230 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:24.037675 27230 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:24.037984 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:24.039595 27230 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:24.040872 19888 raft_consensus.cc:2243] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.041690 19888 raft_consensus.cc:2272] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.045192 19888 tablet_replica.cc:333] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.046113 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:19:24.047098 21150 consensus_peers.cc:597] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f505123ebaba425fa2dadd415e464dfa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.049624 21109 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:24.049810 19888 raft_consensus.cc:2243] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:24.039531 21002 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee; no voters: 
I20260709 12:19:24.051095 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:24.051249 27230 raft_consensus.cc:2804] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:24.051692 27230 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:24.052134 27230 raft_consensus.cc:3060] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:24.052706 27240 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:19:24.054139 21208 debug-util.cc:398] Leaking SignalData structure 0x7b0800339580 after lost signal to thread 19891
W20260709 12:19:24.055197 21208 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0c40 after lost signal to thread 20968
W20260709 12:19:24.055797 21208 debug-util.cc:398] Leaking SignalData structure 0x7b0800249ea0 after lost signal to thread 21060
W20260709 12:19:24.056931 21208 debug-util.cc:398] Leaking SignalData structure 0x7b0800368720 after lost signal to thread 21136
W20260709 12:19:24.058004 21208 debug-util.cc:398] Leaking SignalData structure 0x7b0800354840 after lost signal to thread 21211
I20260709 12:19:24.058640 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81531ae383b1419ea24efbb10c3d2949" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:19:24.059201 21208 debug-util.cc:398] Leaking SignalData structure 0x7b0800376880 after lost signal to thread 21771
I20260709 12:19:24.060668 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:24.061470 21002 leader_election.cc:304] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.050810 19888 raft_consensus.cc:2272] T cff4bd391fcd4a0e98a7359c8267ab60 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.062937 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:24.065388 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "066b481f21914e9aa6feafafc76db125" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:24.068603 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afb5fda50b04769b30c8dfc6a46563e" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:24.069182 27230 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:24.071449 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acde8fc7a134a5e9e141721bf0a4791" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.077865 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.071775 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a1a8045038f4383ba6d1a13bfda6966" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.072091 21186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef296563f06493294dd3c3ee1d30263" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.072707 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a8bfa2966c4510a71d4867b74a1a58" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.073006 27247 raft_consensus.cc:2749] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:24.073338 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ea03120f0340dab2b56ee8ae2b19f9" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.074030 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5bea9516464fcf9fb8a2464ec2f1a8" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.074474 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.080206 20999 leader_election.cc:304] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.073966 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f505123ebaba425fa2dadd415e464dfa" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.075181 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaaf493e892d4ee9839b45b601fc8400" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.074679 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c722a71214448b1f4889cc8bb0c37" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.084408 21709 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.085497 27269 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:24.086660 21709 leader_election.cc:304] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.087492 27230 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:24.087733 27269 raft_consensus.cc:2749] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.092406 27247 raft_consensus.cc:493] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 694635cc4a20455fbbec925e0a84a1ee)
I20260709 12:19:24.092614 21185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:24.092940 27247 raft_consensus.cc:515] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:24.094934 27247 leader_election.cc:290] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:19:24.085716 21076 consensus_peers.cc:597] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:24.080832 20999 raft_consensus.cc:2686] T b90da36dbc3d409db5612d97106ad05a P 3ed9deaeb4014e9d87aeebbc6384f81f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:19:24.095739 21076 consensus_peers.cc:597] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.096581 20999 leader_election.cc:304] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.097342 27247 raft_consensus.cc:2749] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:24.098495 19888 tablet_replica.cc:333] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.099325 19888 raft_consensus.cc:2243] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:24.100281 19888 raft_consensus.cc:2272] T 097c05b85fe14dc38775d8347e0478fe P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.102636 19888 tablet_replica.cc:333] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.106880 20999 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.113215 27247 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:24.114341 20999 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.121668 27230 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:24.123261 20999 leader_election.cc:304] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.123974 27230 raft_consensus.cc:2749] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:24.125361 20999 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.109331 21109 raft_consensus.cc:2955] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:19:24.116711 19888 raft_consensus.cc:2243] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.127868 27230 raft_consensus.cc:2706] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Received pre-election callback for term 17 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:19:24.129987 19888 raft_consensus.cc:2272] T 1f9fa6d1b68a474195f679c548dd3e4f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.106411 27240 raft_consensus.cc:2955] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:19:24.132645 19888 tablet_replica.cc:333] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.133467 19888 raft_consensus.cc:2243] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.116796 27247 raft_consensus.cc:493] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:24.134008 19888 raft_consensus.cc:2272] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.133960 27247 raft_consensus.cc:515] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:24.126587 20999 leader_election.cc:304] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.136446 27230 raft_consensus.cc:2749] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:24.137207 27247 leader_election.cc:290] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:24.137549 20999 leader_election.cc:304] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.138236 27247 raft_consensus.cc:2749] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:24.139034 21181 raft_consensus.cc:1240] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 22 LEADER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:19:24.119639 21709 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.139286 20999 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.139984 27247 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.140877 21709 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.141073 20999 leader_election.cc:304] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.141826 27247 raft_consensus.cc:2749] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:24.142315 27266 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.142897 20999 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:19:24.143492 20999 raft_consensus.cc:2686] T 44d4361c1e5c40639a84f16f00228b6f P 3ed9deaeb4014e9d87aeebbc6384f81f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:24.143954 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:24.145403 27258 consensus_queue.cc:1059] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:19:24.145888 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.146092 27258 consensus_queue.cc:1243] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer 694635cc4a20455fbbec925e0a84a1ee log is divergent from this leader: its last log entry 22.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:19:24.143042 27266 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:24.147440 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
W20260709 12:19:24.148795 21151 consensus_peers.cc:597] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.151155 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:19:24.151757 21151 consensus_peers.cc:597] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.142091 21709 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.150503 20999 leader_election.cc:304] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.152727 27269 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:24.153191 27247 raft_consensus.cc:2804] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:24.155335 27247 raft_consensus.cc:493] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Starting leader election (detected failure of leader a1b891e53adc40a6a1ae813238321e93)
I20260709 12:19:24.155709 27247 raft_consensus.cc:3060] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:24.154589 21002 leader_election.cc:304] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.156700 27230 raft_consensus.cc:2749] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.157305 21002 leader_election.cc:304] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.158036 27230 raft_consensus.cc:2749] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:24.159559 21002 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.160212 27230 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:24.168440 19888 tablet_replica.cc:333] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.169261 19888 raft_consensus.cc:2243] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.169909 19888 raft_consensus.cc:2272] T b7f6c7d44dcf4a5787879c202071e5ba P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.153175 21075 leader_election.cc:304] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.146682 27244 raft_consensus.cc:3055] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:19:24.152213 21151 consensus_peers.cc:597] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.171772 27244 raft_consensus.cc:740] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:24.173312 27244 consensus_queue.cc:260] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:24.174491 27244 raft_consensus.cc:3060] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:19:24.175098 21151 consensus_peers.cc:597] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.171838 27247 raft_consensus.cc:515] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:19:24.175679 21151 consensus_peers.cc:597] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.177485 21178 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
W20260709 12:19:24.186640 21151 consensus_peers.cc:597] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:24.187208 21151 consensus_peers.cc:597] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.192412 20931 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index -1 to 10, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:24.193312 21151 consensus_peers.cc:597] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:24.193948 21151 consensus_peers.cc:597] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:24.194445 21151 consensus_peers.cc:597] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:24.194914 21151 consensus_peers.cc:597] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.182468 19888 tablet_replica.cc:333] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.195984 19888 raft_consensus.cc:2243] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.196520 19888 raft_consensus.cc:2272] T 0a4f0fe95c524d56a1d1a832a802a359 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.183386 27247 leader_election.cc:290] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:19:24.183439 20999 raft_consensus.cc:2686] T f2065378b47e42a29f6e7eb69f39f47c P 3ed9deaeb4014e9d87aeebbc6384f81f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:19:24.198382 21151 consensus_peers.cc:597] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:24.198645 20999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:37643, user_credentials={real_user=slave}} blocked reactor thread for 48202.5us
I20260709 12:19:24.200062 20999 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.200736 21109 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:19:24.201119 20999 leader_election.cc:304] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.202104 27274 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:24.202415 27247 raft_consensus.cc:2749] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.202139 20999 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.202668 27236 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:24.179242 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
W20260709 12:19:24.204579 21075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:35157, user_credentials={real_user=slave}} blocked reactor thread for 55023.4us
W20260709 12:19:24.205138 21150 consensus_peers.cc:597] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): Couldn't send request to peer a1b891e53adc40a6a1ae813238321e93. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ef296563f06493294dd3c3ee1d30263. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.205348 27273 raft_consensus.cc:2749] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.206579 20999 leader_election.cc:304] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.207345 27247 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:24.209229 20999 raft_consensus.cc:2686] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 3ed9deaeb4014e9d87aeebbc6384f81f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:24.210002 20999 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.211248 27247 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.208400 19888 tablet_replica.cc:333] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.212548 19888 raft_consensus.cc:2243] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.213212 19888 raft_consensus.cc:2272] T b55836eaff314a2ebc52f7e3a6801d96 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.215883 19888 tablet_replica.cc:333] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.216598 19888 raft_consensus.cc:2243] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.217151 19888 raft_consensus.cc:2272] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.217923 21075 leader_election.cc:304] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
W20260709 12:19:24.203922 21151 leader_election.cc:336] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.219226 21151 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.220008 27236 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:24.220463 21151 leader_election.cc:336] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:19:24.221287 21151 leader_election.cc:336] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:19:24.222072 21151 leader_election.cc:336] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.222429 21151 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.223302 27273 raft_consensus.cc:2749] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:24.211589 20999 leader_election.cc:304] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.224890 21075 leader_election.cc:304] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.226189 21075 leader_election.cc:304] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.227015 21075 leader_election.cc:304] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.225615 27273 raft_consensus.cc:2749] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.227649 27272 raft_consensus.cc:2749] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:24.228205 19888 tablet_replica.cc:333] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.228955 19888 raft_consensus.cc:2243] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.229146 21111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c63a55bdad346dabf469f0ab75f7020" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.229414 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fd332fad7045099765ea2b69124fb6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.229877 21709 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.231187 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe28fa2b431c442da6a32fe2e3de3ffb" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:19:24.225952 21151 consensus_peers.cc:597] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:24.232162 21151 leader_election.cc:336] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.232666 19888 raft_consensus.cc:2272] T be0e4a74d2d54b1e94234933e9f489c7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:24.232990 21151 leader_election.cc:336] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.233461 21151 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.232405 27259 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:24.234323 27253 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:24.234721 21151 leader_election.cc:336] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.228520 27247 raft_consensus.cc:2749] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.235776 21151 leader_election.cc:304] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.228564 27236 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.232057 27244 raft_consensus.cc:2749] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:24.244493 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531721f3cd9498c9cc3b11699d5de8f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:19:24.243189 21151 consensus_peers.cc:597] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.246004 21178 raft_consensus.cc:1240] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Rejecting Update request from peer 3ed9deaeb4014e9d87aeebbc6384f81f for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:24.246502 21076 consensus_peers.cc:597] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:24.246171 21151 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.247277 21151 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:19:24.248276 21076 leader_election.cc:336] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.244060 27253 raft_consensus.cc:2749] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:24.248672 21076 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:24.249401 27273 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:24.249723 21076 leader_election.cc:336] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.250134 21076 leader_election.cc:304] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:24.250348 27247 consensus_queue.cc:1059] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:24.251204 27258 raft_consensus.cc:2749] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:24.251926 27230 raft_consensus.cc:3055] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:19:24.252017 21076 consensus_peers.cc:597] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.252332 27230 raft_consensus.cc:740] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3ed9deaeb4014e9d87aeebbc6384f81f, State: Running, Role: LEADER
W20260709 12:19:24.252662 21076 consensus_peers.cc:597] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:24.253249 21076 consensus_peers.cc:597] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.253250 27230 consensus_queue.cc:260] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:19:24.254580 21076 leader_election.cc:336] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.255776 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a3a4bebb9546ba9e773da391cb42b6" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.255046 21076 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:24.256775 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c5682e4a6f4eb6a687f13065840f5f" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
W20260709 12:19:24.257449 21151 leader_election.cc:336] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.253539 19888 tablet_replica.cc:333] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.257805 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b9dc7576af431ea6e483cb2a8c04f7" candidate_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:24.257829 21151 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.258944 27253 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:24.259431 27230 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:24.259112 19888 raft_consensus.cc:2243] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:19:24.258005 21076 leader_election.cc:336] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.260594 19888 raft_consensus.cc:2272] T 1407b8879f4c4fe6a95ea91c62d72196 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.260855 21076 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.262144 27256 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:24.263079 21076 leader_election.cc:336] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.263263 19888 tablet_replica.cc:333] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.263375 21076 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:24.264096 19888 raft_consensus.cc:2243] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:24.265523 20999 leader_election.cc:304] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.260408 27244 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:24.267539 21076 leader_election.cc:336] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:19:24.267948 21151 leader_election.cc:336] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.268340 27256 raft_consensus.cc:2749] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.269322 21076 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.269711 27247 raft_consensus.cc:2749] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.269381 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:19:24.273097 21151 leader_election.cc:336] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.269169 27253 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:24.273638 21151 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.271056 20999 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.272804 27240 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:24.275163 21151 leader_election.cc:336] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.276130 20999 leader_election.cc:304] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.276291 27247 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:24.276952 27244 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.276490 27278 raft_consensus.cc:2749] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:24.277176 21076 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.275730 21151 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.276782 27233 raft_consensus.cc:2955] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:19:24.279600 20999 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.280345 19888 raft_consensus.cc:2272] T db9d39844048444b8a7293196d1349e9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.281509 21076 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.280792 27274 raft_consensus.cc:2749] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:24.282307 27256 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:24.283352 21076 leader_election.cc:336] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.283708 21076 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.284337 27256 raft_consensus.cc:2749] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:24.284883 19888 tablet_replica.cc:333] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
W20260709 12:19:24.285311 21076 leader_election.cc:336] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.285682 19888 raft_consensus.cc:2243] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.285692 21076 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:24.286496 27256 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:24.286486 19888 raft_consensus.cc:2272] T 77e78d4839734d8d87724fa056914153 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:24.287029 21076 leader_election.cc:336] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:19:24.288132 21076 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.288545 21076 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:24.287976 21109 raft_consensus.cc:2955] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } } }
I20260709 12:19:24.289181 27256 raft_consensus.cc:2749] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:24.289947 19888 tablet_replica.cc:333] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
W20260709 12:19:24.290220 21076 leader_election.cc:336] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.290727 19888 raft_consensus.cc:2243] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.291420 19888 raft_consensus.cc:2272] T e6a8bfa2966c4510a71d4867b74a1a58 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.290586 21076 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:24.292872 27244 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:24.294010 19888 tablet_replica.cc:333] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.295426 19888 raft_consensus.cc:2243] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.296059 19888 raft_consensus.cc:2272] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.298648 19888 tablet_replica.cc:333] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.299420 19888 raft_consensus.cc:2243] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.300105 19888 raft_consensus.cc:2272] T 9bc4c9f937ef4713ba45ba63b0602a7a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.302110 19888 tablet_replica.cc:333] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.302785 19888 raft_consensus.cc:2243] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.303324 19888 raft_consensus.cc:2272] T 747d6b1df3604e0ab07ec5ad8fa568cf P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.306254 19888 tablet_replica.cc:333] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.307014 19888 raft_consensus.cc:2243] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.307586 19888 raft_consensus.cc:2272] T 0ef296563f06493294dd3c3ee1d30263 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.307890 20999 leader_election.cc:304] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:19:24.308542 20999 raft_consensus.cc:2686] T 92c5682e4a6f4eb6a687f13065840f5f P 3ed9deaeb4014e9d87aeebbc6384f81f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:24.321229 20999 leader_election.cc:304] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.320641 20931 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: config changed from index -1 to 15, NON_VOTER a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) added. New cstate: current_term: 20 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:24.321856 20999 raft_consensus.cc:2686] T 98a3a4bebb9546ba9e773da391cb42b6 P 3ed9deaeb4014e9d87aeebbc6384f81f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:24.322628 20999 leader_election.cc:304] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ed9deaeb4014e9d87aeebbc6384f81f; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.323310 27247 raft_consensus.cc:2749] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:24.308990 27236 raft_consensus.cc:2749] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:24.309907 19888 tablet_replica.cc:333] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.316637 27230 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:19:24.344842 21151 leader_election.cc:336] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.345734 21151 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.346585 27278 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:24.346801 21151 leader_election.cc:336] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.347267 21151 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:24.347939 27278 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:24.345736 19888 raft_consensus.cc:2243] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.351431 19888 raft_consensus.cc:2272] T e3372843b9d8457e9e243e1b6e33141a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.353806 19888 tablet_replica.cc:333] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.354518 19888 raft_consensus.cc:2243] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.355124 19888 raft_consensus.cc:2272] T 40fd334874764b26ba28ac382c4199f8 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.357458 19888 tablet_replica.cc:333] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.358120 19888 raft_consensus.cc:2243] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.358611 19888 raft_consensus.cc:2272] T b6491ed44ddd40e88e8100b87d9eac5e P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:24.360245 21151 leader_election.cc:336] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:24.360673 21151 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:19:24.362623 21151 consensus_peers.cc:597] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.363487 27278 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:19:24.367831 21151 consensus_peers.cc:597] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.391240 19888 tablet_replica.cc:333] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.392055 19888 raft_consensus.cc:2243] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.392688 19888 raft_consensus.cc:2272] T bc9e2a2fa444400287e8c1f7e71cbf5f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.395184 19888 tablet_replica.cc:333] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.395962 19888 raft_consensus.cc:2243] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.396644 19888 raft_consensus.cc:2272] T b547f01ae7e54c0c870de561008eb7e0 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.399123 19888 tablet_replica.cc:333] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.403664 19888 raft_consensus.cc:2243] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.404242 19888 raft_consensus.cc:2272] T e531721f3cd9498c9cc3b11699d5de8f P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.406594 19888 tablet_replica.cc:333] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.407330 19888 raft_consensus.cc:2243] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.408026 19888 raft_consensus.cc:2272] T 2a1a8045038f4383ba6d1a13bfda6966 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.413133 19888 tablet_replica.cc:333] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.413914 19888 raft_consensus.cc:2243] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.414535 19888 raft_consensus.cc:2272] T 1acde8fc7a134a5e9e141721bf0a4791 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.423087 19888 tablet_replica.cc:333] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.423830 19888 raft_consensus.cc:2243] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.424474 19888 raft_consensus.cc:2272] T 11c217b90c5a4022be2281765e591c5a P 3ed9deaeb4014e9d87aeebbc6384f81f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.426885 19888 tablet_replica.cc:333] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.428786 19888 raft_consensus.cc:2243] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.429335 19888 raft_consensus.cc:2272] T 002c722a71214448b1f4889cc8bb0c37 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.431874 19888 tablet_replica.cc:333] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.432590 19888 raft_consensus.cc:2243] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.433163 19888 raft_consensus.cc:2272] T 7c63a55bdad346dabf469f0ab75f7020 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.435739 19888 tablet_replica.cc:333] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.436431 19888 raft_consensus.cc:2243] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.436964 19888 raft_consensus.cc:2272] T e77746cf06a844b28506688985401b7d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.438025 21109 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 22 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:19:24.439492 27236 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:19:24.440795 19888 tablet_replica.cc:333] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.456955 19888 raft_consensus.cc:2243] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.458266 19888 raft_consensus.cc:2272] T f5b9dc7576af431ea6e483cb2a8c04f7 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.461474 19888 tablet_replica.cc:333] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.468411 19888 raft_consensus.cc:2243] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.474197 19888 raft_consensus.cc:2272] T 25ea03120f0340dab2b56ee8ae2b19f9 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.492460 19888 tablet_replica.cc:333] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.493304 19888 raft_consensus.cc:2243] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.494886 19888 raft_consensus.cc:2272] T aaaf493e892d4ee9839b45b601fc8400 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.497483 19888 tablet_replica.cc:333] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.498557 19888 raft_consensus.cc:2243] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.499143 19888 raft_consensus.cc:2272] T f505123ebaba425fa2dadd415e464dfa P 3ed9deaeb4014e9d87aeebbc6384f81f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.501731 19888 tablet_replica.cc:333] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.502411 19888 raft_consensus.cc:2243] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.502974 19888 raft_consensus.cc:2272] T fe28fa2b431c442da6a32fe2e3de3ffb P 3ed9deaeb4014e9d87aeebbc6384f81f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.508600 19888 tablet_replica.cc:333] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.509291 19888 raft_consensus.cc:2243] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:24.514362 19888 raft_consensus.cc:2272] T 81f567d6458f4dddaa94452e04485030 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.517410 19888 tablet_replica.cc:333] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.518189 19888 raft_consensus.cc:2243] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:24.523022 19888 raft_consensus.cc:2272] T fa441bc31c5043668f08c6e72305c329 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.526638 19888 tablet_replica.cc:333] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.527354 19888 raft_consensus.cc:2243] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.529891 19888 raft_consensus.cc:2272] T 2794b9a38ad54e088a7b3f884de8ef3d P 3ed9deaeb4014e9d87aeebbc6384f81f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.532460 19888 tablet_replica.cc:333] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.532698 21747 raft_consensus.cc:1275] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 22 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:19:24.533190 19888 raft_consensus.cc:2243] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:19:24.534310 19888 raft_consensus.cc:2272] T 36a88ddff51a4bcea630447226c59041 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.535197 27234 consensus_queue.cc:1048] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:19:24.585587 19888 tablet_replica.cc:333] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f: stopping tablet replica
I20260709 12:19:24.586400 19888 raft_consensus.cc:2243] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:24.587046 19888 raft_consensus.cc:2272] T 03fd332fad7045099765ea2b69124fb6 P 3ed9deaeb4014e9d87aeebbc6384f81f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:24.644109 21746 raft_consensus.cc:1240] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Rejecting Update request from peer a62242aa80cd4affa87dc4a3cf6b64ec for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:24.645545 27258 consensus_queue.cc:1059] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:24.646560 27258 raft_consensus.cc:3055] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:24.646919 27258 raft_consensus.cc:740] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:24.647697 27258 consensus_queue.cc:260] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:24.649957 27258 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.661742 27297 ts_tablet_manager.cc:933] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:24.680547 27299 ts_tablet_manager.cc:933] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: Initiating tablet copy from peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:24.687168 27297 tablet_copy_client.cc:323] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.3:36737
I20260709 12:19:24.689344 21196 tablet_copy_service.cc:140] P 694635cc4a20455fbbec925e0a84a1ee: Received BeginTabletCopySession request for tablet 0ef296563f06493294dd3c3ee1d30263 from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:48236)
I20260709 12:19:24.689994 21196 tablet_copy_service.cc:161] P 694635cc4a20455fbbec925e0a84a1ee: Beginning new tablet copy session on tablet 0ef296563f06493294dd3c3ee1d30263 from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:48236: session id = a1b891e53adc40a6a1ae813238321e93-0ef296563f06493294dd3c3ee1d30263
I20260709 12:19:24.698598 21196 tablet_copy_source_session.cc:215] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:24.715351 27299 tablet_copy_client.cc:323] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: tablet copy: Beginning tablet copy session from remote peer at address 127.19.108.3:36737
I20260709 12:19:24.965018 21196 tablet_copy_service.cc:140] P 694635cc4a20455fbbec925e0a84a1ee: Received BeginTabletCopySession request for tablet f505123ebaba425fa2dadd415e464dfa from peer a1b891e53adc40a6a1ae813238321e93 ({username='slave'} at 127.0.0.1:48236)
I20260709 12:19:24.972961 21196 tablet_copy_service.cc:161] P 694635cc4a20455fbbec925e0a84a1ee: Beginning new tablet copy session on tablet f505123ebaba425fa2dadd415e464dfa from peer a1b891e53adc40a6a1ae813238321e93 at {username='slave'} at 127.0.0.1:48236: session id = a1b891e53adc40a6a1ae813238321e93-f505123ebaba425fa2dadd415e464dfa
I20260709 12:19:24.973901 27297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef296563f06493294dd3c3ee1d30263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:25.054124 21196 tablet_copy_source_session.cc:215] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:25.058998 27299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f505123ebaba425fa2dadd415e464dfa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:25.111894 21077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:36737, user_credentials={real_user=slave}} blocked reactor thread for 75848.1us
I20260709 12:19:25.121476 27297 tablet_copy_client.cc:806] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:25.122125 27297 tablet_copy_client.cc:670] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:25.126152 27297 tablet_copy_client.cc:538] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:25.136269 27299 tablet_copy_client.cc:806] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:25.146603 27299 tablet_copy_client.cc:670] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:25.159125 27297 tablet_bootstrap.cc:492] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:19:25.168665 27299 tablet_copy_client.cc:538] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:19:25.208240 21151 connection.cc:769] client connection to 127.19.108.1:42723 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 12:19:25.213778 27299 tablet_bootstrap.cc:492] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: Bootstrap starting.
I20260709 12:19:25.286260 27297 tablet_bootstrap.cc:492] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.287195 27297 tablet_bootstrap.cc:492] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:19:25.294281 27253 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.294548 27297 ts_tablet_manager.cc:1403] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.147s	user 0.038s	sys 0.021s
I20260709 12:19:25.294973 27253 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.297246 27303 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.297762 27303 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.298498 27240 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.299017 27240 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.299772 27303 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:25.301471 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:25.303313 27240 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:25.305001 27297 raft_consensus.cc:359] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:19:25.307708 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:25.308661 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:25.311321 27297 raft_consensus.cc:740] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:19:25.311769 27253 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:25.312075 27297 consensus_queue.cc:260] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:19:25.306733 27299 tablet_bootstrap.cc:492] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.321174 27299 tablet_bootstrap.cc:492] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: Bootstrap complete.
I20260709 12:19:25.321902 27299 ts_tablet_manager.cc:1403] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: Time spent bootstrapping tablet: real 0.108s	user 0.024s	sys 0.013s
I20260709 12:19:25.322479 27258 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.323074 27258 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.324988 27299 raft_consensus.cc:359] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:19:25.325707 27258 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:25.325892 27299 raft_consensus.cc:740] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Initialized, Role: LEARNER
I20260709 12:19:25.326706 27299 consensus_queue.cc:260] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: NON_VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: true } }
I20260709 12:19:25.329157 27297 ts_tablet_manager.cc:1434] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:19:25.330832 21196 tablet_copy_service.cc:342] P 694635cc4a20455fbbec925e0a84a1ee: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-0ef296563f06493294dd3c3ee1d30263 received from {username='slave'} at 127.0.0.1:48236
I20260709 12:19:25.331305 21196 tablet_copy_service.cc:434] P 694635cc4a20455fbbec925e0a84a1ee: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-0ef296563f06493294dd3c3ee1d30263 on tablet 0ef296563f06493294dd3c3ee1d30263 with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:25.332701 27299 ts_tablet_manager.cc:1434] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:19:25.335074 21196 tablet_copy_service.cc:342] P 694635cc4a20455fbbec925e0a84a1ee: Request end of tablet copy session a1b891e53adc40a6a1ae813238321e93-f505123ebaba425fa2dadd415e464dfa received from {username='slave'} at 127.0.0.1:48236
I20260709 12:19:25.335455 21196 tablet_copy_service.cc:434] P 694635cc4a20455fbbec925e0a84a1ee: ending tablet copy session a1b891e53adc40a6a1ae813238321e93-f505123ebaba425fa2dadd415e464dfa on tablet f505123ebaba425fa2dadd415e464dfa with peer a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:25.345516 27305 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.346043 27305 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.348902 27305 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:25.350255 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:25.350872 21182 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 16.
I20260709 12:19:25.351506 21746 raft_consensus.cc:1217] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 12:19:25.352092 21712 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:19:25.352963 27305 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:25.353343 27305 raft_consensus.cc:493] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.353749 27305 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.361819 27258 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.363807 27258 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.366194 27258 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:25.371420 27305 raft_consensus.cc:515] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.376945 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:25.395794 21184 raft_consensus.cc:2393] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 14: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:19:25.377532 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:19:25.385403 21711 leader_election.cc:336] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.396741 21181 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
W20260709 12:19:25.394883 21076 leader_election.cc:336] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:25.407140 21076 leader_election.cc:336] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:25.418135 21711 leader_election.cc:336] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.424176 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4624827ee54eb0ba008c640f0ffb6b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:25.424741 21181 raft_consensus.cc:3060] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.431524 21181 raft_consensus.cc:2468] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 17.
I20260709 12:19:25.432823 21712 leader_election.cc:304] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:25.433961 27309 raft_consensus.cc:2804] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:25.434448 27309 raft_consensus.cc:697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 17 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:19:25.435245 27309 consensus_queue.cc:237] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 16.16, Last appended by leader: 16, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.445924 27305 leader_election.cc:290] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:25.448082 27319 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.451797 27319 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.453728 27319 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:25.452243 20931 catalog_manager.cc:5697] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 16 to 17, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 17 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:25.465723 21077 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:25.467166 27319 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:25.487550 21077 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:25.488724 27258 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:25.489202 27258 raft_consensus.cc:493] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.489630 27258 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:25.495847 21151 leader_election.cc:336] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.496374 21151 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:25.502591 27235 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:25.497313 27319 raft_consensus.cc:2749] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:25.504954 21151 leader_election.cc:336] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.507602 21746 raft_consensus.cc:1217] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.14->[20.15-20.15]   Dedup: 20.15->[]
I20260709 12:19:25.523533 21151 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a1b891e53adc40a6a1ae813238321e93
I20260709 12:19:25.528919 27235 raft_consensus.cc:2749] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:25.530011 21151 leader_election.cc:336] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.534189 21151 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:19:25.528419 21076 leader_election.cc:336] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.499800 27258 raft_consensus.cc:515] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.539288 27235 raft_consensus.cc:2749] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:25.555027 27258 leader_election.cc:290] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:19:25.561237 21076 leader_election.cc:336] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.573334 27309 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.606820 27309 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.608942 27309 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:19:25.598251 21711 consensus_peers.cc:597] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:25.610420 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:25.611075 21184 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:19:25.612475 21712 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
I20260709 12:19:25.620786 27328 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:25.621328 27328 raft_consensus.cc:493] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.621730 27328 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:25.622191 21711 leader_election.cc:336] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:25.615381 21076 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 54167.9us
I20260709 12:19:25.631743 27328 raft_consensus.cc:515] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.644457 27328 leader_election.cc:290] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:25.645769 21182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0e4a74d2d54b1e94234933e9f489c7" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:25.646343 21182 raft_consensus.cc:3060] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.650698 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:25.652240 21184 raft_consensus.cc:2393] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a62242aa80cd4affa87dc4a3cf6b64ec in current term 16: Already voted for candidate 694635cc4a20455fbbec925e0a84a1ee in this term.
I20260709 12:19:25.653302 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9e0f35d22542d19db11ce7085af404" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:25.653834 21184 raft_consensus.cc:3060] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:25.654289 21711 leader_election.cc:336] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.658674 21182 raft_consensus.cc:2468] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:19:25.659823 21712 leader_election.cc:304] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:25.660359 21184 raft_consensus.cc:2468] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 16.
I20260709 12:19:25.660549 27328 raft_consensus.cc:2804] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:25.661096 27328 raft_consensus.cc:697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:19:25.661900 27328 consensus_queue.cc:237] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.683445 20931 catalog_manager.cc:5697] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 10 to 12, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 12 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:25.685981 21711 consensus_peers.cc:597] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:25.711587 21077 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, 694635cc4a20455fbbec925e0a84a1ee
I20260709 12:19:25.712801 27258 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.720134 27258 raft_consensus.cc:2749] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:25.740639 21077 leader_election.cc:304] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:25.741881 27258 raft_consensus.cc:2804] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:25.744663 27328 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.745286 27328 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.747385 27328 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:25.750912 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:25.753067 27235 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.753579 27235 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.757019 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:25.757617 21109 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
I20260709 12:19:25.759330 21149 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:25.760051 27240 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:25.760428 27240 raft_consensus.cc:493] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.760769 27240 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:25.762300 21711 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.762753 21711 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:25.764299 27309 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:25.768162 27269 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.768662 27269 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.768784 27240 raft_consensus.cc:515] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.770816 27269 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:25.772897 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:25.773675 27244 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.777212 27244 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.779268 27244 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:25.772145 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9d39844048444b8a7293196d1349e9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:25.780275 21104 raft_consensus.cc:3060] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.780596 27235 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:25.781948 27258 raft_consensus.cc:697] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
W20260709 12:19:25.785367 21076 leader_election.cc:336] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.783304 27240 leader_election.cc:290] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:25.785917 21711 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.786762 21711 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:25.787499 27328 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:25.788548 21104 raft_consensus.cc:2468] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:19:25.789808 21149 leader_election.cc:304] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:25.789624 27258 consensus_queue.cc:237] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.791985 27240 raft_consensus.cc:2804] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:25.792482 27240 raft_consensus.cc:697] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 17 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:25.793277 27240 consensus_queue.cc:237] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.816941 20931 catalog_manager.cc:5697] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 16 to 17, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 17 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:25.820367 21178 raft_consensus.cc:1275] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 17 index: 17. (index mismatch)
I20260709 12:19:25.823138 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:25.823256 27328 consensus_queue.cc:1048] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:19:25.823910 21178 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 13.
I20260709 12:19:25.833024 27269 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.833575 27269 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.835728 27269 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:25.838222 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:25.838932 21104 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:19:25.840435 21709 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:25.841395 27269 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:25.841842 27269 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.842239 27269 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.832897 27240 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:25.847417 27240 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.855167 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
W20260709 12:19:25.855921 21711 consensus_peers.cc:597] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:25.855803 21104 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 11.
I20260709 12:19:25.857621 21149 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:25.859330 27253 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:25.859700 27253 raft_consensus.cc:493] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:25.860015 27253 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.867583 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:25.869511 27240 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:25.870038 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:25.871335 27253 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.875813 27328 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.888155 21178 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:19:25.887890 27328 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.889025 27244 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.889529 27244 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.891544 27244 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:25.886816 27269 raft_consensus.cc:515] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.911024 27244 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.912472 21746 raft_consensus.cc:2368] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12.
I20260709 12:19:25.912223 27244 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.914130 21150 leader_election.cc:400] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12.
I20260709 12:19:25.914330 27244 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:25.897162 20931 catalog_manager.cc:5697] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 15 to 16, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 16 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.898409 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
W20260709 12:19:25.897260 21711 leader_election.cc:336] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.915139 21184 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 15.
I20260709 12:19:25.915802 27269 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:25.918236 21712 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:25.890065 27328 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:19:25.897568 21076 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.895037 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:25.919157 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:25.919624 21747 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
I20260709 12:19:25.920888 27328 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:25.921319 27328 raft_consensus.cc:493] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.921736 27328 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.927480 21075 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:25.929141 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:25.929322 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:25.929929 21747 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 20.
W20260709 12:19:25.930198 21711 consensus_peers.cc:597] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:25.919729 21184 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.929685 21104 raft_consensus.cc:3060] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.932464 27258 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.933177 27258 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.934477 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:25.935065 27258 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:25.930368 27244 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:25.935896 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa56a6078064852ac53dd912136460b" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:25.936615 21747 raft_consensus.cc:2368] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12.
I20260709 12:19:25.937568 21150 leader_election.cc:400] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12.
I20260709 12:19:25.937848 21150 leader_election.cc:403] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:19:25.930979 21075 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:25.938560 27319 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:25.938927 27319 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.939217 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:25.939383 27319 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:25.940300 21747 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:19:25.941334 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:25.942044 27258 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:25.942414 27258 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.942760 27258 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:25.935963 27244 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.944126 27244 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.948685 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
W20260709 12:19:25.939052 21076 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.950007 27249 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:25.950464 27249 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:25.950819 27249 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:25.952939 27319 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.954934 27319 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:19:25.950024 21711 consensus_peers.cc:597] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:25.957159 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa441bc31c5043668f08c6e72305c329" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:25.957753 21747 raft_consensus.cc:3060] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:25.963658 27249 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:25.965193 27244 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:19:25.965852 21076 leader_election.cc:336] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.966156 27249 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:19:25.966573 21076 consensus_peers.cc:597] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:25.948657 21104 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
W20260709 12:19:25.967041 21076 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.967852 21709 leader_election.cc:304] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:25.976081 27269 raft_consensus.cc:2804] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:25.977371 27269 raft_consensus.cc:697] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:19:25.978317 27269 consensus_queue.cc:237] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.981863 27244 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:25.983345 21746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a88ddff51a4bcea630447226c59041" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:25.983914 21746 raft_consensus.cc:3060] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:25.985356 21076 consensus_peers.cc:597] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:25.988533 21076 leader_election.cc:336] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:25.988997 21076 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:25.989786 21711 consensus_peers.cc:597] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:25.974442 27258 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:25.993286 21746 raft_consensus.cc:2468] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
I20260709 12:19:25.994445 27258 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:25.968183 21747 raft_consensus.cc:2468] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 21.
W20260709 12:19:25.968930 27333 log.cc:927] Time spent T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:19:25.971417 21184 raft_consensus.cc:2468] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 12.
I20260709 12:19:25.996932 27235 raft_consensus.cc:2749] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157) with higher term. Message: Invalid argument: T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 694635cc4a20455fbbec925e0a84a1ee for earlier term 11. Current term is 12.
I20260709 12:19:25.997448 21075 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:25.998873 21075 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:25.999683 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a039020e2b434452bdc6cf055df7cc8a" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:26.000221 21747 raft_consensus.cc:3060] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.002463 27319 raft_consensus.cc:2804] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:26.003002 27319 raft_consensus.cc:697] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:26.003856 27319 consensus_queue.cc:237] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:26.006385 27244 raft_consensus.cc:2804] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:26.006562 20931 catalog_manager.cc:5697] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 10 to 12, leader changed from a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 12 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:26.014631 21076 leader_election.cc:336] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.015362 27258 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:26.015863 27258 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.017998 27258 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:19:25.995095 21151 leader_election.cc:336] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:26.027392 21711 consensus_peers.cc:597] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.035332 21747 raft_consensus.cc:2468] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 15.
I20260709 12:19:26.036537 21075 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:26.038786 27258 raft_consensus.cc:2804] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:26.039290 27258 raft_consensus.cc:697] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:25.973840 27253 leader_election.cc:290] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
W20260709 12:19:26.040393 21076 leader_election.cc:336] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:25.972389 27328 raft_consensus.cc:515] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:26.052150 27258 consensus_queue.cc:237] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:19:26.058602 21711 leader_election.cc:336] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:26.026780 21151 leader_election.cc:336] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.062160 27235 raft_consensus.cc:1064] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:19:26.063990 27328 leader_election.cc:290] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:26.065125 27235 consensus_queue.cc:237] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:26.067088 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4bd391fcd4a0e98a7359c8267ab60" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:26.092013 21184 raft_consensus.cc:3060] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:26.076504 21711 consensus_peers.cc:597] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.099249 27244 raft_consensus.cc:697] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:26.100239 27244 consensus_queue.cc:237] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:26.101692 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f88dd1e21043668981ccdd8686a159" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:26.102182 21103 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:19:26.103542 21747 raft_consensus.cc:1275] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93 [term 20 LEARNER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:19:26.104943 27337 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:26.109009 27235 consensus_queue.cc:1048] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:19:26.117400 21076 consensus_peers.cc:597] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.119459 21181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:26.120086 21181 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 18.
I20260709 12:19:26.102327 21183 raft_consensus.cc:3060] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:26.140379 20928 catalog_manager.cc:5697] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 9 to 10, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 10 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:26.149293 21711 consensus_peers.cc:597] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.149542 27258 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:26.150104 27258 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:19:26.158334 21076 leader_election.cc:336] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.156152 27258 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:26.159158 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
I20260709 12:19:26.160832 21747 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 11.
I20260709 12:19:26.161885 21075 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:26.162622 27258 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:26.162990 27258 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:26.163326 27258 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:26.165657 21184 raft_consensus.cc:2468] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 16.
I20260709 12:19:26.166182 21183 raft_consensus.cc:2468] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 14.
I20260709 12:19:26.167239 21077 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:26.170806 27244 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:26.171500 27244 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:26.171885 27244 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:26.172338 21712 leader_election.cc:304] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:26.173966 27328 raft_consensus.cc:2804] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:26.175094 27328 raft_consensus.cc:697] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Becoming Leader. State: Replica: a1b891e53adc40a6a1ae813238321e93, State: Running, Role: LEADER
I20260709 12:19:26.176127 27328 consensus_queue.cc:237] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:26.178654 27258 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:26.183261 20931 catalog_manager.cc:5697] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 20 to 21, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 21 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:26.184847 20931 catalog_manager.cc:5697] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 14 to 15, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 15 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:26.192339 21747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "097c05b85fe14dc38775d8347e0478fe" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93"
I20260709 12:19:26.192931 21747 raft_consensus.cc:3060] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:26.196287 21076 leader_election.cc:336] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.200431 27258 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:26.201730 21184 raft_consensus.cc:1275] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:26.203150 27269 consensus_queue.cc:1048] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:26.199622 21747 raft_consensus.cc:2468] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 12.
I20260709 12:19:26.205936 21075 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:26.208011 27319 raft_consensus.cc:2804] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:26.209342 27319 raft_consensus.cc:697] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:26.210176 27319 consensus_queue.cc:237] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:26.214922 21104 raft_consensus.cc:1275] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:26.216257 27240 raft_consensus.cc:1064] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: attempting to promote NON_VOTER a1b891e53adc40a6a1ae813238321e93 to VOTER
I20260709 12:19:26.216672 27336 consensus_queue.cc:1048] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:26.218645 27240 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:26.217649 27253 raft_consensus.cc:2955] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:26.220551 21104 raft_consensus.cc:2955] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:26.241250 21747 raft_consensus.cc:2955] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:19:26.247072 21711 consensus_peers.cc:597] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.249675 21746 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [term 16 LEARNER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:26.251196 27253 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:26.251971 21109 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:26.253352 27235 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:26.264549 20928 catalog_manager.cc:5697] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 reported cstate change: term changed from 15 to 16, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a1b891e53adc40a6a1ae813238321e93 (127.19.108.4). New cstate: current_term: 16 leader_uuid: "a1b891e53adc40a6a1ae813238321e93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.271747 27235 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.276147 27235 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.278867 27235 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:26.290580 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:26.291206 21103 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 16.
W20260709 12:19:26.295207 21076 consensus_peers.cc:597] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.298164 21077 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:26.300279 27244 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.301487 27319 raft_consensus.cc:2804] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:26.302140 27319 raft_consensus.cc:697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:26.303035 27319 consensus_queue.cc:237] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.293874 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
W20260709 12:19:26.306300 21076 leader_election.cc:336] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.292733 20928 catalog_manager.cc:5697] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 11 to 12, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 12 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:26.307936 27253 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:26.314352 27253 raft_consensus.cc:493] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.314785 27253 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:26.318205 27336 raft_consensus.cc:2955] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:26.322043 27253 raft_consensus.cc:515] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.312814 20928 catalog_manager.cc:5697] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: config changed from index 15 to 16, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } attrs { replace: true } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:26.328991 21747 raft_consensus.cc:2955] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:19:26.335441 21076 consensus_peers.cc:597] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.323827 27244 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:26.326221 27235 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:26.327827 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f567d6458f4dddaa94452e04485030" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:26.336444 21183 raft_consensus.cc:3060] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:26.336391 27235 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.338693 27235 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:26.340281 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:26.340883 21109 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:19:26.342216 21149 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:26.339489 21105 raft_consensus.cc:2955] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:26.343071 27235 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:26.343441 27235 raft_consensus.cc:493] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:26.343765 27235 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.351692 27235 raft_consensus.cc:515] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.354444 21109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb2ddbea74b45ee881e46a2349d3cc9" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:26.370227 21109 raft_consensus.cc:3060] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.377496 21109 raft_consensus.cc:2468] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:19:26.352051 21183 raft_consensus.cc:2468] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 19.
I20260709 12:19:26.362110 27235 leader_election.cc:290] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:26.329488 21151 consensus_peers.cc:597] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:26.379455 21151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 49998.5us
W20260709 12:19:26.380882 21151 consensus_peers.cc:597] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.382230 21184 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:26.383353 21149 leader_election.cc:304] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:26.383924 27309 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:26.384436 27336 raft_consensus.cc:2804] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:26.384944 27336 raft_consensus.cc:697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:26.385768 27336 consensus_queue.cc:237] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.387936 27319 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:26.388433 27319 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.390308 27319 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:26.391780 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b5e6970bf54d93a119ce3444c25c6a" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:26.392315 21105 raft_consensus.cc:3060] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:26.385674 20931 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 10 to 11, a1b891e53adc40a6a1ae813238321e93 (127.19.108.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } attrs { replace: true } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:26.397845 21077 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:26.399375 27258 raft_consensus.cc:2804] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:26.399827 27258 raft_consensus.cc:697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:26.400612 27258 consensus_queue.cc:237] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.384649 27253 leader_election.cc:290] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:26.409567 21076 leader_election.cc:336] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.420874 21183 raft_consensus.cc:1275] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:26.424741 21183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:26.425376 21183 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 9.
W20260709 12:19:26.426502 21151 consensus_peers.cc:597] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.426959 20931 catalog_manager.cc:5697] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 13 to 14, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 14 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:26.428537 21151 consensus_peers.cc:597] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.428941 21151 consensus_peers.cc:597] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:26.429697 21151 leader_election.cc:336] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.432528 21105 raft_consensus.cc:2468] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 17.
I20260709 12:19:26.433915 21149 leader_election.cc:304] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:26.434597 27235 raft_consensus.cc:2804] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:26.436298 27258 consensus_queue.cc:1048] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:26.435281 27235 raft_consensus.cc:697] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 17 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:26.441290 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:26.441152 27235 consensus_queue.cc:237] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.442378 27258 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:26.442827 27258 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3ed9deaeb4014e9d87aeebbc6384f81f)
I20260709 12:19:26.443272 27258 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:26.450171 20931 catalog_manager.cc:5697] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 18 to 19, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 19 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:26.462378 21151 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:26.467837 21151 leader_election.cc:336] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.464392 21185 consensus_queue.cc:237] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:19:26.469381 21151 consensus_peers.cc:597] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.469801 21151 leader_election.cc:336] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.463296 27258 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.478724 27258 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
W20260709 12:19:26.478808 21711 consensus_peers.cc:597] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.490674 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1407b8879f4c4fe6a95ea91c62d72196" candidate_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee"
I20260709 12:19:26.491325 21178 raft_consensus.cc:3060] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:26.503569 21747 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:26.504956 21105 raft_consensus.cc:1275] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:26.505818 27240 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:19:26.506100 21151 consensus_peers.cc:597] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.506630 27235 consensus_queue.cc:1048] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:19:26.507184 21151 consensus_peers.cc:597] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.507596 21151 consensus_peers.cc:597] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.516248 21151 consensus_peers.cc:597] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.517655 27337 raft_consensus.cc:2955] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:26.522157 21747 raft_consensus.cc:2955] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:26.522949 21103 raft_consensus.cc:2955] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
I20260709 12:19:26.521212 21109 raft_consensus.cc:1275] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:26.534317 27309 consensus_queue.cc:1048] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:26.545346 20921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f505123ebaba425fa2dadd415e464dfa with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:26.554833 20931 catalog_manager.cc:5697] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 reported cstate change: config changed from index 11 to 12, VOTER 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) evicted. New cstate: current_term: 16 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } } }
W20260709 12:19:26.558524 21151 consensus_peers.cc:597] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.560750 21178 raft_consensus.cc:2468] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a62242aa80cd4affa87dc4a3cf6b64ec in term 10.
W20260709 12:19:26.560396 21151 consensus_peers.cc:597] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.603608 21151 consensus_peers.cc:597] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.605484 21077 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:26.574393 27240 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.606295 27240 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.607460 27258 raft_consensus.cc:2804] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:26.607592 21076 leader_election.cc:336] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.584393 21747 raft_consensus.cc:1275] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:19:26.608422 21076 consensus_peers.cc:597] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.585038 21746 raft_consensus.cc:1275] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 12:19:26.609122 21076 consensus_peers.cc:597] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.609802 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" is_pre_election: true
I20260709 12:19:26.610409 21105 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 14.
I20260709 12:19:26.611805 21149 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 
I20260709 12:19:26.613116 27319 consensus_queue.cc:1048] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:26.608407 27240 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:26.614446 27339 consensus_queue.cc:1048] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:19:26.615079 27240 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:26.615458 27240 raft_consensus.cc:493] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.615767 27240 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:26.623466 21151 consensus_peers.cc:597] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.624006 21151 consensus_peers.cc:597] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.624413 21151 leader_election.cc:336] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:26.629125 21076 consensus_peers.cc:597] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.634424 20926 catalog_manager.cc:5697] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 14 to 15, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 15 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.625352 27258 raft_consensus.cc:697] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Becoming Leader. State: Replica: a62242aa80cd4affa87dc4a3cf6b64ec, State: Running, Role: LEADER
I20260709 12:19:26.659888 27258 consensus_queue.cc:237] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:19:26.679603 21151 consensus_peers.cc:597] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.681816 21076 consensus_peers.cc:597] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.682381 21076 consensus_peers.cc:597] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:26.683073 21076 consensus_peers.cc:597] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.686018 21076 consensus_peers.cc:597] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.711311 27240 raft_consensus.cc:515] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.716511 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77746cf06a844b28506688985401b7d" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec"
I20260709 12:19:26.717258 21103 raft_consensus.cc:3060] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:26.723147 21076 consensus_peers.cc:597] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:26.731968 21076 consensus_peers.cc:597] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:26.731937 21151 leader_election.cc:336] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:26.739748 21183 raft_consensus.cc:1275] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Refusing update from remote peer a1b891e53adc40a6a1ae813238321e93: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:19:26.738313 27240 leader_election.cc:290] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Requested vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:26.738981 20920 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.108.1:42723, user_credentials={real_user=slave}} blocked reactor thread for 87498.3us
I20260709 12:19:26.743312 27364 consensus_queue.cc:1048] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:19:26.745247 20920 catalog_manager.cc:4755] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f505123ebaba425fa2dadd415e464dfa: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:26.747845 21151 consensus_peers.cc:597] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:26.752688 21746 raft_consensus.cc:1275] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:26.754074 27339 consensus_queue.cc:1048] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:19:26.754508 21103 raft_consensus.cc:2468] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 694635cc4a20455fbbec925e0a84a1ee in term 15.
I20260709 12:19:26.757470 21149 leader_election.cc:304] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f
I20260709 12:19:26.758253 27336 raft_consensus.cc:2804] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:26.758781 27336 raft_consensus.cc:697] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Becoming Leader. State: Replica: 694635cc4a20455fbbec925e0a84a1ee, State: Running, Role: LEADER
I20260709 12:19:26.759646 27336 consensus_queue.cc:237] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:26.758253 20928 catalog_manager.cc:5697] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 15 to 17, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 17 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:26.768357 21711 consensus_peers.cc:597] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.780459 21742 raft_consensus.cc:1275] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:26.782130 27319 consensus_queue.cc:1048] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:26.788594 20931 catalog_manager.cc:5697] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec reported cstate change: term changed from 9 to 10, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2). New cstate: current_term: 10 leader_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:26.791817 21076 consensus_peers.cc:597] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.796813 21103 raft_consensus.cc:1275] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:26.821556 27337 consensus_queue.cc:1048] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:19:26.825511 21151 consensus_peers.cc:597] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.830224 20928 catalog_manager.cc:5697] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee reported cstate change: term changed from 13 to 15, leader changed from 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1) to 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3). New cstate: current_term: 15 leader_uuid: "694635cc4a20455fbbec925e0a84a1ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:26.838227 21151 consensus_peers.cc:597] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.863081 21183 raft_consensus.cc:1275] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:26.865243 27258 consensus_queue.cc:1048] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:19:26.873003 21076 consensus_peers.cc:597] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:26.948983 21185 raft_consensus.cc:1275] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:26.964397 27258 consensus_queue.cc:1048] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:19:27.016646 21103 raft_consensus.cc:1275] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:19:27.018639 21076 consensus_peers.cc:597] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.029815 27240 consensus_queue.cc:1048] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:27.133044 21184 raft_consensus.cc:1275] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Refusing update from remote peer a62242aa80cd4affa87dc4a3cf6b64ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:27.160214 27378 consensus_queue.cc:1048] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 12:19:27.253018 21076 consensus_peers.cc:597] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:27.264225 21076 consensus_peers.cc:597] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:27.277570 21151 consensus_peers.cc:597] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:27.294118 21151 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111) [suppressed 366 similar messages]
I20260709 12:19:27.360050 21105 raft_consensus.cc:1275] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Refusing update from remote peer 694635cc4a20455fbbec925e0a84a1ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:27.362126 27253 consensus_queue.cc:1048] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:27.450780 19888 tablet_server.cc:196] TabletServer@127.19.108.1:0 shutdown complete.
I20260709 12:19:27.613616 19888 tablet_server.cc:179] TabletServer@127.19.108.2:0 shutting down...
W20260709 12:19:27.639490 21709 consensus_peers.cc:597] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:27.654825 21709 consensus_peers.cc:597] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.694082 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:27.695566 19888 tablet_replica.cc:333] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.696800 19888 raft_consensus.cc:2243] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:19:27.698666 21709 consensus_peers.cc:597] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.699098 19888 raft_consensus.cc:2272] T 2747202c22c64b3cb3fb096f2f65e662 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.701984 19888 tablet_replica.cc:333] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.702929 19888 raft_consensus.cc:2243] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.703563 19888 raft_consensus.cc:2272] T 2fb2ddbea74b45ee881e46a2349d3cc9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.703680 21709 consensus_peers.cc:597] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.708096 19888 tablet_replica.cc:333] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.709070 19888 raft_consensus.cc:2243] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:27.709115 21149 consensus_peers.cc:597] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.710726 19888 raft_consensus.cc:2272] T b55836eaff314a2ebc52f7e3a6801d96 P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.711406 21149 consensus_peers.cc:597] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.713487 19888 tablet_replica.cc:333] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.714294 19888 raft_consensus.cc:2243] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.714941 19888 raft_consensus.cc:2272] T 2dc46ba93c94432f85502db4f2496cfc P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.718423 19888 tablet_replica.cc:333] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.719280 19888 raft_consensus.cc:2243] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.720067 19888 raft_consensus.cc:2272] T c68b72acae564588a3a276b7b233d977 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.722807 19888 tablet_replica.cc:333] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.724607 19888 raft_consensus.cc:2243] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.726431 19888 raft_consensus.cc:2272] T 44d4361c1e5c40639a84f16f00228b6f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.726423 21149 consensus_peers.cc:597] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.729347 19888 tablet_replica.cc:333] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.730436 19888 raft_consensus.cc:2243] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.732173 19888 raft_consensus.cc:2272] T 8c9e0f35d22542d19db11ce7085af404 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.732381 21149 consensus_peers.cc:597] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.735083 19888 tablet_replica.cc:333] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.735883 19888 raft_consensus.cc:2243] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.737000 19888 raft_consensus.cc:2272] T b6f88dd1e21043668981ccdd8686a159 P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.740329 19888 tablet_replica.cc:333] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.741174 19888 raft_consensus.cc:2243] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.741693 19888 raft_consensus.cc:2272] T 79b5e6970bf54d93a119ce3444c25c6a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.744441 19888 tablet_replica.cc:333] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.745183 19888 raft_consensus.cc:2243] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.745733 19888 raft_consensus.cc:2272] T b90da36dbc3d409db5612d97106ad05a P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.748306 19888 tablet_replica.cc:333] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.749042 19888 raft_consensus.cc:2243] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.750115 19888 raft_consensus.cc:2272] T a039020e2b434452bdc6cf055df7cc8a P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.753011 19888 tablet_replica.cc:333] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.753602 19888 raft_consensus.cc:2243] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.754225 19888 raft_consensus.cc:2272] T 066b481f21914e9aa6feafafc76db125 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.756564 19888 tablet_replica.cc:333] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.757303 19888 raft_consensus.cc:2243] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.758096 19888 raft_consensus.cc:2272] T 2afb5fda50b04769b30c8dfc6a46563e P a62242aa80cd4affa87dc4a3cf6b64ec [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.760627 19888 tablet_replica.cc:333] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.761382 19888 raft_consensus.cc:2243] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.763046 19888 raft_consensus.cc:2272] T b7f6c7d44dcf4a5787879c202071e5ba P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.769964 21709 consensus_peers.cc:597] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.770872 19888 tablet_replica.cc:333] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.771706 19888 raft_consensus.cc:2243] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.772765 19888 raft_consensus.cc:2272] T 3a806d7d80a64c98ad9053bacc618d37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.776208 19888 tablet_replica.cc:333] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.777015 19888 raft_consensus.cc:2243] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.777845 19888 raft_consensus.cc:2272] T f2065378b47e42a29f6e7eb69f39f47c P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.780673 19888 tablet_replica.cc:333] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.781391 19888 raft_consensus.cc:2243] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.783216 19888 raft_consensus.cc:2272] T 097c05b85fe14dc38775d8347e0478fe P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.788785 19888 tablet_replica.cc:333] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.789680 19888 raft_consensus.cc:2243] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.790814 19888 raft_consensus.cc:2272] T 1f9fa6d1b68a474195f679c548dd3e4f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.793416 19888 tablet_replica.cc:333] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.794098 19888 raft_consensus.cc:2243] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.794772 19888 raft_consensus.cc:2272] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.797384 19888 tablet_replica.cc:333] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.798058 19888 raft_consensus.cc:2243] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.799149 19888 raft_consensus.cc:2272] T 0a4f0fe95c524d56a1d1a832a802a359 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.799813 21149 consensus_peers.cc:597] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.801791 19888 tablet_replica.cc:333] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.802580 19888 raft_consensus.cc:2243] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.803776 19888 raft_consensus.cc:2272] T 861699cfca584c7b963879b6d12f2866 P a62242aa80cd4affa87dc4a3cf6b64ec [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.804234 21149 consensus_peers.cc:597] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.806265 19888 tablet_replica.cc:333] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.807137 19888 raft_consensus.cc:2243] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.807700 19888 raft_consensus.cc:2272] T 98a3a4bebb9546ba9e773da391cb42b6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.808898 21149 consensus_peers.cc:597] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.810474 19888 tablet_replica.cc:333] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.811313 19888 raft_consensus.cc:2243] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.811884 19888 raft_consensus.cc:2272] T e3372843b9d8457e9e243e1b6e33141a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.814697 19888 tablet_replica.cc:333] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.815490 19888 raft_consensus.cc:2243] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.816154 19888 raft_consensus.cc:2272] T 81531ae383b1419ea24efbb10c3d2949 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.817341 21149 consensus_peers.cc:597] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.818781 19888 tablet_replica.cc:333] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.819674 19888 raft_consensus.cc:2243] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.820394 19888 raft_consensus.cc:2272] T 1acde8fc7a134a5e9e141721bf0a4791 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.821816 21149 consensus_peers.cc:597] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.823004 19888 tablet_replica.cc:333] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.823779 19888 raft_consensus.cc:2243] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.824872 19888 raft_consensus.cc:2272] T e531721f3cd9498c9cc3b11699d5de8f P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.827625 19888 tablet_replica.cc:333] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.828382 19888 raft_consensus.cc:2243] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.829602 19888 raft_consensus.cc:2272] T b547f01ae7e54c0c870de561008eb7e0 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.832042 19888 tablet_replica.cc:333] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.832756 19888 raft_consensus.cc:2243] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.833817 19888 raft_consensus.cc:2272] T 0f86692ab0d642a990d934ba6bd6493f P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.837015 19888 tablet_replica.cc:333] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.837939 19888 raft_consensus.cc:2243] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:19:27.838008 21149 consensus_peers.cc:597] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.839041 19888 raft_consensus.cc:2272] T 002c722a71214448b1f4889cc8bb0c37 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.841013 19888 tablet_replica.cc:333] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.841578 19888 raft_consensus.cc:2243] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.842041 19888 raft_consensus.cc:2272] T e6a8bfa2966c4510a71d4867b74a1a58 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.844130 19888 tablet_replica.cc:333] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.844666 19888 raft_consensus.cc:2243] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.845408 19888 raft_consensus.cc:2272] T 92c5682e4a6f4eb6a687f13065840f5f P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.851351 19888 tablet_replica.cc:333] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.852101 19888 raft_consensus.cc:2243] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.852587 19888 raft_consensus.cc:2272] T 747d6b1df3604e0ab07ec5ad8fa568cf P a62242aa80cd4affa87dc4a3cf6b64ec [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.855544 19888 tablet_replica.cc:333] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.856110 19888 raft_consensus.cc:2243] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.857657 19888 raft_consensus.cc:2272] T 9bc4c9f937ef4713ba45ba63b0602a7a P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.862119 19888 tablet_replica.cc:333] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.862800 19888 raft_consensus.cc:2243] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.863755 19888 raft_consensus.cc:2272] T 0ef296563f06493294dd3c3ee1d30263 P a62242aa80cd4affa87dc4a3cf6b64ec [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.867332 19888 tablet_replica.cc:333] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.868016 19888 raft_consensus.cc:2243] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.869055 19888 raft_consensus.cc:2272] T 1407b8879f4c4fe6a95ea91c62d72196 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.870934 21149 consensus_peers.cc:597] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.873507 19888 tablet_replica.cc:333] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
W20260709 12:19:27.874024 21149 consensus_peers.cc:597] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.874253 19888 raft_consensus.cc:2243] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.874949 19888 raft_consensus.cc:2272] T db9d39844048444b8a7293196d1349e9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.876837 19888 tablet_replica.cc:333] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.877457 19888 raft_consensus.cc:2243] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.878101 19888 raft_consensus.cc:2272] T 77e78d4839734d8d87724fa056914153 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.879983 19888 tablet_replica.cc:333] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.880504 19888 raft_consensus.cc:2243] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.880976 19888 raft_consensus.cc:2272] T f16c07bcae284f65a7c0ee0375e00769 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.883042 19888 tablet_replica.cc:333] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.883661 19888 raft_consensus.cc:2243] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.884114 19888 raft_consensus.cc:2272] T 2a1a8045038f4383ba6d1a13bfda6966 P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.885879 19888 tablet_replica.cc:333] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.886358 19888 raft_consensus.cc:2243] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.886791 19888 raft_consensus.cc:2272] T f5b9dc7576af431ea6e483cb2a8c04f7 P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.888551 19888 tablet_replica.cc:333] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.889020 19888 raft_consensus.cc:2243] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.889470 19888 raft_consensus.cc:2272] T 8fa56a6078064852ac53dd912136460b P a62242aa80cd4affa87dc4a3cf6b64ec [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.891353 19888 tablet_replica.cc:333] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.891935 19888 raft_consensus.cc:2243] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.893239 19888 raft_consensus.cc:2272] T f505123ebaba425fa2dadd415e464dfa P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.895550 19888 tablet_replica.cc:333] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.896204 19888 raft_consensus.cc:2243] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:19:27.896837 21149 consensus_peers.cc:597] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.897284 19888 raft_consensus.cc:2272] T fe28fa2b431c442da6a32fe2e3de3ffb P a62242aa80cd4affa87dc4a3cf6b64ec [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.899421 19888 tablet_replica.cc:333] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.900074 19888 raft_consensus.cc:2243] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.901034 19888 raft_consensus.cc:2272] T 81f567d6458f4dddaa94452e04485030 P a62242aa80cd4affa87dc4a3cf6b64ec [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.904415 19888 tablet_replica.cc:333] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.904960 19888 raft_consensus.cc:2243] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.905769 19888 raft_consensus.cc:2272] T 25ea03120f0340dab2b56ee8ae2b19f9 P a62242aa80cd4affa87dc4a3cf6b64ec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.907876 19888 tablet_replica.cc:333] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.908370 19888 raft_consensus.cc:2243] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.909173 19888 raft_consensus.cc:2272] T aaaf493e892d4ee9839b45b601fc8400 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.911391 19888 tablet_replica.cc:333] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.911837 19888 raft_consensus.cc:2243] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.912804 19888 raft_consensus.cc:2272] T fa441bc31c5043668f08c6e72305c329 P a62242aa80cd4affa87dc4a3cf6b64ec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.915252 19888 tablet_replica.cc:333] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.915904 19888 raft_consensus.cc:2243] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.917001 19888 raft_consensus.cc:2272] T 36a88ddff51a4bcea630447226c59041 P a62242aa80cd4affa87dc4a3cf6b64ec [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.917611 21149 consensus_peers.cc:597] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.919379 19888 tablet_replica.cc:333] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.920104 19888 raft_consensus.cc:2243] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.920635 19888 raft_consensus.cc:2272] T 03fd332fad7045099765ea2b69124fb6 P a62242aa80cd4affa87dc4a3cf6b64ec [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.921339 21149 consensus_peers.cc:597] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:27.921955 21149 consensus_peers.cc:597] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:27.922912 19888 tablet_replica.cc:333] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.923398 19888 raft_consensus.cc:2243] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.923882 19888 raft_consensus.cc:2272] T e77746cf06a844b28506688985401b7d P a62242aa80cd4affa87dc4a3cf6b64ec [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.926122 19888 tablet_replica.cc:333] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec: stopping tablet replica
I20260709 12:19:27.926687 19888 raft_consensus.cc:2243] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:27.927341 19888 raft_consensus.cc:2272] T 7c63a55bdad346dabf469f0ab75f7020 P a62242aa80cd4affa87dc4a3cf6b64ec [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:27.959472 21149 consensus_peers.cc:597] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:27.991462 21149 consensus_peers.cc:597] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:27.995978 21149 consensus_peers.cc:597] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:28.018054 21149 consensus_peers.cc:597] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:28.027870 21149 consensus_peers.cc:597] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:28.027877 21711 consensus_peers.cc:597] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.057735 21711 consensus_peers.cc:597] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.103019 21709 consensus_peers.cc:597] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:28.103530 21709 consensus_peers.cc:597] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:28.120092 20920 catalog_manager.cc:4755] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f505123ebaba425fa2dadd415e464dfa: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:28.120697 21709 consensus_peers.cc:597] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:28.135848 21149 consensus_peers.cc:597] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:28.189492 21709 consensus_peers.cc:597] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:28.196733 21711 consensus_peers.cc:597] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.278043 21711 consensus_peers.cc:597] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.447723 21711 consensus_peers.cc:597] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.464253 21711 consensus_peers.cc:597] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.467573 21711 consensus_peers.cc:597] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.557523 21711 consensus_peers.cc:597] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:28.628662 21151 consensus_peers.cc:597] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:28.633759 21151 consensus_peers.cc:597] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.664140 21711 consensus_peers.cc:597] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:28.716001 21711 consensus_peers.cc:597] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.764504 21151 consensus_peers.cc:597] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:28.770278 21151 consensus_peers.cc:597] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:28.781523 21711 consensus_peers.cc:597] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:28.795758 27390 raft_consensus.cc:493] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:28.796380 27390 raft_consensus.cc:515] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:19:28.798303 21151 consensus_peers.cc:597] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:28.798460 27390 leader_election.cc:290] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:28.803427 21149 leader_election.cc:336] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
W20260709 12:19:28.805270 21151 leader_election.cc:336] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:28.805682 21151 leader_election.cc:304] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:28.806399 27253 raft_consensus.cc:2749] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:28.832109 27390 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:28.832752 27390 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:28.835649 27390 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157)
I20260709 12:19:28.836383 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "694635cc4a20455fbbec925e0a84a1ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a1b891e53adc40a6a1ae813238321e93" is_pre_election: true
W20260709 12:19:28.842018 21149 leader_election.cc:336] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:28.842504 21149 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: a1b891e53adc40a6a1ae813238321e93, a62242aa80cd4affa87dc4a3cf6b64ec
W20260709 12:19:28.842764 21151 consensus_peers.cc:597] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:28.843317 27390 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:28.871304 19888 tablet_server.cc:196] TabletServer@127.19.108.2:0 shutdown complete.
I20260709 12:19:28.905285 27253 raft_consensus.cc:493] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:28.905885 27253 raft_consensus.cc:515] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:28.908125 27253 leader_election.cc:290] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:28.913589 21151 leader_election.cc:336] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:28.915411 21149 leader_election.cc:336] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:28.915933 21149 leader_election.cc:304] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:28.917755 27390 raft_consensus.cc:2749] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:28.920639 27309 raft_consensus.cc:493] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:28.921195 27309 raft_consensus.cc:515] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:19:28.929113 21711 leader_election.cc:336] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:28.929906 27253 raft_consensus.cc:493] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:28.930442 27253 raft_consensus.cc:515] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:28.932528 27253 leader_election.cc:290] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:28.935290 21709 leader_election.cc:336] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:28.935770 21709 leader_election.cc:304] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:28.936656 27259 raft_consensus.cc:2749] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:28.941880 21151 leader_election.cc:336] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:28.943549 27309 leader_election.cc:290] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:28.944774 27253 raft_consensus.cc:493] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:28.945379 27253 raft_consensus.cc:515] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:28.947504 27253 leader_election.cc:290] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:28.956889 21149 leader_election.cc:336] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:28.957343 21149 leader_election.cc:304] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:28.959492 27253 raft_consensus.cc:2749] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:28.960341 21151 leader_election.cc:336] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:28.960693 27309 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:28.961319 27309 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
W20260709 12:19:28.964911 21149 leader_election.cc:336] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:28.965446 21149 leader_election.cc:304] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:28.966223 27253 raft_consensus.cc:2749] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:28.969689 27309 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:28.971752 21184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a806d7d80a64c98ad9053bacc618d37" candidate_uuid: "a1b891e53adc40a6a1ae813238321e93" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "694635cc4a20455fbbec925e0a84a1ee" is_pre_election: true
I20260709 12:19:28.972462 21184 raft_consensus.cc:2468] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b891e53adc40a6a1ae813238321e93 in term 11.
I20260709 12:19:28.973863 21712 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee, a1b891e53adc40a6a1ae813238321e93; no voters: 
W20260709 12:19:28.975682 21709 leader_election.cc:336] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:28.975677 27259 raft_consensus.cc:2804] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:28.977161 27259 raft_consensus.cc:493] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:28.977566 27259 raft_consensus.cc:3060] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:28.993604 19888 tablet_server.cc:179] TabletServer@127.19.108.3:0 shutting down...
W20260709 12:19:29.001267 21712 consensus_peers.cc:597] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:29.003677 21712 consensus_peers.cc:597] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:29.006222 27259 raft_consensus.cc:515] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:29.011884 27253 raft_consensus.cc:493] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.012663 27253 raft_consensus.cc:515] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
W20260709 12:19:29.013269 21709 leader_election.cc:336] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
W20260709 12:19:29.013800 21712 leader_election.cc:336] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:29.014181 21712 leader_election.cc:304] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 694635cc4a20455fbbec925e0a84a1ee, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.014931 27309 raft_consensus.cc:2749] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:29.015692 27259 leader_election.cc:290] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 12 election: Requested vote from peers a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643), 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737)
I20260709 12:19:29.016183 27253 leader_election.cc:290] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:29.026557 21151 consensus_peers.cc:597] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:29.027081 21151 consensus_peers.cc:597] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:29.029846 21151 consensus_peers.cc:597] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:29.030264 21151 leader_election.cc:336] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:29.030653 21149 leader_election.cc:336] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:29.031112 21149 leader_election.cc:304] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.031769 27253 raft_consensus.cc:2749] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:29.033102 21712 consensus_peers.cc:597] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:29.049857 27253 raft_consensus.cc:493] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.050395 27253 raft_consensus.cc:515] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:29.055389 27253 leader_election.cc:290] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:29.058131 21151 leader_election.cc:336] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:29.063997 21149 leader_election.cc:336] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:29.064411 21149 leader_election.cc:304] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.065872 27253 raft_consensus.cc:2749] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:19:29.068195 21151 consensus_peers.cc:597] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:29.070765 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:29.071777 19888 tablet_replica.cc:333] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.072685 19888 raft_consensus.cc:2243] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.073421 19888 raft_consensus.cc:2272] T 0e4624827ee54eb0ba008c640f0ffb6b P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:29.075992 21151 consensus_peers.cc:597] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:29.076520 19888 tablet_replica.cc:333] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.077450 19888 raft_consensus.cc:2243] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.078506 19888 raft_consensus.cc:2272] T 2fb2ddbea74b45ee881e46a2349d3cc9 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.081115 19888 tablet_replica.cc:333] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.081887 19888 raft_consensus.cc:2243] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.082932 19888 raft_consensus.cc:2272] T 2dc46ba93c94432f85502db4f2496cfc P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.084539 27259 raft_consensus.cc:493] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.085062 27259 raft_consensus.cc:515] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:29.085623 19888 tablet_replica.cc:333] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.086546 19888 raft_consensus.cc:2243] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.087536 19888 raft_consensus.cc:2272] T 2747202c22c64b3cb3fb096f2f65e662 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.090232 19888 tablet_replica.cc:333] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.091142 19888 raft_consensus.cc:2243] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:29.091642 21711 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:29.091830 19888 raft_consensus.cc:2272] T b6491ed44ddd40e88e8100b87d9eac5e P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.094532 19888 tablet_replica.cc:333] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.094769 27259 leader_election.cc:290] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:29.095352 19888 raft_consensus.cc:2243] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:19:29.096261 21709 leader_election.cc:336] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:29.096395 19888 raft_consensus.cc:2272] T b55836eaff314a2ebc52f7e3a6801d96 P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.096685 21709 leader_election.cc:304] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.099112 19888 tablet_replica.cc:333] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.099251 27259 raft_consensus.cc:2749] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:29.099742 21151 consensus_peers.cc:597] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:29.100035 19888 raft_consensus.cc:2243] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.101977 19888 raft_consensus.cc:2272] T 79b5e6970bf54d93a119ce3444c25c6a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.102100 27253 raft_consensus.cc:493] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.102674 27253 raft_consensus.cc:515] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:29.104568 19888 tablet_replica.cc:333] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.104696 27253 leader_election.cc:290] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:29.105388 19888 raft_consensus.cc:2243] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.106563 19888 raft_consensus.cc:2272] T b90da36dbc3d409db5612d97106ad05a P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.109114 19888 tablet_replica.cc:333] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
W20260709 12:19:29.109176 21149 leader_election.cc:336] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:29.109979 19888 raft_consensus.cc:2243] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.110651 19888 raft_consensus.cc:2272] T 8c9e0f35d22542d19db11ce7085af404 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:29.110929 21151 leader_election.cc:336] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:29.111368 21151 leader_election.cc:304] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.112051 27253 raft_consensus.cc:2749] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:29.112911 19888 tablet_replica.cc:333] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.113484 19888 raft_consensus.cc:2243] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.114324 19888 raft_consensus.cc:2272] T b6f88dd1e21043668981ccdd8686a159 P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.114337 27390 raft_consensus.cc:493] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.114926 27390 raft_consensus.cc:515] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:29.117009 19888 tablet_replica.cc:333] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.117800 19888 raft_consensus.cc:2243] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.117861 27337 raft_consensus.cc:493] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.118382 27337 raft_consensus.cc:515] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:29.119001 19888 raft_consensus.cc:2272] T c68b72acae564588a3a276b7b233d977 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.120556 27337 leader_election.cc:290] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:29.121739 19888 tablet_replica.cc:333] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.122572 19888 raft_consensus.cc:2243] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.116950 27390 leader_election.cc:290] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
I20260709 12:19:29.123368 19888 raft_consensus.cc:2272] T 44d4361c1e5c40639a84f16f00228b6f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:29.123315 21712 consensus_peers.cc:597] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:29.126191 19888 tablet_replica.cc:333] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
W20260709 12:19:29.126754 21712 consensus_peers.cc:597] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:29.127009 19888 raft_consensus.cc:2243] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.127621 19888 raft_consensus.cc:2272] T cff4bd391fcd4a0e98a7359c8267ab60 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:29.129524 21149 leader_election.cc:336] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
W20260709 12:19:29.130033 21149 leader_election.cc:336] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:29.130210 19888 tablet_replica.cc:333] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.130995 19888 raft_consensus.cc:2243] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:29.131047 21151 leader_election.cc:336] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:29.131567 19888 raft_consensus.cc:2272] T 1f9fa6d1b68a474195f679c548dd3e4f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.131539 21151 leader_election.cc:304] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.132467 27390 raft_consensus.cc:2749] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:29.133337 21151 leader_election.cc:336] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:29.133708 21151 leader_election.cc:304] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.134354 27390 raft_consensus.cc:2749] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:29.134578 19888 tablet_replica.cc:333] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.135470 19888 raft_consensus.cc:2243] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.136746 19888 raft_consensus.cc:2272] T 4d5bea9516464fcf9fb8a2464ec2f1a8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:29.137427 21712 consensus_peers.cc:597] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:29.138242 27390 raft_consensus.cc:493] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.138728 27390 raft_consensus.cc:515] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:29.139357 19888 tablet_replica.cc:333] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.140185 19888 raft_consensus.cc:2243] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.140697 19888 raft_consensus.cc:2272] T 066b481f21914e9aa6feafafc76db125 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.140815 27390 leader_election.cc:290] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:29.143369 21712 consensus_peers.cc:597] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:29.143383 19888 tablet_replica.cc:333] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.144965 19888 raft_consensus.cc:2243] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.145591 19888 raft_consensus.cc:2272] T 2afb5fda50b04769b30c8dfc6a46563e P 694635cc4a20455fbbec925e0a84a1ee [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:29.146004 21149 leader_election.cc:336] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:29.143522 27259 raft_consensus.cc:493] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.148334 19888 tablet_replica.cc:333] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
W20260709 12:19:29.148802 21151 consensus_peers.cc:597] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:29.149288 19888 raft_consensus.cc:2243] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.150116 19888 raft_consensus.cc:2272] T b7f6c7d44dcf4a5787879c202071e5ba P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:29.150982 21151 leader_election.cc:336] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:29.151388 21151 leader_election.cc:304] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.148006 27259 raft_consensus.cc:515] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:29.152083 27390 raft_consensus.cc:2749] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:29.153461 19888 tablet_replica.cc:333] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.154345 19888 raft_consensus.cc:2243] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.155009 19888 raft_consensus.cc:2272] T 3a806d7d80a64c98ad9053bacc618d37 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.157666 19888 tablet_replica.cc:333] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
W20260709 12:19:29.157985 21711 leader_election.cc:336] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:29.158329 19888 raft_consensus.cc:2243] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.158913 19888 raft_consensus.cc:2272] T 0a4f0fe95c524d56a1d1a832a802a359 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.162509 19888 tablet_replica.cc:333] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.163295 19888 raft_consensus.cc:2243] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 22 LEADER]: Raft consensus shutting down.
W20260709 12:19:29.163870 21711 consensus_peers.cc:597] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:29.164382 19888 raft_consensus.cc:2272] T 861699cfca584c7b963879b6d12f2866 P 694635cc4a20455fbbec925e0a84a1ee [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.154206 27259 leader_election.cc:290] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:29.165481 21151 consensus_peers.cc:597] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee -> Peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Couldn't send request to peer 3ed9deaeb4014e9d87aeebbc6384f81f. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:29.167333 19888 tablet_replica.cc:333] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
W20260709 12:19:29.168300 21709 leader_election.cc:336] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:29.168915 19888 raft_consensus.cc:2243] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.169250 21709 leader_election.cc:304] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.169589 19888 raft_consensus.cc:2272] T be0e4a74d2d54b1e94234933e9f489c7 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.170403 27259 raft_consensus.cc:2749] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:29.171032 21712 consensus_peers.cc:597] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:29.172309 19888 tablet_replica.cc:333] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.163388 27390 raft_consensus.cc:493] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.173143 19888 raft_consensus.cc:2243] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.173380 27390 raft_consensus.cc:515] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "694635cc4a20455fbbec925e0a84a1ee" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 36737 } }
I20260709 12:19:29.174259 19888 raft_consensus.cc:2272] T 98a3a4bebb9546ba9e773da391cb42b6 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.176898 19888 tablet_replica.cc:333] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.177737 19888 raft_consensus.cc:2243] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.178972 19888 raft_consensus.cc:2272] T e6a8bfa2966c4510a71d4867b74a1a58 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:29.178987 20920 catalog_manager.cc:4755] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f505123ebaba425fa2dadd415e464dfa: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:29.177685 27390 leader_election.cc:290] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:29.181066 21151 leader_election.cc:336] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:29.181645 19888 tablet_replica.cc:333] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.182439 19888 raft_consensus.cc:2243] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.182951 19888 raft_consensus.cc:2272] T 9bc4c9f937ef4713ba45ba63b0602a7a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.185357 19888 tablet_replica.cc:333] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.186069 19888 raft_consensus.cc:2243] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.187433 19888 raft_consensus.cc:2272] T 747d6b1df3604e0ab07ec5ad8fa568cf P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.190110 19888 tablet_replica.cc:333] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.190825 19888 raft_consensus.cc:2243] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.192307 19888 raft_consensus.cc:2272] T 0ef296563f06493294dd3c3ee1d30263 P 694635cc4a20455fbbec925e0a84a1ee [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.194769 19888 tablet_replica.cc:333] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.196305 19888 raft_consensus.cc:2243] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:19:29.196507 21149 leader_election.cc:336] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
I20260709 12:19:29.196966 21149 leader_election.cc:304] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 694635cc4a20455fbbec925e0a84a1ee; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.197405 19888 raft_consensus.cc:2272] T 1acde8fc7a134a5e9e141721bf0a4791 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.198410 27390 raft_consensus.cc:2749] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:29.200021 21712 consensus_peers.cc:597] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:29.201324 19888 tablet_replica.cc:333] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.202142 19888 raft_consensus.cc:2243] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.202739 19888 raft_consensus.cc:2272] T 11c217b90c5a4022be2281765e591c5a P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.205111 19888 tablet_replica.cc:333] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.205721 19888 raft_consensus.cc:2243] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.206190 19888 raft_consensus.cc:2272] T 81531ae383b1419ea24efbb10c3d2949 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.207974 19888 tablet_replica.cc:333] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.208488 19888 raft_consensus.cc:2243] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.209264 19888 raft_consensus.cc:2272] T e3372843b9d8457e9e243e1b6e33141a P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.211140 19888 tablet_replica.cc:333] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.211685 19888 raft_consensus.cc:2243] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.212221 19888 raft_consensus.cc:2272] T 40fd334874764b26ba28ac382c4199f8 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.214092 19888 tablet_replica.cc:333] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.214588 19888 raft_consensus.cc:2243] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.215202 19888 raft_consensus.cc:2272] T e531721f3cd9498c9cc3b11699d5de8f P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.217361 19888 tablet_replica.cc:333] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.218024 19888 raft_consensus.cc:2243] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.218636 19888 raft_consensus.cc:2272] T b547f01ae7e54c0c870de561008eb7e0 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.221033 19888 tablet_replica.cc:333] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.221550 19888 raft_consensus.cc:2243] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.222170 19888 raft_consensus.cc:2272] T 0f86692ab0d642a990d934ba6bd6493f P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.224588 19888 tablet_replica.cc:333] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.225298 19888 raft_consensus.cc:2243] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.225891 19888 raft_consensus.cc:2272] T 002c722a71214448b1f4889cc8bb0c37 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.228255 19888 tablet_replica.cc:333] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.228724 19888 raft_consensus.cc:2243] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.229442 19888 raft_consensus.cc:2272] T f16c07bcae284f65a7c0ee0375e00769 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.231165 19888 tablet_replica.cc:333] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.231662 19888 raft_consensus.cc:2243] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.232385 19888 raft_consensus.cc:2272] T 2a1a8045038f4383ba6d1a13bfda6966 P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.234149 19888 tablet_replica.cc:333] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.234622 19888 raft_consensus.cc:2243] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.235411 19888 raft_consensus.cc:2272] T 7c63a55bdad346dabf469f0ab75f7020 P 694635cc4a20455fbbec925e0a84a1ee [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.237226 19888 tablet_replica.cc:333] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.237679 19888 raft_consensus.cc:2243] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.238413 19888 raft_consensus.cc:2272] T e77746cf06a844b28506688985401b7d P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.240463 19888 tablet_replica.cc:333] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.241140 19888 raft_consensus.cc:2243] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.241663 19888 raft_consensus.cc:2272] T 1407b8879f4c4fe6a95ea91c62d72196 P 694635cc4a20455fbbec925e0a84a1ee [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.243791 19888 tablet_replica.cc:333] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.244243 19888 raft_consensus.cc:2243] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.245042 19888 raft_consensus.cc:2272] T db9d39844048444b8a7293196d1349e9 P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.246768 19888 tablet_replica.cc:333] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.247309 19888 raft_consensus.cc:2243] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.248063 19888 raft_consensus.cc:2272] T 77e78d4839734d8d87724fa056914153 P 694635cc4a20455fbbec925e0a84a1ee [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.249789 19888 tablet_replica.cc:333] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.250274 19888 raft_consensus.cc:2243] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.251098 19888 raft_consensus.cc:2272] T f505123ebaba425fa2dadd415e464dfa P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.252777 19888 tablet_replica.cc:333] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.253239 19888 raft_consensus.cc:2243] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.253654 19888 raft_consensus.cc:2272] T fe28fa2b431c442da6a32fe2e3de3ffb P 694635cc4a20455fbbec925e0a84a1ee [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.255438 19888 tablet_replica.cc:333] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.255906 19888 raft_consensus.cc:2243] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.256445 19888 raft_consensus.cc:2272] T 81f567d6458f4dddaa94452e04485030 P 694635cc4a20455fbbec925e0a84a1ee [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.258036 19888 tablet_replica.cc:333] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.258496 19888 raft_consensus.cc:2243] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.258898 19888 raft_consensus.cc:2272] T 25ea03120f0340dab2b56ee8ae2b19f9 P 694635cc4a20455fbbec925e0a84a1ee [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.260592 19888 tablet_replica.cc:333] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.261061 19888 raft_consensus.cc:2243] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.261723 19888 raft_consensus.cc:2272] T aaaf493e892d4ee9839b45b601fc8400 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.263489 19888 tablet_replica.cc:333] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.263952 19888 raft_consensus.cc:2243] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.264338 19888 raft_consensus.cc:2272] T 8fa56a6078064852ac53dd912136460b P 694635cc4a20455fbbec925e0a84a1ee [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.266031 19888 tablet_replica.cc:333] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.266482 19888 raft_consensus.cc:2243] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.266924 19888 raft_consensus.cc:2272] T bc9e2a2fa444400287e8c1f7e71cbf5f P 694635cc4a20455fbbec925e0a84a1ee [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.268680 19888 tablet_replica.cc:333] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.269124 19888 raft_consensus.cc:2243] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:29.269568 19888 raft_consensus.cc:2272] T 2794b9a38ad54e088a7b3f884de8ef3d P 694635cc4a20455fbbec925e0a84a1ee [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.271410 19888 tablet_replica.cc:333] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee: stopping tablet replica
I20260709 12:19:29.271816 19888 raft_consensus.cc:2243] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:29.272574 19888 raft_consensus.cc:2272] T 03fd332fad7045099765ea2b69124fb6 P 694635cc4a20455fbbec925e0a84a1ee [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:29.285866 27259 raft_consensus.cc:493] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a62242aa80cd4affa87dc4a3cf6b64ec)
I20260709 12:19:29.286458 27259 raft_consensus.cc:515] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3ed9deaeb4014e9d87aeebbc6384f81f" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42723 } } peers { permanent_uuid: "a62242aa80cd4affa87dc4a3cf6b64ec" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 37643 } } peers { permanent_uuid: "a1b891e53adc40a6a1ae813238321e93" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 35157 } attrs { promote: false } }
I20260709 12:19:29.289489 27259 leader_election.cc:290] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723), a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643)
W20260709 12:19:29.296074 21709 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111)
W20260709 12:19:29.297554 21711 leader_election.cc:336] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
I20260709 12:19:29.297994 21711 leader_election.cc:304] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1b891e53adc40a6a1ae813238321e93; no voters: 3ed9deaeb4014e9d87aeebbc6384f81f, a62242aa80cd4affa87dc4a3cf6b64ec
I20260709 12:19:29.298723 27259 raft_consensus.cc:2749] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:19:29.316146 21712 consensus_peers.cc:597] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:29.341208 21712 consensus_peers.cc:597] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:29.417007 21712 consensus_peers.cc:597] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.3:36737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:29.428601 21712 consensus_peers.cc:597] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.3:36737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:29.588675 21712 consensus_peers.cc:597] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 -> Peer 694635cc4a20455fbbec925e0a84a1ee (127.19.108.3:36737): Couldn't send request to peer 694635cc4a20455fbbec925e0a84a1ee. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.3:36737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:29.955981 21709 consensus_peers.cc:597] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:30.036295 19888 tablet_server.cc:196] TabletServer@127.19.108.3:0 shutdown complete.
I20260709 12:19:30.139422 19888 tablet_server.cc:179] TabletServer@127.19.108.4:0 shutting down...
I20260709 12:19:30.183254 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:30.183914 19888 tablet_replica.cc:333] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.184587 19888 raft_consensus.cc:2243] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.185299 19888 raft_consensus.cc:2272] T f505123ebaba425fa2dadd415e464dfa P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.188165 19888 tablet_replica.cc:333] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.188974 19888 raft_consensus.cc:2243] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.189986 19888 raft_consensus.cc:2272] T 40fd334874764b26ba28ac382c4199f8 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:30.190241 21709 consensus_peers.cc:597] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 -> Peer a62242aa80cd4affa87dc4a3cf6b64ec (127.19.108.2:37643): Couldn't send request to peer a62242aa80cd4affa87dc4a3cf6b64ec. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:37643: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:30.192099 19888 tablet_replica.cc:333] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.192754 19888 raft_consensus.cc:2243] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.193512 19888 raft_consensus.cc:2272] T 0f86692ab0d642a990d934ba6bd6493f P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.195565 19888 tablet_replica.cc:333] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.196043 19888 raft_consensus.cc:2243] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.196504 19888 raft_consensus.cc:2272] T 861699cfca584c7b963879b6d12f2866 P a1b891e53adc40a6a1ae813238321e93 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.198271 19888 tablet_replica.cc:333] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.198997 19888 raft_consensus.cc:2243] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.199836 19888 raft_consensus.cc:2272] T be0e4a74d2d54b1e94234933e9f489c7 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.201793 19888 tablet_replica.cc:333] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.202396 19888 raft_consensus.cc:2243] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.202824 19888 raft_consensus.cc:2272] T fa441bc31c5043668f08c6e72305c329 P a1b891e53adc40a6a1ae813238321e93 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.204661 19888 tablet_replica.cc:333] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.205319 19888 raft_consensus.cc:2243] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.206221 19888 raft_consensus.cc:2272] T b6491ed44ddd40e88e8100b87d9eac5e P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.208503 19888 tablet_replica.cc:333] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.209175 19888 raft_consensus.cc:2243] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.210103 19888 raft_consensus.cc:2272] T bc9e2a2fa444400287e8c1f7e71cbf5f P a1b891e53adc40a6a1ae813238321e93 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.211934 19888 tablet_replica.cc:333] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.212450 19888 raft_consensus.cc:2243] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.213186 19888 raft_consensus.cc:2272] T 066b481f21914e9aa6feafafc76db125 P a1b891e53adc40a6a1ae813238321e93 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.215687 19888 tablet_replica.cc:333] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.216431 19888 raft_consensus.cc:2243] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.217056 19888 raft_consensus.cc:2272] T 3a806d7d80a64c98ad9053bacc618d37 P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.219942 19888 tablet_replica.cc:333] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.220690 19888 raft_consensus.cc:2243] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.221769 19888 raft_consensus.cc:2272] T 2afb5fda50b04769b30c8dfc6a46563e P a1b891e53adc40a6a1ae813238321e93 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.223938 19888 tablet_replica.cc:333] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.224426 19888 raft_consensus.cc:2243] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.225172 19888 raft_consensus.cc:2272] T 81531ae383b1419ea24efbb10c3d2949 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.227006 19888 tablet_replica.cc:333] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.227509 19888 raft_consensus.cc:2243] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.227972 19888 raft_consensus.cc:2272] T f16c07bcae284f65a7c0ee0375e00769 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.229732 19888 tablet_replica.cc:333] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.230212 19888 raft_consensus.cc:2243] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.231148 19888 raft_consensus.cc:2272] T aaaf493e892d4ee9839b45b601fc8400 P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.232982 19888 tablet_replica.cc:333] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.233486 19888 raft_consensus.cc:2243] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.234205 19888 raft_consensus.cc:2272] T f5b9dc7576af431ea6e483cb2a8c04f7 P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.236133 19888 tablet_replica.cc:333] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.236636 19888 raft_consensus.cc:2243] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.237356 19888 raft_consensus.cc:2272] T 8fa56a6078064852ac53dd912136460b P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.239183 19888 tablet_replica.cc:333] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.239673 19888 raft_consensus.cc:2243] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.240388 19888 raft_consensus.cc:2272] T cff4bd391fcd4a0e98a7359c8267ab60 P a1b891e53adc40a6a1ae813238321e93 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.242169 19888 tablet_replica.cc:333] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.242645 19888 raft_consensus.cc:2243] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.243407 19888 raft_consensus.cc:2272] T 2794b9a38ad54e088a7b3f884de8ef3d P a1b891e53adc40a6a1ae813238321e93 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.245275 19888 tablet_replica.cc:333] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.245761 19888 raft_consensus.cc:2243] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.246174 19888 raft_consensus.cc:2272] T a039020e2b434452bdc6cf055df7cc8a P a1b891e53adc40a6a1ae813238321e93 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.247921 19888 tablet_replica.cc:333] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.248433 19888 raft_consensus.cc:2243] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.248844 19888 raft_consensus.cc:2272] T 36a88ddff51a4bcea630447226c59041 P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.250705 19888 tablet_replica.cc:333] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.251233 19888 raft_consensus.cc:2243] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.252020 19888 raft_consensus.cc:2272] T 0e4624827ee54eb0ba008c640f0ffb6b P a1b891e53adc40a6a1ae813238321e93 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.253926 19888 tablet_replica.cc:333] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.254408 19888 raft_consensus.cc:2243] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.255185 19888 raft_consensus.cc:2272] T 11c217b90c5a4022be2281765e591c5a P a1b891e53adc40a6a1ae813238321e93 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.256999 19888 tablet_replica.cc:333] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.257481 19888 raft_consensus.cc:2243] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.258180 19888 raft_consensus.cc:2272] T f2065378b47e42a29f6e7eb69f39f47c P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.259956 19888 tablet_replica.cc:333] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.260409 19888 raft_consensus.cc:2243] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.260793 19888 raft_consensus.cc:2272] T 097c05b85fe14dc38775d8347e0478fe P a1b891e53adc40a6a1ae813238321e93 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.262624 19888 tablet_replica.cc:333] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.263103 19888 raft_consensus.cc:2243] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.263581 19888 raft_consensus.cc:2272] T 0ef296563f06493294dd3c3ee1d30263 P a1b891e53adc40a6a1ae813238321e93 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.265618 19888 tablet_replica.cc:333] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93: stopping tablet replica
I20260709 12:19:30.266013 19888 raft_consensus.cc:2243] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.266743 19888 raft_consensus.cc:2272] T 92c5682e4a6f4eb6a687f13065840f5f P a1b891e53adc40a6a1ae813238321e93 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.640232 19888 tablet_server.cc:196] TabletServer@127.19.108.4:0 shutdown complete.
I20260709 12:19:30.688342 19888 master.cc:562] Master@127.19.108.62:42247 shutting down...
W20260709 12:19:30.724629 20982 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:19:30.724888 20982 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:19:30.725095 20982 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:19:31.244932 20920 catalog_manager.cc:4755] TS 3ed9deaeb4014e9d87aeebbc6384f81f (127.19.108.1:42723): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f505123ebaba425fa2dadd415e464dfa: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42723: connect: Connection refused (error 111)
W20260709 12:19:37.830826 20919 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.108.4:35157: connect: Connection refused (error 111) [suppressed 355 similar messages]
W20260709 12:19:37.834111 20919 catalog_manager.cc:4755] TS a1b891e53adc40a6a1ae813238321e93 (127.19.108.4:35157): ChangeConfig:REMOVE_PEER RPC failed for tablet aaaf493e892d4ee9839b45b601fc8400: Network error: Client connection negotiation failed: client connection to 127.19.108.4:35157: connect: Connection refused (error 111)
I20260709 12:19:39.453377 19888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:39.454545 19888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:39.454986 19888 tablet_replica.cc:333] T 00000000000000000000000000000000 P d43fece763204ac08240a85f3921173b: stopping tablet replica
I20260709 12:19:39.649191 19888 master.cc:584] Master@127.19.108.62:42247 shutdown complete.
I20260709 12:19:39.696362 19888 test_util.cc:182] -----------------------------------------------
I20260709 12:19:39.696573 19888 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599318085381-19888-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (202447 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:19:39.699898 19888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.108.62:44381
I20260709 12:19:39.700981 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:39.706368 27400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:39.706499 27401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:39.706897 27403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:39.708566 19888 server_base.cc:1061] running on GCE node
I20260709 12:19:39.711156 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:39.711335 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:39.711447 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599579711437 us; error 0 us; skew 500 ppm
I20260709 12:19:39.711885 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:39.714088 19888 webserver.cc:533] Webserver started at http://127.19.108.62:41941/ using document root <none> and password file <none>
I20260709 12:19:39.714510 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:39.714658 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:39.714900 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:39.716094 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/master-0-root/instance:
uuid: "38da4d668a3a4017bdd3303e8d76fcf9"
format_stamp: "Formatted at 2026-07-09 12:19:39 on dist-test-slave-0g1j"
I20260709 12:19:39.720345 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:39.723587 27408 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:39.724272 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:39.724547 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/master-0-root
uuid: "38da4d668a3a4017bdd3303e8d76fcf9"
format_stamp: "Formatted at 2026-07-09 12:19:39 on dist-test-slave-0g1j"
I20260709 12:19:39.724810 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:39.742772 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:39.744004 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:39.780467 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.62:44381
I20260709 12:19:39.780575 27459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.62:44381 every 8 connection(s)
I20260709 12:19:39.784564 27460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.795519 27460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9: Bootstrap starting.
I20260709 12:19:39.800251 27460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.804183 27460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9: No bootstrap required, opened a new log
I20260709 12:19:39.806277 27460 raft_consensus.cc:359] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38da4d668a3a4017bdd3303e8d76fcf9" member_type: VOTER }
I20260709 12:19:39.806692 27460 raft_consensus.cc:385] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.806900 27460 raft_consensus.cc:740] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38da4d668a3a4017bdd3303e8d76fcf9, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.807480 27460 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38da4d668a3a4017bdd3303e8d76fcf9" member_type: VOTER }
I20260709 12:19:39.807937 27460 raft_consensus.cc:399] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:39.808166 27460 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:39.808411 27460 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:39.812803 27460 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38da4d668a3a4017bdd3303e8d76fcf9" member_type: VOTER }
I20260709 12:19:39.813282 27460 leader_election.cc:304] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38da4d668a3a4017bdd3303e8d76fcf9; no voters: 
I20260709 12:19:39.814340 27460 leader_election.cc:290] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:39.814625 27463 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:39.815943 27463 raft_consensus.cc:697] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 1 LEADER]: Becoming Leader. State: Replica: 38da4d668a3a4017bdd3303e8d76fcf9, State: Running, Role: LEADER
I20260709 12:19:39.816625 27463 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38da4d668a3a4017bdd3303e8d76fcf9" member_type: VOTER }
I20260709 12:19:39.817102 27460 sys_catalog.cc:565] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:39.822504 27464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38da4d668a3a4017bdd3303e8d76fcf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38da4d668a3a4017bdd3303e8d76fcf9" member_type: VOTER } }
I20260709 12:19:39.822712 27465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38da4d668a3a4017bdd3303e8d76fcf9. Latest consensus state: current_term: 1 leader_uuid: "38da4d668a3a4017bdd3303e8d76fcf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38da4d668a3a4017bdd3303e8d76fcf9" member_type: VOTER } }
I20260709 12:19:39.823175 27464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:39.823343 27465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:39.825138 27470 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:39.830122 27470 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:39.832937 19888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:39.838757 27470 catalog_manager.cc:1383] Generated new cluster ID: 721e88c24fac4cb0a80595496ab70e68
I20260709 12:19:39.839042 27470 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:39.864229 27470 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:39.865536 27470 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:39.879868 27470 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9: Generated new TSK 0
I20260709 12:19:39.880441 27470 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:39.899765 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:39.905586 27481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:39.906689 27482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:39.907761 27484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:39.908773 19888 server_base.cc:1061] running on GCE node
I20260709 12:19:39.910804 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:39.911034 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:39.911201 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599579911182 us; error 0 us; skew 500 ppm
I20260709 12:19:39.911761 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:39.913861 19888 webserver.cc:533] Webserver started at http://127.19.108.1:40227/ using document root <none> and password file <none>
I20260709 12:19:39.914335 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:39.914516 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:39.914789 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:39.915967 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/instance:
uuid: "de15618bc48545b6986320ca2292fc60"
format_stamp: "Formatted at 2026-07-09 12:19:39 on dist-test-slave-0g1j"
I20260709 12:19:39.920444 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:19:39.923624 27489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:39.924365 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:39.924635 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "de15618bc48545b6986320ca2292fc60"
format_stamp: "Formatted at 2026-07-09 12:19:39 on dist-test-slave-0g1j"
I20260709 12:19:39.924885 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:39.942555 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:39.943760 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:39.945187 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:39.947443 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:39.947639 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:39.947850 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:39.948011 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:39.987478 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:34993
I20260709 12:19:39.987579 27551 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:34993 every 8 connection(s)
I20260709 12:19:39.992421 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:39.999189 27556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:40.001178 27557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:40.002739 27559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:40.003481 19888 server_base.cc:1061] running on GCE node
I20260709 12:19:40.005812 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:40.006075 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:40.006270 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599580006251 us; error 0 us; skew 500 ppm
I20260709 12:19:40.006999 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:40.007941 27552 heartbeater.cc:344] Connected to a master server at 127.19.108.62:44381
I20260709 12:19:40.008353 27552 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:40.009277 27552 heartbeater.cc:507] Master 127.19.108.62:44381 requested a full tablet report, sending...
I20260709 12:19:40.009603 19888 webserver.cc:533] Webserver started at http://127.19.108.2:39991/ using document root <none> and password file <none>
I20260709 12:19:40.010226 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:40.010416 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:40.010684 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:40.011555 27425 ts_manager.cc:194] Registered new tserver with Master: de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:40.011917 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/instance:
uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
format_stamp: "Formatted at 2026-07-09 12:19:40 on dist-test-slave-0g1j"
I20260709 12:19:40.013269 27425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60966
I20260709 12:19:40.016996 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:19:40.021667 27564 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:40.022925 19888 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:19:40.023270 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-1-root
uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
format_stamp: "Formatted at 2026-07-09 12:19:40 on dist-test-slave-0g1j"
I20260709 12:19:40.023659 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:40.042439 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:40.043653 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:40.045035 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:40.047187 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:40.047376 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:40.047590 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:40.047742 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:40.086527 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.2:38235
I20260709 12:19:40.086625 27626 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.2:38235 every 8 connection(s)
I20260709 12:19:40.091321 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:40.097755 27630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:40.098419 27631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:40.101042 27633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:40.101956 19888 server_base.cc:1061] running on GCE node
I20260709 12:19:40.102964 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:40.103261 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:40.103502 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599580103481 us; error 0 us; skew 500 ppm
I20260709 12:19:40.104055 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:40.104580 27627 heartbeater.cc:344] Connected to a master server at 127.19.108.62:44381
I20260709 12:19:40.104899 27627 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:40.105660 27627 heartbeater.cc:507] Master 127.19.108.62:44381 requested a full tablet report, sending...
I20260709 12:19:40.106715 19888 webserver.cc:533] Webserver started at http://127.19.108.3:33983/ using document root <none> and password file <none>
I20260709 12:19:40.107255 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:40.107439 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:40.107501 27425 ts_manager.cc:194] Registered new tserver with Master: aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:40.107697 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:40.108880 27425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60980
I20260709 12:19:40.109015 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/instance:
uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
format_stamp: "Formatted at 2026-07-09 12:19:40 on dist-test-slave-0g1j"
I20260709 12:19:40.113512 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:19:40.117285 27638 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:40.117980 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:40.118265 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-2-root
uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
format_stamp: "Formatted at 2026-07-09 12:19:40 on dist-test-slave-0g1j"
I20260709 12:19:40.118597 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:40.154809 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:40.156051 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:40.157497 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:40.159662 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:40.159855 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:40.160084 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:40.160238 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:40.199189 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.3:45493
I20260709 12:19:40.199276 27700 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.3:45493 every 8 connection(s)
I20260709 12:19:40.203895 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:40.211738 27704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:40.213199 27705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:40.215195 19888 server_base.cc:1061] running on GCE node
W20260709 12:19:40.216068 27707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:40.216297 27701 heartbeater.cc:344] Connected to a master server at 127.19.108.62:44381
I20260709 12:19:40.216763 27701 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:40.217187 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:40.217471 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:40.217681 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599580217663 us; error 0 us; skew 500 ppm
I20260709 12:19:40.217756 27701 heartbeater.cc:507] Master 127.19.108.62:44381 requested a full tablet report, sending...
I20260709 12:19:40.218546 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:40.220079 27425 ts_manager.cc:194] Registered new tserver with Master: 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:40.221321 19888 webserver.cc:533] Webserver started at http://127.19.108.4:43667/ using document root <none> and password file <none>
I20260709 12:19:40.221866 27425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60982
I20260709 12:19:40.221982 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:40.222375 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:40.222733 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:40.224248 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-3-root/instance:
uuid: "be117ea016214236abda478b04f7f70c"
format_stamp: "Formatted at 2026-07-09 12:19:40 on dist-test-slave-0g1j"
I20260709 12:19:40.228893 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:40.231927 27712 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:40.232613 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:40.232859 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-3-root
uuid: "be117ea016214236abda478b04f7f70c"
format_stamp: "Formatted at 2026-07-09 12:19:40 on dist-test-slave-0g1j"
I20260709 12:19:40.233088 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:40.244634 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:40.245793 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:40.247125 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:40.249533 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:40.249716 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:40.249943 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:40.250092 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:40.288543 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.4:38323
I20260709 12:19:40.288653 27774 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.4:38323 every 8 connection(s)
I20260709 12:19:40.301709 27775 heartbeater.cc:344] Connected to a master server at 127.19.108.62:44381
I20260709 12:19:40.302099 27775 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:40.302799 27775 heartbeater.cc:507] Master 127.19.108.62:44381 requested a full tablet report, sending...
I20260709 12:19:40.304632 27425 ts_manager.cc:194] Registered new tserver with Master: be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:40.305025 19888 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01336572s
I20260709 12:19:40.305948 27425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60984
I20260709 12:19:40.330250 27425 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60992:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:19:40.561229 27666 tablet_service.cc:1511] Processing CreateTablet for tablet 41b03c9e97db4f44883288bc9389dfe6 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:40.561780 27665 tablet_service.cc:1511] Processing CreateTablet for tablet d53924e99bd64e01be6cf5fbd86a0abc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:40.562062 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 25217e2e64ee4c46a3c6fe52f264eb73 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:40.563009 27666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b03c9e97db4f44883288bc9389dfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.563709 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25217e2e64ee4c46a3c6fe52f264eb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.564669 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53924e99bd64e01be6cf5fbd86a0abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.565593 27740 tablet_service.cc:1511] Processing CreateTablet for tablet 41b03c9e97db4f44883288bc9389dfe6 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:40.566963 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b03c9e97db4f44883288bc9389dfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.567343 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 314f0bf0cb9746fbac4d45766dcb3dcb (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:40.568645 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314f0bf0cb9746fbac4d45766dcb3dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.565586 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 25217e2e64ee4c46a3c6fe52f264eb73 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:40.571873 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25217e2e64ee4c46a3c6fe52f264eb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.575709 27517 tablet_service.cc:1511] Processing CreateTablet for tablet 41b03c9e97db4f44883288bc9389dfe6 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:40.577066 27517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b03c9e97db4f44883288bc9389dfe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.580508 27516 tablet_service.cc:1511] Processing CreateTablet for tablet d53924e99bd64e01be6cf5fbd86a0abc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:40.581809 27516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53924e99bd64e01be6cf5fbd86a0abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.585098 27663 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcdc60f1f704ccbae94b68301d5d7c7 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:40.586397 27663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcdc60f1f704ccbae94b68301d5d7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.588523 27515 tablet_service.cc:1511] Processing CreateTablet for tablet 314f0bf0cb9746fbac4d45766dcb3dcb (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:40.589883 27515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314f0bf0cb9746fbac4d45766dcb3dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.593861 27737 tablet_service.cc:1511] Processing CreateTablet for tablet cab21d2c166f4303beb2fa0bbc3868cc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:40.595182 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab21d2c166f4303beb2fa0bbc3868cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.596652 27514 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcdc60f1f704ccbae94b68301d5d7c7 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:40.597975 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcdc60f1f704ccbae94b68301d5d7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.604074 27591 tablet_service.cc:1511] Processing CreateTablet for tablet 314f0bf0cb9746fbac4d45766dcb3dcb (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:40.605451 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314f0bf0cb9746fbac4d45766dcb3dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.607995 27589 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcdc60f1f704ccbae94b68301d5d7c7 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:40.609338 27589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcdc60f1f704ccbae94b68301d5d7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.611629 27662 tablet_service.cc:1511] Processing CreateTablet for tablet 3edaed12566a4bdf9cbff46d06ef8f1e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:40.612884 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edaed12566a4bdf9cbff46d06ef8f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.616004 27588 tablet_service.cc:1511] Processing CreateTablet for tablet cab21d2c166f4303beb2fa0bbc3868cc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:40.617429 27588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab21d2c166f4303beb2fa0bbc3868cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.619369 27590 tablet_service.cc:1511] Processing CreateTablet for tablet 25217e2e64ee4c46a3c6fe52f264eb73 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:40.620693 27590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25217e2e64ee4c46a3c6fe52f264eb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.621469 27736 tablet_service.cc:1511] Processing CreateTablet for tablet 3edaed12566a4bdf9cbff46d06ef8f1e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:40.622756 27736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edaed12566a4bdf9cbff46d06ef8f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.628376 27512 tablet_service.cc:1511] Processing CreateTablet for tablet 3edaed12566a4bdf9cbff46d06ef8f1e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:40.629770 27512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edaed12566a4bdf9cbff46d06ef8f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.632094 27587 tablet_service.cc:1511] Processing CreateTablet for tablet 459c85488af34f9ca4d2f9dfc4946c38 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:40.633436 27587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459c85488af34f9ca4d2f9dfc4946c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.635432 27513 tablet_service.cc:1511] Processing CreateTablet for tablet cab21d2c166f4303beb2fa0bbc3868cc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:40.636788 27513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab21d2c166f4303beb2fa0bbc3868cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.644986 27666 tablet_service.cc:1511] Processing CreateTablet for tablet 459c85488af34f9ca4d2f9dfc4946c38 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:40.646313 27666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459c85488af34f9ca4d2f9dfc4946c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.646026 27735 tablet_service.cc:1511] Processing CreateTablet for tablet 459c85488af34f9ca4d2f9dfc4946c38 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:40.647334 27735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459c85488af34f9ca4d2f9dfc4946c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.651116 27586 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4c36c14e1343f2a56f2fd93787f29b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:40.652554 27586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4c36c14e1343f2a56f2fd93787f29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.651012 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4c36c14e1343f2a56f2fd93787f29b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:40.656123 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4c36c14e1343f2a56f2fd93787f29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.622079 27592 tablet_service.cc:1511] Processing CreateTablet for tablet d53924e99bd64e01be6cf5fbd86a0abc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:40.661608 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53924e99bd64e01be6cf5fbd86a0abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.671674 27792 tablet_bootstrap.cc:492] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:40.685652 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 3bba2f26eea142268f411f8f91197880 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:40.687059 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bba2f26eea142268f411f8f91197880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.687260 27510 tablet_service.cc:1511] Processing CreateTablet for tablet 3bba2f26eea142268f411f8f91197880 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:40.688122 27585 tablet_service.cc:1511] Processing CreateTablet for tablet 3bba2f26eea142268f411f8f91197880 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:40.688655 27510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bba2f26eea142268f411f8f91197880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.689447 27585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bba2f26eea142268f411f8f91197880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.697906 27663 tablet_service.cc:1511] Processing CreateTablet for tablet f041e7df1d5b483ca8adc01300cbf2ab (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:40.699290 27663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f041e7df1d5b483ca8adc01300cbf2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.703809 27737 tablet_service.cc:1511] Processing CreateTablet for tablet f041e7df1d5b483ca8adc01300cbf2ab (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:40.718670 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f041e7df1d5b483ca8adc01300cbf2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.724424 27584 tablet_service.cc:1511] Processing CreateTablet for tablet 27eb2f13d7e642e9b623762ab04241c0 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:40.725757 27584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27eb2f13d7e642e9b623762ab04241c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.727888 27508 tablet_service.cc:1511] Processing CreateTablet for tablet 304ee4c1b5cd4dcf992f38355c86bb62 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:40.729283 27508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304ee4c1b5cd4dcf992f38355c86bb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.729888 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 27eb2f13d7e642e9b623762ab04241c0 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:40.731123 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27eb2f13d7e642e9b623762ab04241c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.703806 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4c36c14e1343f2a56f2fd93787f29b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:40.738704 27509 tablet_service.cc:1511] Processing CreateTablet for tablet f041e7df1d5b483ca8adc01300cbf2ab (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:40.739475 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4c36c14e1343f2a56f2fd93787f29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.740069 27509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f041e7df1d5b483ca8adc01300cbf2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.739254 27792 tablet_bootstrap.cc:654] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.753551 27795 tablet_bootstrap.cc:492] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:40.759675 27662 tablet_service.cc:1511] Processing CreateTablet for tablet 27eb2f13d7e642e9b623762ab04241c0 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:40.760942 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27eb2f13d7e642e9b623762ab04241c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.763315 27794 tablet_bootstrap.cc:492] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:40.766503 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 304ee4c1b5cd4dcf992f38355c86bb62 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:40.767760 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304ee4c1b5cd4dcf992f38355c86bb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.775894 27589 tablet_service.cc:1511] Processing CreateTablet for tablet 304ee4c1b5cd4dcf992f38355c86bb62 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:40.777331 27589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304ee4c1b5cd4dcf992f38355c86bb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.786103 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 8153e71c9ead48ec81fc9271d7844e53 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:40.791635 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8153e71c9ead48ec81fc9271d7844e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.812045 27795 tablet_bootstrap.cc:654] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.811829 27512 tablet_service.cc:1511] Processing CreateTablet for tablet 8153e71c9ead48ec81fc9271d7844e53 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:40.813115 27512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8153e71c9ead48ec81fc9271d7844e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.816265 27794 tablet_bootstrap.cc:654] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.819299 27591 tablet_service.cc:1511] Processing CreateTablet for tablet 8153e71c9ead48ec81fc9271d7844e53 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:40.827739 27793 tablet_bootstrap.cc:492] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:40.829272 27473 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:40.835362 27792 tablet_bootstrap.cc:492] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:40.835948 27792 ts_tablet_manager.cc:1403] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.165s	user 0.021s	sys 0.034s
I20260709 12:19:40.839121 27792 raft_consensus.cc:359] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:40.839920 27792 raft_consensus.cc:385] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.843334 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 6c35d6286faf45d4af1a9dfcd42a2819 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:40.844696 27737 tablet_service.cc:1511] Processing CreateTablet for tablet 6c35d6286faf45d4af1a9dfcd42a2819 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:40.847028 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c35d6286faf45d4af1a9dfcd42a2819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.847215 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c35d6286faf45d4af1a9dfcd42a2819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.852746 27793 tablet_bootstrap.cc:654] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.845256 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8153e71c9ead48ec81fc9271d7844e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.857741 27795 tablet_bootstrap.cc:492] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:40.858245 27795 ts_tablet_manager.cc:1403] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.012s
I20260709 12:19:40.860286 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 6c35d6286faf45d4af1a9dfcd42a2819 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:40.861346 27592 tablet_service.cc:1511] Processing CreateTablet for tablet 8567b5a62d02414f90f1c2141914a76b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:40.861821 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c35d6286faf45d4af1a9dfcd42a2819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.846167 27792 raft_consensus.cc:740] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.861253 27795 raft_consensus.cc:359] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:40.862855 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8567b5a62d02414f90f1c2141914a76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.862833 27795 raft_consensus.cc:385] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.863730 27795 raft_consensus.cc:740] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.864461 27795 consensus_queue.cc:260] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:40.862990 27792 consensus_queue.cc:260] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:40.870030 27794 tablet_bootstrap.cc:492] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:40.870563 27794 ts_tablet_manager.cc:1403] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.004s
I20260709 12:19:40.871747 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 8567b5a62d02414f90f1c2141914a76b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:40.873080 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8567b5a62d02414f90f1c2141914a76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.873555 27794 raft_consensus.cc:359] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:40.874272 27794 raft_consensus.cc:385] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.874547 27794 raft_consensus.cc:740] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.877051 27589 tablet_service.cc:1511] Processing CreateTablet for tablet b3a11bd7b16c4cf7bbfcecc5fa6170e7 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:40.878252 27589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a11bd7b16c4cf7bbfcecc5fa6170e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.885155 27794 consensus_queue.cc:260] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:40.900036 27513 tablet_service.cc:1511] Processing CreateTablet for tablet bae19825ecd9430ebb84254135a9b43d (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:40.901372 27513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae19825ecd9430ebb84254135a9b43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.904774 27738 tablet_service.cc:1511] Processing CreateTablet for tablet bae19825ecd9430ebb84254135a9b43d (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:40.906134 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae19825ecd9430ebb84254135a9b43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.888585 27665 tablet_service.cc:1511] Processing CreateTablet for tablet b3a11bd7b16c4cf7bbfcecc5fa6170e7 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:40.911957 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a11bd7b16c4cf7bbfcecc5fa6170e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.914103 27587 tablet_service.cc:1511] Processing CreateTablet for tablet bae19825ecd9430ebb84254135a9b43d (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:40.915969 27587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae19825ecd9430ebb84254135a9b43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.915706 27512 tablet_service.cc:1511] Processing CreateTablet for tablet b3a11bd7b16c4cf7bbfcecc5fa6170e7 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:40.917110 27512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a11bd7b16c4cf7bbfcecc5fa6170e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.894627 27701 heartbeater.cc:499] Master 127.19.108.62:44381 was elected leader, sending a full tablet report...
I20260709 12:19:40.927066 27662 tablet_service.cc:1511] Processing CreateTablet for tablet 8567b5a62d02414f90f1c2141914a76b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:40.928489 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8567b5a62d02414f90f1c2141914a76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.928794 27735 tablet_service.cc:1511] Processing CreateTablet for tablet ced5637a8c774be3bf649a62de77ab2c (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:40.930091 27735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced5637a8c774be3bf649a62de77ab2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.935863 27666 tablet_service.cc:1511] Processing CreateTablet for tablet ced5637a8c774be3bf649a62de77ab2c (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:40.937048 27666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced5637a8c774be3bf649a62de77ab2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.941586 27801 raft_consensus.cc:493] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.941783 27795 ts_tablet_manager.cc:1434] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.083s	user 0.030s	sys 0.017s
I20260709 12:19:40.942606 27627 heartbeater.cc:499] Master 127.19.108.62:44381 was elected leader, sending a full tablet report...
I20260709 12:19:40.942410 27514 tablet_service.cc:1511] Processing CreateTablet for tablet ced5637a8c774be3bf649a62de77ab2c (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:40.942917 27795 tablet_bootstrap.cc:492] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:40.943676 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced5637a8c774be3bf649a62de77ab2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.942209 27801 raft_consensus.cc:515] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:40.949224 27795 tablet_bootstrap.cc:654] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.954378 27591 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc249d99a354b2ba8dfb84856dbbb01 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:40.955627 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc249d99a354b2ba8dfb84856dbbb01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.960983 27775 heartbeater.cc:499] Master 127.19.108.62:44381 was elected leader, sending a full tablet report...
W20260709 12:19:40.962703 27702 tablet.cc:2406] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:40.964409 27792 ts_tablet_manager.cc:1434] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.128s	user 0.013s	sys 0.001s
I20260709 12:19:40.965878 27792 tablet_bootstrap.cc:492] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:40.968082 27793 tablet_bootstrap.cc:492] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:40.964828 27794 ts_tablet_manager.cc:1434] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.094s	user 0.024s	sys 0.023s
I20260709 12:19:40.968572 27793 ts_tablet_manager.cc:1403] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.027s
I20260709 12:19:40.969307 27794 tablet_bootstrap.cc:492] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:40.977106 27794 tablet_bootstrap.cc:654] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.978693 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b03c9e97db4f44883288bc9389dfe6" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:40.983783 27714 leader_election.cc:343] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.982183 27792 tablet_bootstrap.cc:654] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.989151 27801 leader_election.cc:290] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:40.994408 27793 raft_consensus.cc:359] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:40.995060 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc249d99a354b2ba8dfb84856dbbb01 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:40.996295 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc249d99a354b2ba8dfb84856dbbb01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.995041 27793 raft_consensus.cc:385] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.001863 27793 raft_consensus.cc:740] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.002777 27793 consensus_queue.cc:260] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.007596 27800 raft_consensus.cc:493] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.008096 27800 raft_consensus.cc:515] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.011750 27800 leader_election.cc:290] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:41.017547 27552 heartbeater.cc:499] Master 127.19.108.62:44381 was elected leader, sending a full tablet report...
I20260709 12:19:41.030825 27737 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc249d99a354b2ba8dfb84856dbbb01 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:41.031821 27795 tablet_bootstrap.cc:492] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:41.032133 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc249d99a354b2ba8dfb84856dbbb01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.032431 27795 ts_tablet_manager.cc:1403] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.001s
I20260709 12:19:41.035882 27795 raft_consensus.cc:359] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:41.036713 27795 raft_consensus.cc:385] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.037086 27795 raft_consensus.cc:740] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.047401 27794 tablet_bootstrap.cc:492] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:41.047991 27794 ts_tablet_manager.cc:1403] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.000s
I20260709 12:19:41.052459 27795 consensus_queue.cc:260] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:41.058821 27795 ts_tablet_manager.cc:1434] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:19:41.059860 27795 tablet_bootstrap.cc:492] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:41.059491 27592 tablet_service.cc:1511] Processing CreateTablet for tablet 2259e0eb900541c7b9d47a4406bce163 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:41.060920 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2259e0eb900541c7b9d47a4406bce163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.064443 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 2259e0eb900541c7b9d47a4406bce163 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:41.065691 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2259e0eb900541c7b9d47a4406bce163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.069195 27794 raft_consensus.cc:359] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:41.069964 27794 raft_consensus.cc:385] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.070261 27794 raft_consensus.cc:740] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.076649 27795 tablet_bootstrap.cc:654] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.079507 27793 ts_tablet_manager.cc:1434] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.005s
I20260709 12:19:41.080677 27793 tablet_bootstrap.cc:492] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:41.084579 27792 tablet_bootstrap.cc:492] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:41.085119 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b03c9e97db4f44883288bc9389dfe6" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:41.085862 27527 raft_consensus.cc:2468] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:41.087432 27716 leader_election.cc:304] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:41.088346 27801 raft_consensus.cc:2804] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:41.088699 27801 raft_consensus.cc:493] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.089022 27801 raft_consensus.cc:3060] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:41.085162 27792 ts_tablet_manager.cc:1403] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.005s
I20260709 12:19:41.098304 27794 consensus_queue.cc:260] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:41.107693 27794 ts_tablet_manager.cc:1434] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 12:19:41.108419 27801 raft_consensus.cc:515] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.110472 27801 leader_election.cc:290] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:41.111459 27587 tablet_service.cc:1511] Processing CreateTablet for tablet 43107870acfc4582affbc438751f8144 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:41.112857 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b03c9e97db4f44883288bc9389dfe6" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:41.113476 27527 raft_consensus.cc:3060] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:41.116649 27514 tablet_service.cc:1511] Processing CreateTablet for tablet 43107870acfc4582affbc438751f8144 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:41.119767 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b03c9e97db4f44883288bc9389dfe6" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
W20260709 12:19:41.124498 27714 leader_election.cc:343] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.120237 27587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43107870acfc4582affbc438751f8144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.108817 27794 tablet_bootstrap.cc:492] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:41.125247 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad5954225334151b3f3a9827fc27342 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:41.126506 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad5954225334151b3f3a9827fc27342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.124393 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad5954225334151b3f3a9827fc27342 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:41.127599 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad5954225334151b3f3a9827fc27342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.128733 27802 raft_consensus.cc:493] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.129285 27802 raft_consensus.cc:515] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.109725 27662 tablet_service.cc:1511] Processing CreateTablet for tablet 2259e0eb900541c7b9d47a4406bce163 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:41.130645 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2259e0eb900541c7b9d47a4406bce163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.131816 27802 leader_election.cc:290] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:41.133878 27735 tablet_service.cc:1511] Processing CreateTablet for tablet 43107870acfc4582affbc438751f8144 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:41.135130 27735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43107870acfc4582affbc438751f8144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.129068 27792 raft_consensus.cc:359] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.138383 27792 raft_consensus.cc:385] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.138680 27792 raft_consensus.cc:740] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.118767 27793 tablet_bootstrap.cc:654] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.140218 27792 consensus_queue.cc:260] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.141207 27795 tablet_bootstrap.cc:492] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:41.141745 27795 ts_tablet_manager.cc:1403] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.006s
I20260709 12:19:41.142092 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43107870acfc4582affbc438751f8144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.144953 27527 raft_consensus.cc:2468] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:41.145478 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad5954225334151b3f3a9827fc27342 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:41.146178 27716 leader_election.cc:304] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:41.146991 27801 raft_consensus.cc:2804] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:41.147647 27801 raft_consensus.cc:697] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:41.148123 27592 tablet_service.cc:1511] Processing CreateTablet for tablet 72e820d15af94d0d8c63cd76f44ee8ec (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:41.148483 27801 consensus_queue.cc:237] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.149340 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e820d15af94d0d8c63cd76f44ee8ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.146668 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad5954225334151b3f3a9827fc27342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.154172 27666 tablet_service.cc:1511] Processing CreateTablet for tablet 72e820d15af94d0d8c63cd76f44ee8ec (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:41.155391 27666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e820d15af94d0d8c63cd76f44ee8ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.155941 27795 raft_consensus.cc:359] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.156666 27795 raft_consensus.cc:385] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.156983 27795 raft_consensus.cc:740] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.142350 27792 ts_tablet_manager.cc:1434] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.000s
I20260709 12:19:41.167155 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcdc60f1f704ccbae94b68301d5d7c7" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:41.173725 27737 tablet_service.cc:1511] Processing CreateTablet for tablet 72e820d15af94d0d8c63cd76f44ee8ec (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:41.175571 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e820d15af94d0d8c63cd76f44ee8ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:41.178090 27568 leader_election.cc:343] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.192513 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcdc60f1f704ccbae94b68301d5d7c7" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:41.193238 27676 raft_consensus.cc:2468] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:41.197438 27566 leader_election.cc:304] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:41.198360 27800 raft_consensus.cc:2804] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:41.198736 27800 raft_consensus.cc:493] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.199189 27800 raft_consensus.cc:3060] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:41.203835 27591 tablet_service.cc:1511] Processing CreateTablet for tablet adb38284310a4a308dbb1da8b4325596 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:41.205159 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb38284310a4a308dbb1da8b4325596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.204761 27513 tablet_service.cc:1511] Processing CreateTablet for tablet adb38284310a4a308dbb1da8b4325596 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:41.207695 27800 raft_consensus.cc:515] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.210615 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcdc60f1f704ccbae94b68301d5d7c7" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:41.213936 27665 tablet_service.cc:1511] Processing CreateTablet for tablet adb38284310a4a308dbb1da8b4325596 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:41.215396 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb38284310a4a308dbb1da8b4325596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.215443 27738 tablet_service.cc:1511] Processing CreateTablet for tablet fecbf499aff740c39b815de4701ab51b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:41.216315 27794 tablet_bootstrap.cc:654] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.216826 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fecbf499aff740c39b815de4701ab51b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:41.212208 27568 leader_election.cc:343] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.223215 27792 tablet_bootstrap.cc:492] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:41.223517 27800 leader_election.cc:290] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:41.224958 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcdc60f1f704ccbae94b68301d5d7c7" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:41.238814 27676 raft_consensus.cc:3060] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:41.245961 27676 raft_consensus.cc:2468] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:41.246862 27513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb38284310a4a308dbb1da8b4325596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.254172 27589 tablet_service.cc:1511] Processing CreateTablet for tablet fecbf499aff740c39b815de4701ab51b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:41.255479 27589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fecbf499aff740c39b815de4701ab51b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.255725 27793 tablet_bootstrap.cc:492] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:41.256287 27793 ts_tablet_manager.cc:1403] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.176s	user 0.007s	sys 0.008s
I20260709 12:19:41.257882 27421 catalog_manager.cc:5697] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:41.259266 27793 raft_consensus.cc:359] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.259809 27512 tablet_service.cc:1511] Processing CreateTablet for tablet fecbf499aff740c39b815de4701ab51b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:41.262276 27793 raft_consensus.cc:385] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.262660 27793 raft_consensus.cc:740] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.262961 27512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fecbf499aff740c39b815de4701ab51b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.261761 27792 tablet_bootstrap.cc:654] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.266254 27566 leader_election.cc:304] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:41.267467 27800 raft_consensus.cc:2804] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:41.263621 27793 consensus_queue.cc:260] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.279309 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 0103e954b4ec472a9b561d0a4a1cbb10 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:41.280597 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0103e954b4ec472a9b561d0a4a1cbb10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.283116 27793 ts_tablet_manager.cc:1434] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:19:41.177012 27795 consensus_queue.cc:260] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.293524 27740 tablet_service.cc:1511] Processing CreateTablet for tablet 0103e954b4ec472a9b561d0a4a1cbb10 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:41.295001 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0103e954b4ec472a9b561d0a4a1cbb10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.303725 27793 tablet_bootstrap.cc:492] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:41.315565 27801 raft_consensus.cc:493] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.316193 27801 raft_consensus.cc:515] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:41.322360 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab21d2c166f4303beb2fa0bbc3868cc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:41.318678 27801 leader_election.cc:290] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
W20260709 12:19:41.328999 27716 leader_election.cc:343] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.331199 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 0103e954b4ec472a9b561d0a4a1cbb10 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:41.331211 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 2b28984fc9c44e9fb4b3df581a269923 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:41.332662 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0103e954b4ec472a9b561d0a4a1cbb10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.332726 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b28984fc9c44e9fb4b3df581a269923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.325544 27800 raft_consensus.cc:697] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:41.344805 27795 ts_tablet_manager.cc:1434] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.203s	user 0.016s	sys 0.022s
I20260709 12:19:41.345909 27795 tablet_bootstrap.cc:492] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:41.347815 27592 tablet_service.cc:1511] Processing CreateTablet for tablet 62b31e2427a143d2be9c66d5831fb40e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:41.347854 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53924e99bd64e01be6cf5fbd86a0abc" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:41.349110 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62b31e2427a143d2be9c66d5831fb40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.350065 27737 tablet_service.cc:1511] Processing CreateTablet for tablet 2b28984fc9c44e9fb4b3df581a269923 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:41.351300 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b28984fc9c44e9fb4b3df581a269923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.344985 27514 tablet_service.cc:1511] Processing CreateTablet for tablet 62b31e2427a143d2be9c66d5831fb40e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:41.358290 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62b31e2427a143d2be9c66d5831fb40e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:41.367513 27641 leader_election.cc:343] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.343753 27591 tablet_service.cc:1511] Processing CreateTablet for tablet 2b28984fc9c44e9fb4b3df581a269923 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:41.369190 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b28984fc9c44e9fb4b3df581a269923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.372023 27794 tablet_bootstrap.cc:492] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:41.372548 27794 ts_tablet_manager.cc:1403] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.264s	user 0.014s	sys 0.012s
I20260709 12:19:41.372889 27795 tablet_bootstrap.cc:654] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.376852 27793 tablet_bootstrap.cc:654] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.380244 27800 consensus_queue.cc:237] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.392558 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53924e99bd64e01be6cf5fbd86a0abc" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:41.393971 27642 leader_election.cc:343] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.394443 27642 leader_election.cc:304] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:19:41.395063 27794 raft_consensus.cc:359] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.395584 27802 raft_consensus.cc:2749] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:41.395843 27794 raft_consensus.cc:385] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.396245 27794 raft_consensus.cc:740] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.397197 27794 consensus_queue.cc:260] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.400120 27820 raft_consensus.cc:493] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.400683 27820 raft_consensus.cc:515] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:41.402442 27794 ts_tablet_manager.cc:1434] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 12:19:41.407773 27662 tablet_service.cc:1511] Processing CreateTablet for tablet 62b31e2427a143d2be9c66d5831fb40e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:41.409073 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62b31e2427a143d2be9c66d5831fb40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.410948 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 58ccaa3a32e64320ac39060852b877fc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:41.414047 27819 raft_consensus.cc:493] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.414533 27819 raft_consensus.cc:515] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.415007 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 24fc70997e4048979966612dc07d9a47 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:41.416329 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24fc70997e4048979966612dc07d9a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.416684 27819 leader_election.cc:290] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:41.417820 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4c36c14e1343f2a56f2fd93787f29b" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:41.421736 27566 leader_election.cc:343] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.422729 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ccaa3a32e64320ac39060852b877fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.422457 27512 tablet_service.cc:1511] Processing CreateTablet for tablet 58ccaa3a32e64320ac39060852b877fc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:41.427624 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4c36c14e1343f2a56f2fd93787f29b" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:41.431459 27592 tablet_service.cc:1511] Processing CreateTablet for tablet 58ccaa3a32e64320ac39060852b877fc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:41.433629 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab21d2c166f4303beb2fa0bbc3868cc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:41.439776 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ccaa3a32e64320ac39060852b877fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:41.437984 27568 leader_election.cc:343] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.429386 27512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ccaa3a32e64320ac39060852b877fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.441694 27422 catalog_manager.cc:5697] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.444888 27820 leader_election.cc:290] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:41.445142 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 24fc70997e4048979966612dc07d9a47 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:41.446399 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24fc70997e4048979966612dc07d9a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.446226 27568 leader_election.cc:304] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:41.447259 27800 raft_consensus.cc:2749] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:41.447953 27715 leader_election.cc:343] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.448467 27715 leader_election.cc:304] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:19:41.449592 27801 raft_consensus.cc:2749] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:41.453205 27794 tablet_bootstrap.cc:492] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:41.472333 27792 tablet_bootstrap.cc:492] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:41.472921 27792 ts_tablet_manager.cc:1403] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.250s	user 0.009s	sys 0.014s
I20260709 12:19:41.483161 27792 raft_consensus.cc:359] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.483357 27514 tablet_service.cc:1511] Processing CreateTablet for tablet 24fc70997e4048979966612dc07d9a47 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:41.484050 27792 raft_consensus.cc:385] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.484460 27792 raft_consensus.cc:740] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.484731 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24fc70997e4048979966612dc07d9a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.486634 27792 consensus_queue.cc:260] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.498788 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:41.499836 27591 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9dad5b0ab6435aaf307e6816020451 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 12:19:41.500695 27568 leader_election.cc:343] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.500918 27793 tablet_bootstrap.cc:492] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:41.501130 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9dad5b0ab6435aaf307e6816020451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.501595 27793 ts_tablet_manager.cc:1403] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.198s	user 0.040s	sys 0.010s
I20260709 12:19:41.502048 27792 ts_tablet_manager.cc:1434] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.008s
I20260709 12:19:41.504624 27793 raft_consensus.cc:359] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.508543 27511 tablet_service.cc:1511] Processing CreateTablet for tablet b167e6443cee4e879c2294bb44197833 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:41.508852 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9dad5b0ab6435aaf307e6816020451 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:41.512360 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b167e6443cee4e879c2294bb44197833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.512976 27792 tablet_bootstrap.cc:492] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:41.513821 27794 tablet_bootstrap.cc:654] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.516637 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9dad5b0ab6435aaf307e6816020451 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:41.517707 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9dad5b0ab6435aaf307e6816020451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.510536 27793 raft_consensus.cc:385] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.525594 27662 tablet_service.cc:1511] Processing CreateTablet for tablet b167e6443cee4e879c2294bb44197833 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:41.526561 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9dad5b0ab6435aaf307e6816020451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.521366 27793 raft_consensus.cc:740] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.528328 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b167e6443cee4e879c2294bb44197833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.532153 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
W20260709 12:19:41.533740 27566 leader_election.cc:343] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.534178 27566 leader_election.cc:304] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:41.534953 27820 raft_consensus.cc:2749] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:41.532147 27795 tablet_bootstrap.cc:492] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:41.535754 27795 ts_tablet_manager.cc:1403] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.190s	user 0.013s	sys 0.016s
I20260709 12:19:41.532058 27739 tablet_service.cc:1511] Processing CreateTablet for tablet f9660477954949d78372b3e23fb42b46 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:41.541358 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9660477954949d78372b3e23fb42b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.542976 27587 tablet_service.cc:1511] Processing CreateTablet for tablet f9660477954949d78372b3e23fb42b46 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:41.544433 27587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9660477954949d78372b3e23fb42b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.545205 27512 tablet_service.cc:1511] Processing CreateTablet for tablet f9660477954949d78372b3e23fb42b46 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:41.544466 27664 tablet_service.cc:1511] Processing CreateTablet for tablet fd2c5c04c10e47208177d477008b8d8f (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:41.529675 27793 consensus_queue.cc:260] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.538666 27795 raft_consensus.cc:359] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.556077 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd2c5c04c10e47208177d477008b8d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.557705 27740 tablet_service.cc:1511] Processing CreateTablet for tablet fd2c5c04c10e47208177d477008b8d8f (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:41.560878 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd2c5c04c10e47208177d477008b8d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.561340 27511 tablet_service.cc:1511] Processing CreateTablet for tablet fd2c5c04c10e47208177d477008b8d8f (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:41.562598 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd2c5c04c10e47208177d477008b8d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.567375 27793 ts_tablet_manager.cc:1434] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 12:19:41.559396 27795 raft_consensus.cc:385] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.568197 27795 raft_consensus.cc:740] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.569802 27795 consensus_queue.cc:260] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.568392 27793 tablet_bootstrap.cc:492] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:41.567751 27589 tablet_service.cc:1511] Processing CreateTablet for tablet 67e42f9eb1474d79a877272e9d1566ca (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:41.575191 27589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e42f9eb1474d79a877272e9d1566ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.575318 27592 tablet_service.cc:1511] Processing CreateTablet for tablet b167e6443cee4e879c2294bb44197833 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:41.579957 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b167e6443cee4e879c2294bb44197833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.580260 27792 tablet_bootstrap.cc:654] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.580693 27794 tablet_bootstrap.cc:492] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:41.581202 27794 ts_tablet_manager.cc:1403] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.000s
I20260709 12:19:41.584208 27794 raft_consensus.cc:359] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.584873 27794 raft_consensus.cc:385] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.585172 27794 raft_consensus.cc:740] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.586174 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 67e42f9eb1474d79a877272e9d1566ca (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:41.591652 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e42f9eb1474d79a877272e9d1566ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.592705 27737 tablet_service.cc:1511] Processing CreateTablet for tablet 67e42f9eb1474d79a877272e9d1566ca (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:41.593979 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e42f9eb1474d79a877272e9d1566ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.595052 27513 tablet_service.cc:1511] Processing CreateTablet for tablet 61af26ee6a29463f8084851d49c5597c (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 12:19:41.596383 27714 consensus_peers.cc:597] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c -> Peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Couldn't send request to peer 2e2faf2971ea4c7ab7f426935b9e6d96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:41.606334 27512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9660477954949d78372b3e23fb42b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.607052 27513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61af26ee6a29463f8084851d49c5597c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.596271 27795 ts_tablet_manager.cc:1434] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.001s
I20260709 12:19:41.612967 27795 tablet_bootstrap.cc:492] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:41.621927 27795 tablet_bootstrap.cc:654] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.622144 27793 tablet_bootstrap.cc:654] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.630597 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 61af26ee6a29463f8084851d49c5597c (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:41.632148 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61af26ee6a29463f8084851d49c5597c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.598626 27794 consensus_queue.cc:260] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.634768 27801 raft_consensus.cc:493] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.635262 27801 raft_consensus.cc:515] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.638386 27792 tablet_bootstrap.cc:492] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:41.638577 27794 ts_tablet_manager.cc:1434] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:19:41.641980 27792 ts_tablet_manager.cc:1403] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.129s	user 0.007s	sys 0.005s
I20260709 12:19:41.643677 27794 tablet_bootstrap.cc:492] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:41.646342 27792 raft_consensus.cc:359] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.647064 27792 raft_consensus.cc:385] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.647354 27792 raft_consensus.cc:740] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.649078 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edaed12566a4bdf9cbff46d06ef8f1e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:41.649715 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edaed12566a4bdf9cbff46d06ef8f1e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:41.650426 27716 leader_election.cc:343] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:41.655702 27714 leader_election.cc:343] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.660813 27714 leader_election.cc:304] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:41.656081 27792 consensus_queue.cc:260] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.661847 27803 raft_consensus.cc:2749] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:41.656378 27514 tablet_service.cc:1511] Processing CreateTablet for tablet 648ac5bd1d184f85b76916c8695098f0 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:41.667765 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648ac5bd1d184f85b76916c8695098f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.677791 27792 ts_tablet_manager.cc:1434] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 12:19:41.654049 27801 leader_election.cc:290] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:41.686017 27792 tablet_bootstrap.cc:492] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:41.686688 27802 raft_consensus.cc:493] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.687204 27802 raft_consensus.cc:515] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.693862 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25217e2e64ee4c46a3c6fe52f264eb73" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:41.694465 27602 raft_consensus.cc:2468] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:41.695735 27641 leader_election.cc:304] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:41.695899 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 648ac5bd1d184f85b76916c8695098f0 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:41.697221 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648ac5bd1d184f85b76916c8695098f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.658430 27794 tablet_bootstrap.cc:654] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.658746 27589 tablet_service.cc:1511] Processing CreateTablet for tablet 61af26ee6a29463f8084851d49c5597c (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:41.700459 27589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61af26ee6a29463f8084851d49c5597c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.703701 27802 leader_election.cc:290] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:41.704278 27592 tablet_service.cc:1511] Processing CreateTablet for tablet 648ac5bd1d184f85b76916c8695098f0 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:41.704306 27802 raft_consensus.cc:2804] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:41.705312 27802 raft_consensus.cc:493] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.705506 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648ac5bd1d184f85b76916c8695098f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.706974 27802 raft_consensus.cc:3060] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:41.711169 27803 consensus_queue.cc:1048] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:41.714802 27793 tablet_bootstrap.cc:492] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:41.715329 27793 ts_tablet_manager.cc:1403] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.013s
I20260709 12:19:41.718743 27737 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb3a4caa6e144feae981f2540571cf2 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:41.720007 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb3a4caa6e144feae981f2540571cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.719823 27513 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb3a4caa6e144feae981f2540571cf2 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:41.720345 27795 tablet_bootstrap.cc:492] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:41.720849 27795 ts_tablet_manager.cc:1403] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.108s	user 0.034s	sys 0.035s
I20260709 12:19:41.721071 27513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb3a4caa6e144feae981f2540571cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.723074 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25217e2e64ee4c46a3c6fe52f264eb73" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
W20260709 12:19:41.724647 27640 leader_election.cc:343] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.727535 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb3a4caa6e144feae981f2540571cf2 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:41.728472 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb3a4caa6e144feae981f2540571cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.733585 27802 raft_consensus.cc:515] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.737325 27793 raft_consensus.cc:359] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.738031 27793 raft_consensus.cc:385] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.738319 27793 raft_consensus.cc:740] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.743707 27802 leader_election.cc:290] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:41.745249 27792 tablet_bootstrap.cc:654] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.752782 27811 raft_consensus.cc:493] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.753306 27811 raft_consensus.cc:515] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.785646 27793 consensus_queue.cc:260] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.787245 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25217e2e64ee4c46a3c6fe52f264eb73" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:41.788040 27811 leader_election.cc:290] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:41.790129 27793 ts_tablet_manager.cc:1434] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.002s
I20260709 12:19:41.789861 27587 tablet_service.cc:1511] Processing CreateTablet for tablet 76a307ee39574103a5e8d0dbbc4311a9 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:19:41.790683 27640 leader_election.cc:343] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.792798 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 76a307ee39574103a5e8d0dbbc4311a9 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:41.799006 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a307ee39574103a5e8d0dbbc4311a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.801486 27591 tablet_service.cc:1511] Processing CreateTablet for tablet 38f3f60349784a56b3225530bd5d5b14 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:41.793529 27794 tablet_bootstrap.cc:492] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:41.803200 27794 ts_tablet_manager.cc:1403] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.160s	user 0.005s	sys 0.006s
I20260709 12:19:41.803400 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25217e2e64ee4c46a3c6fe52f264eb73" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:41.804152 27602 raft_consensus.cc:3060] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:41.804487 27587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a307ee39574103a5e8d0dbbc4311a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.806493 27794 raft_consensus.cc:359] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.795989 27737 tablet_service.cc:1511] Processing CreateTablet for tablet 76a307ee39574103a5e8d0dbbc4311a9 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:41.807785 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a307ee39574103a5e8d0dbbc4311a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.809861 27793 tablet_bootstrap.cc:492] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:41.807001 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38f3f60349784a56b3225530bd5d5b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.818944 27794 raft_consensus.cc:385] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.819342 27794 raft_consensus.cc:740] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.831671 27794 consensus_queue.cc:260] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.833572 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 38f3f60349784a56b3225530bd5d5b14 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:41.836404 27592 tablet_service.cc:1511] Processing CreateTablet for tablet 72f87bb1f2fd40e1b066d978660bf0fe (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:41.837545 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f87bb1f2fd40e1b066d978660bf0fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:41.837755 27473 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:41.838650 27795 raft_consensus.cc:359] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:41.839394 27795 raft_consensus.cc:385] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.839640 27794 ts_tablet_manager.cc:1434] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:19:41.840175 27513 tablet_service.cc:1511] Processing CreateTablet for tablet 72f87bb1f2fd40e1b066d978660bf0fe (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:41.839676 27795 raft_consensus.cc:740] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.841496 27513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f87bb1f2fd40e1b066d978660bf0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.847215 27512 tablet_service.cc:1511] Processing CreateTablet for tablet 38f3f60349784a56b3225530bd5d5b14 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:41.849249 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38f3f60349784a56b3225530bd5d5b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.840718 27794 tablet_bootstrap.cc:492] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:41.849871 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 72f87bb1f2fd40e1b066d978660bf0fe (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:41.860936 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f87bb1f2fd40e1b066d978660bf0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.864293 27740 tablet_service.cc:1511] Processing CreateTablet for tablet 5a629b1a82d14248a102eec847a92754 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:41.865504 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a629b1a82d14248a102eec847a92754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.865374 27512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38f3f60349784a56b3225530bd5d5b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.872749 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 5a629b1a82d14248a102eec847a92754 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:41.873855 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a629b1a82d14248a102eec847a92754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.875134 27811 raft_consensus.cc:493] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.875732 27839 raft_consensus.cc:493] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.877279 27839 raft_consensus.cc:515] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:41.879432 27839 leader_election.cc:290] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:41.849927 27795 consensus_queue.cc:260] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:41.881397 27795 ts_tablet_manager.cc:1434] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.160s	user 0.022s	sys 0.000s
I20260709 12:19:41.881644 27794 tablet_bootstrap.cc:654] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.862699 27801 raft_consensus.cc:493] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.875638 27811 raft_consensus.cc:515] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.883466 27602 raft_consensus.cc:2468] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:41.883818 27801 raft_consensus.cc:515] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.885900 27801 leader_election.cc:290] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:41.888160 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f0bf0cb9746fbac4d45766dcb3dcb" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
W20260709 12:19:41.889408 27715 leader_election.cc:343] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.894188 27820 consensus_queue.cc:1048] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:41.882344 27795 tablet_bootstrap.cc:492] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:41.898336 27792 tablet_bootstrap.cc:492] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:41.898818 27792 ts_tablet_manager.cc:1403] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.220s	user 0.019s	sys 0.000s
I20260709 12:19:41.901666 27792 raft_consensus.cc:359] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:41.902356 27792 raft_consensus.cc:385] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.903229 27811 leader_election.cc:290] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:41.902633 27792 raft_consensus.cc:740] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.876816 27793 tablet_bootstrap.cc:654] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.918705 27514 tablet_service.cc:1511] Processing CreateTablet for tablet 5a629b1a82d14248a102eec847a92754 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:41.919679 27587 tablet_service.cc:1511] Processing CreateTablet for tablet e7a8e7d5f765421391635cebebac4add (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:41.920019 27795 tablet_bootstrap.cc:654] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.920928 27587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a8e7d5f765421391635cebebac4add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.924376 27665 tablet_service.cc:1511] Processing CreateTablet for tablet e7a8e7d5f765421391635cebebac4add (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:41.925674 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a8e7d5f765421391635cebebac4add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.925843 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304ee4c1b5cd4dcf992f38355c86bb62" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:41.915359 27792 consensus_queue.cc:260] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
W20260709 12:19:41.928905 27492 leader_election.cc:343] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.929235 27792 ts_tablet_manager.cc:1434] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:19:41.929620 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcdc60f1f704ccbae94b68301d5d7c7" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:41.930235 27792 tablet_bootstrap.cc:492] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:41.931027 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 22da56e5d8d04a7a82f4d2cc8eacf27a (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:41.933646 27738 tablet_service.cc:1511] Processing CreateTablet for tablet e7a8e7d5f765421391635cebebac4add (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:41.935951 27820 raft_consensus.cc:493] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.936429 27820 raft_consensus.cc:515] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:41.934753 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a8e7d5f765421391635cebebac4add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.920053 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a629b1a82d14248a102eec847a92754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.938482 27820 leader_election.cc:290] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:41.940303 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22da56e5d8d04a7a82f4d2cc8eacf27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.940104 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab21d2c166f4303beb2fa0bbc3868cc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:41.940775 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab21d2c166f4303beb2fa0bbc3868cc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:41.941435 27750 raft_consensus.cc:2468] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
W20260709 12:19:41.941773 27568 leader_election.cc:343] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.944363 27566 leader_election.cc:304] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:41.944949 27526 raft_consensus.cc:3060] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:41.945442 27800 raft_consensus.cc:2804] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:41.945843 27800 raft_consensus.cc:493] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.946183 27800 raft_consensus.cc:3060] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:41.911450 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f0bf0cb9746fbac4d45766dcb3dcb" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:41.952258 27591 tablet_service.cc:1511] Processing CreateTablet for tablet 22da56e5d8d04a7a82f4d2cc8eacf27a (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:41.953516 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22da56e5d8d04a7a82f4d2cc8eacf27a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:41.960201 27716 leader_election.cc:343] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.960661 27716 leader_election.cc:304] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:19:41.961731 27801 raft_consensus.cc:2749] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:41.964048 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 22da56e5d8d04a7a82f4d2cc8eacf27a (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:41.965185 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22da56e5d8d04a7a82f4d2cc8eacf27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.968145 27794 tablet_bootstrap.cc:492] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:41.968674 27794 ts_tablet_manager.cc:1403] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.128s	user 0.007s	sys 0.007s
I20260709 12:19:41.970122 27820 consensus_queue.cc:1048] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:41.948248 27641 leader_election.cc:304] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c
I20260709 12:19:41.974661 27737 tablet_service.cc:1511] Processing CreateTablet for tablet d280b2356d7f4990b289d4c328eb9e7e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:41.975436 27802 raft_consensus.cc:2804] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:41.975999 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d280b2356d7f4990b289d4c328eb9e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.975919 27802 raft_consensus.cc:697] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:41.977270 27802 consensus_queue.cc:237] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:41.975240 27800 raft_consensus.cc:515] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
W20260709 12:19:41.980808 27641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:38235, user_credentials={real_user=slave}} blocked reactor thread for 65819us
I20260709 12:19:42.021459 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcdc60f1f704ccbae94b68301d5d7c7" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:42.023198 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304ee4c1b5cd4dcf992f38355c86bb62" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:42.024333 27848 log.cc:927] Time spent T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:42.024717 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:42.024894 27491 leader_election.cc:304] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67
W20260709 12:19:42.027253 27491 leader_election.cc:343] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.027720 27491 leader_election.cc:304] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67
I20260709 12:19:42.028487 27839 raft_consensus.cc:2749] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:42.028884 27491 leader_election.cc:343] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.030926 27800 leader_election.cc:290] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:42.031626 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:42.032680 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab21d2c166f4303beb2fa0bbc3868cc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:42.032966 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab21d2c166f4303beb2fa0bbc3868cc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:42.033386 27749 raft_consensus.cc:3060] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:42.035151 27568 leader_election.cc:343] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:42.039984 27491 leader_election.cc:343] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.040455 27491 leader_election.cc:304] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:42.041239 27839 raft_consensus.cc:2749] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:42.028056 27792 tablet_bootstrap.cc:654] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.033921 27794 raft_consensus.cc:359] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.043545 27794 raft_consensus.cc:385] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.043856 27794 raft_consensus.cc:740] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.056829 27836 raft_consensus.cc:493] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.057363 27836 raft_consensus.cc:515] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.044677 27794 consensus_queue.cc:260] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.057817 27811 raft_consensus.cc:2749] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:42.064550 27749 raft_consensus.cc:2468] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:42.065780 27664 tablet_service.cc:1511] Processing CreateTablet for tablet fec8141371c04e69b06fc2f3b1fffef9 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:42.066509 27795 tablet_bootstrap.cc:492] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:42.067091 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec8141371c04e69b06fc2f3b1fffef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.067883 27566 leader_election.cc:304] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:42.068377 27793 tablet_bootstrap.cc:492] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:42.067027 27795 ts_tablet_manager.cc:1403] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.024s
I20260709 12:19:42.068236 27514 tablet_service.cc:1511] Processing CreateTablet for tablet d280b2356d7f4990b289d4c328eb9e7e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:42.068887 27793 ts_tablet_manager.cc:1403] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.259s	user 0.007s	sys 0.015s
I20260709 12:19:42.069638 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d280b2356d7f4990b289d4c328eb9e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.066723 27591 tablet_service.cc:1511] Processing CreateTablet for tablet d280b2356d7f4990b289d4c328eb9e7e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:42.071810 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d280b2356d7f4990b289d4c328eb9e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.076592 27820 raft_consensus.cc:2804] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:42.077097 27820 raft_consensus.cc:697] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:42.080904 27836 leader_election.cc:290] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:42.081883 27424 catalog_manager.cc:5697] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:42.083391 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b03c9e97db4f44883288bc9389dfe6" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:42.081831 27795 raft_consensus.cc:359] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.086584 27795 raft_consensus.cc:385] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.086912 27795 raft_consensus.cc:740] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.087152 27794 ts_tablet_manager.cc:1434] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.118s	user 0.010s	sys 0.000s
I20260709 12:19:42.087631 27792 tablet_bootstrap.cc:492] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:42.093238 27795 consensus_queue.cc:260] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.094422 27792 ts_tablet_manager.cc:1403] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.000s
I20260709 12:19:42.079294 27820 consensus_queue.cc:237] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.088186 27794 tablet_bootstrap.cc:492] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:42.096203 27795 ts_tablet_manager.cc:1434] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.002s
I20260709 12:19:42.097213 27795 tablet_bootstrap.cc:492] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:42.099640 27676 raft_consensus.cc:3060] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.080603 27793 raft_consensus.cc:359] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.103904 27793 raft_consensus.cc:385] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.104261 27740 tablet_service.cc:1511] Processing CreateTablet for tablet fec8141371c04e69b06fc2f3b1fffef9 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:42.104197 27793 raft_consensus.cc:740] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.105516 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec8141371c04e69b06fc2f3b1fffef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.107760 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b03c9e97db4f44883288bc9389dfe6" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:42.109201 27640 leader_election.cc:304] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:42.110329 27795 tablet_bootstrap.cc:654] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.113571 27792 raft_consensus.cc:359] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.125339 27792 raft_consensus.cc:385] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.115175 27512 tablet_service.cc:1511] Processing CreateTablet for tablet fec8141371c04e69b06fc2f3b1fffef9 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:42.126598 27512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec8141371c04e69b06fc2f3b1fffef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.133383 27425 catalog_manager.cc:5697] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.106460 27793 consensus_queue.cc:260] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.150209 27587 tablet_service.cc:1511] Processing CreateTablet for tablet 58f8b7dcacaf41f18a7974c565deffd4 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:42.151670 27587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f8b7dcacaf41f18a7974c565deffd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.152278 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 58f8b7dcacaf41f18a7974c565deffd4 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:42.153558 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f8b7dcacaf41f18a7974c565deffd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.148844 27792 raft_consensus.cc:740] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.157720 27792 consensus_queue.cc:260] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.184295 27792 ts_tablet_manager.cc:1434] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.001s
I20260709 12:19:42.163208 27737 tablet_service.cc:1511] Processing CreateTablet for tablet 58f8b7dcacaf41f18a7974c565deffd4 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:42.163584 27820 raft_consensus.cc:493] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.185369 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f8b7dcacaf41f18a7974c565deffd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.168977 27846 raft_consensus.cc:493] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.171365 27591 tablet_service.cc:1511] Processing CreateTablet for tablet e9cb727b47e94021b993343a72045259 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:42.186342 27846 raft_consensus.cc:515] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.176580 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 69fe214d9a2046e5ad2f9c677aef5b61 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:42.176633 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 69fe214d9a2046e5ad2f9c677aef5b61 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:42.187732 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fe214d9a2046e5ad2f9c677aef5b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.187851 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fe214d9a2046e5ad2f9c677aef5b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.188696 27846 leader_election.cc:290] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:42.191536 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25217e2e64ee4c46a3c6fe52f264eb73" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:42.192293 27602 raft_consensus.cc:2393] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:42.193552 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25217e2e64ee4c46a3c6fe52f264eb73" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:42.195182 27714 leader_election.cc:304] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67
I20260709 12:19:42.177764 27794 tablet_bootstrap.cc:654] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.178192 27795 tablet_bootstrap.cc:492] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:42.196076 27795 ts_tablet_manager.cc:1403] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.099s	user 0.006s	sys 0.010s
I20260709 12:19:42.196326 27846 raft_consensus.cc:3060] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.197396 27792 tablet_bootstrap.cc:492] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:42.184998 27820 raft_consensus.cc:515] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.207248 27820 leader_election.cc:290] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:42.167661 27514 tablet_service.cc:1511] Processing CreateTablet for tablet e9cb727b47e94021b993343a72045259 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:42.186865 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9cb727b47e94021b993343a72045259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.208350 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9cb727b47e94021b993343a72045259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.208442 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27eb2f13d7e642e9b623762ab04241c0" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:42.176432 27662 tablet_service.cc:1511] Processing CreateTablet for tablet e9cb727b47e94021b993343a72045259 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:42.210129 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9cb727b47e94021b993343a72045259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.199146 27795 raft_consensus.cc:359] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.159972 27793 ts_tablet_manager.cc:1434] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.001s
I20260709 12:19:42.211606 27795 raft_consensus.cc:385] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.211941 27795 raft_consensus.cc:740] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.212378 27793 tablet_bootstrap.cc:492] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:42.212095 27587 tablet_service.cc:1511] Processing CreateTablet for tablet 69fe214d9a2046e5ad2f9c677aef5b61 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:19:42.212787 27566 leader_election.cc:343] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.203122 27802 raft_consensus.cc:493] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.215157 27587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fe214d9a2046e5ad2f9c677aef5b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.215091 27802 raft_consensus.cc:515] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.216625 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27eb2f13d7e642e9b623762ab04241c0" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:42.217206 27795 consensus_queue.cc:260] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
W20260709 12:19:42.218883 27566 leader_election.cc:343] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.219347 27566 leader_election.cc:304] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:42.220629 27857 raft_consensus.cc:2749] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:42.224886 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 6af49c4f1e7b4c12a9985f530fc9603b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:42.225876 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af49c4f1e7b4c12a9985f530fc9603b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.227578 27795 ts_tablet_manager.cc:1434] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 12:19:42.228312 27846 raft_consensus.cc:2749] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:42.228895 27795 tablet_bootstrap.cc:492] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:42.229965 27802 leader_election.cc:290] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:42.230607 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:42.231103 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:42.231729 27527 raft_consensus.cc:2468] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
W20260709 12:19:42.232019 27640 leader_election.cc:343] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.233012 27642 leader_election.cc:304] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: be117ea016214236abda478b04f7f70c
I20260709 12:19:42.234133 27802 raft_consensus.cc:2804] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.234476 27802 raft_consensus.cc:493] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.234783 27802 raft_consensus.cc:3060] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.235249 27836 raft_consensus.cc:2749] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:42.244848 27795 tablet_bootstrap.cc:654] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.247246 27802 raft_consensus.cc:515] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.250977 27793 tablet_bootstrap.cc:654] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.254046 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:42.254302 27802 leader_election.cc:290] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:42.254235 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:42.255125 27527 raft_consensus.cc:3060] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:42.255544 27640 leader_election.cc:343] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.263018 27794 tablet_bootstrap.cc:492] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:42.263530 27794 ts_tablet_manager.cc:1403] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.176s	user 0.010s	sys 0.004s
I20260709 12:19:42.265748 27820 raft_consensus.cc:493] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.266292 27820 raft_consensus.cc:515] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.266480 27794 raft_consensus.cc:359] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.271697 27820 leader_election.cc:290] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:42.271591 27794 raft_consensus.cc:385] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.273485 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f0bf0cb9746fbac4d45766dcb3dcb" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:42.273778 27794 raft_consensus.cc:740] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.274209 27795 tablet_bootstrap.cc:492] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:42.274591 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f0bf0cb9746fbac4d45766dcb3dcb" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:42.274698 27795 ts_tablet_manager.cc:1403] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.014s
I20260709 12:19:42.274150 27526 raft_consensus.cc:2468] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:42.274708 27794 consensus_queue.cc:260] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.276374 27568 leader_election.cc:304] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:42.277360 27846 raft_consensus.cc:493] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.277609 27795 raft_consensus.cc:359] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.277850 27846 raft_consensus.cc:515] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.278323 27795 raft_consensus.cc:385] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.278647 27795 raft_consensus.cc:740] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.279006 27820 raft_consensus.cc:2804] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.279738 27749 raft_consensus.cc:2468] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:42.279450 27795 consensus_queue.cc:260] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.279395 27820 raft_consensus.cc:493] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.281304 27820 raft_consensus.cc:3060] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.281590 27795 ts_tablet_manager.cc:1434] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:42.282521 27795 tablet_bootstrap.cc:492] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:42.283882 27846 leader_election.cc:290] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:42.284511 27794 ts_tablet_manager.cc:1434] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:19:42.285607 27794 tablet_bootstrap.cc:492] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:42.285763 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c85488af34f9ca4d2f9dfc4946c38" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:42.285567 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c85488af34f9ca4d2f9dfc4946c38" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
W20260709 12:19:42.287223 27714 leader_election.cc:343] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.287557 27602 raft_consensus.cc:2468] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:42.288030 27795 tablet_bootstrap.cc:654] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.289551 27715 leader_election.cc:304] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:42.289763 27737 tablet_service.cc:1511] Processing CreateTablet for tablet 6af49c4f1e7b4c12a9985f530fc9603b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:42.290668 27846 raft_consensus.cc:2804] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.291055 27527 raft_consensus.cc:2468] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:42.292615 27514 tablet_service.cc:1511] Processing CreateTablet for tablet 6af49c4f1e7b4c12a9985f530fc9603b (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:42.292723 27591 tablet_service.cc:1511] Processing CreateTablet for tablet fcf91225062d4c728d8ff49b308ebf18 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:42.293816 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af49c4f1e7b4c12a9985f530fc9603b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.293834 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf91225062d4c728d8ff49b308ebf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.290946 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af49c4f1e7b4c12a9985f530fc9603b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.299593 27642 leader_election.cc:304] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: be117ea016214236abda478b04f7f70c
I20260709 12:19:42.300769 27802 raft_consensus.cc:2804] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:42.301249 27802 raft_consensus.cc:697] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:42.302000 27802 consensus_queue.cc:237] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.291090 27846 raft_consensus.cc:493] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.309609 27846 raft_consensus.cc:3060] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.319101 27801 raft_consensus.cc:493] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.319729 27801 raft_consensus.cc:515] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.321683 27820 raft_consensus.cc:515] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.322028 27846 raft_consensus.cc:515] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.322453 27801 leader_election.cc:290] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:42.323884 27846 leader_election.cc:290] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:42.323894 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27eb2f13d7e642e9b623762ab04241c0" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:42.325075 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f0bf0cb9746fbac4d45766dcb3dcb" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:42.325872 27749 raft_consensus.cc:3060] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.326315 27792 tablet_bootstrap.cc:654] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:42.327986 27714 leader_election.cc:343] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.328382 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c85488af34f9ca4d2f9dfc4946c38" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:42.329797 27737 tablet_service.cc:1511] Processing CreateTablet for tablet fcf91225062d4c728d8ff49b308ebf18 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:42.330475 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27eb2f13d7e642e9b623762ab04241c0" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:42.330971 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf91225062d4c728d8ff49b308ebf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.332362 27664 tablet_service.cc:1511] Processing CreateTablet for tablet fcf91225062d4c728d8ff49b308ebf18 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:42.333436 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf91225062d4c728d8ff49b308ebf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.334017 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c85488af34f9ca4d2f9dfc4946c38" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
W20260709 12:19:42.334405 27714 leader_election.cc:343] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.334578 27601 raft_consensus.cc:3060] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.335000 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 2db3cbf0efe649f592da4a1f3a3b331a (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:42.336072 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db3cbf0efe649f592da4a1f3a3b331a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.337975 27794 tablet_bootstrap.cc:654] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.342638 27602 raft_consensus.cc:2468] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:42.345153 27715 leader_election.cc:304] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:42.347347 27591 tablet_service.cc:1511] Processing CreateTablet for tablet 2db3cbf0efe649f592da4a1f3a3b331a (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:42.348182 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db3cbf0efe649f592da4a1f3a3b331a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.353021 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314f0bf0cb9746fbac4d45766dcb3dcb" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:42.353188 27662 tablet_service.cc:1511] Processing CreateTablet for tablet 2db3cbf0efe649f592da4a1f3a3b331a (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:42.353652 27527 raft_consensus.cc:3060] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.354444 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db3cbf0efe649f592da4a1f3a3b331a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.355584 27514 tablet_service.cc:1511] Processing CreateTablet for tablet 8af215ddc5284c54a2e361b75ce7b45e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:42.356719 27424 catalog_manager.cc:5697] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:42.359611 27587 tablet_service.cc:1511] Processing CreateTablet for tablet 8af215ddc5284c54a2e361b75ce7b45e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:42.360733 27587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af215ddc5284c54a2e361b75ce7b45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.364372 27527 raft_consensus.cc:2468] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:42.364914 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 91a5aef7a6d84eb79c2a50447c018732 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:42.365545 27568 leader_election.cc:304] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:42.365991 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a5aef7a6d84eb79c2a50447c018732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.356679 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af215ddc5284c54a2e361b75ce7b45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.360432 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 8af215ddc5284c54a2e361b75ce7b45e (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:42.366618 27740 tablet_service.cc:1511] Processing CreateTablet for tablet 91a5aef7a6d84eb79c2a50447c018732 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:42.367484 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af215ddc5284c54a2e361b75ce7b45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.367863 27857 raft_consensus.cc:2804] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:42.368359 27857 raft_consensus.cc:697] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:42.351693 27820 leader_election.cc:290] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:42.369587 27793 tablet_bootstrap.cc:492] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:42.370162 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a5aef7a6d84eb79c2a50447c018732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.369154 27857 consensus_queue.cc:237] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.370086 27793 ts_tablet_manager.cc:1403] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.158s	user 0.004s	sys 0.011s
I20260709 12:19:42.384959 27601 raft_consensus.cc:2468] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:42.386322 27715 leader_election.cc:304] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:42.387439 27801 raft_consensus.cc:2804] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:42.387903 27801 raft_consensus.cc:697] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:42.388705 27801 consensus_queue.cc:237] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.390828 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 91a5aef7a6d84eb79c2a50447c018732 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:42.394008 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a5aef7a6d84eb79c2a50447c018732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.399925 27592 tablet_service.cc:1511] Processing CreateTablet for tablet 3e24b3506bb747b18e327830848ab3fc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:42.401054 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e24b3506bb747b18e327830848ab3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.378485 27793 raft_consensus.cc:359] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.373907 27846 raft_consensus.cc:2804] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.408717 27793 raft_consensus.cc:385] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.408834 27802 raft_consensus.cc:493] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.374027 27749 raft_consensus.cc:2468] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:42.410766 27846 raft_consensus.cc:493] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.416926 27802 raft_consensus.cc:515] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.418978 27846 raft_consensus.cc:3060] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.422801 27802 leader_election.cc:290] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:42.410959 27793 raft_consensus.cc:740] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.426802 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edaed12566a4bdf9cbff46d06ef8f1e" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:42.431389 27792 tablet_bootstrap.cc:492] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:42.431891 27792 ts_tablet_manager.cc:1403] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.235s	user 0.007s	sys 0.009s
I20260709 12:19:42.435516 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edaed12566a4bdf9cbff46d06ef8f1e" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:42.436260 27749 raft_consensus.cc:2468] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:42.437129 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 3e24b3506bb747b18e327830848ab3fc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:42.438284 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e24b3506bb747b18e327830848ab3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.438966 27793 consensus_queue.cc:260] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
W20260709 12:19:42.435911 27642 leader_election.cc:343] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.441843 27793 ts_tablet_manager.cc:1434] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.066s	user 0.000s	sys 0.006s
I20260709 12:19:42.441944 27640 leader_election.cc:304] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:42.443143 27802 raft_consensus.cc:2804] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.443521 27802 raft_consensus.cc:493] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.443858 27802 raft_consensus.cc:3060] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.439944 27424 catalog_manager.cc:5697] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.447805 27846 raft_consensus.cc:515] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.449915 27846 leader_election.cc:290] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:42.434736 27792 raft_consensus.cc:359] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.450943 27792 raft_consensus.cc:385] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.451239 27792 raft_consensus.cc:740] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.451367 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 3e24b3506bb747b18e327830848ab3fc (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:42.452600 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e24b3506bb747b18e327830848ab3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.453266 27591 tablet_service.cc:1511] Processing CreateTablet for tablet ecf3cff3a1874453ab1973cc35091fa0 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:42.454372 27591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf3cff3a1874453ab1973cc35091fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.460175 27664 tablet_service.cc:1511] Processing CreateTablet for tablet ecf3cff3a1874453ab1973cc35091fa0 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:42.461305 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf3cff3a1874453ab1973cc35091fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.472563 27514 tablet_service.cc:1511] Processing CreateTablet for tablet ecf3cff3a1874453ab1973cc35091fa0 (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:42.473835 27514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf3cff3a1874453ab1973cc35091fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.480558 27662 tablet_service.cc:1511] Processing CreateTablet for tablet abcf1b0ba28942d0928c3c0e5bf3c95c (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 12:19:42.481786 27870 log.cc:927] Time spent T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:19:42.481715 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcf1b0ba28942d0928c3c0e5bf3c95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.460361 27792 consensus_queue.cc:260] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.484912 27792 ts_tablet_manager.cc:1434] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:19:42.485817 27792 tablet_bootstrap.cc:492] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:42.487483 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27eb2f13d7e642e9b623762ab04241c0" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:42.489462 27802 raft_consensus.cc:515] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.494181 27512 tablet_service.cc:1511] Processing CreateTablet for tablet abcf1b0ba28942d0928c3c0e5bf3c95c (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:42.494875 27793 tablet_bootstrap.cc:492] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:42.495604 27511 tablet_service.cc:1511] Processing CreateTablet for tablet 438693ab12264201bb1a9cf7690d128a (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:19:42.496234 27714 leader_election.cc:343] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.496719 27511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438693ab12264201bb1a9cf7690d128a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.496506 27425 catalog_manager.cc:5697] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:42.498769 27512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcf1b0ba28942d0928c3c0e5bf3c95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.494170 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27eb2f13d7e642e9b623762ab04241c0" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:42.499428 27601 raft_consensus.cc:3060] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.500866 27793 tablet_bootstrap.cc:654] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.502424 27737 tablet_service.cc:1511] Processing CreateTablet for tablet abcf1b0ba28942d0928c3c0e5bf3c95c (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:42.502974 27738 tablet_service.cc:1511] Processing CreateTablet for tablet 438693ab12264201bb1a9cf7690d128a (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:42.503475 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcf1b0ba28942d0928c3c0e5bf3c95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.510627 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438693ab12264201bb1a9cf7690d128a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.511399 27802 leader_election.cc:290] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:42.512527 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edaed12566a4bdf9cbff46d06ef8f1e" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
W20260709 12:19:42.513944 27642 leader_election.cc:343] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.514998 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edaed12566a4bdf9cbff46d06ef8f1e" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:42.515560 27749 raft_consensus.cc:3060] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.516824 27794 tablet_bootstrap.cc:492] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:42.517495 27794 ts_tablet_manager.cc:1403] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.232s	user 0.020s	sys 0.009s
I20260709 12:19:42.518674 27592 tablet_service.cc:1511] Processing CreateTablet for tablet 438693ab12264201bb1a9cf7690d128a (DEFAULT_TABLE table=test-workload [id=eeb572c0c68b4b329c5b7cb7701e9717]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:42.519783 27592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438693ab12264201bb1a9cf7690d128a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.521059 27794 raft_consensus.cc:359] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.521979 27794 raft_consensus.cc:385] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.524973 27794 raft_consensus.cc:740] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.522934 27749 raft_consensus.cc:2468] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:42.526650 27640 leader_election.cc:304] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:42.527562 27794 consensus_queue.cc:260] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.544086 27802 raft_consensus.cc:2804] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:42.544688 27802 raft_consensus.cc:697] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:42.545560 27802 consensus_queue.cc:237] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.546358 27794 ts_tablet_manager.cc:1434] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.004s
I20260709 12:19:42.547963 27794 tablet_bootstrap.cc:492] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:42.548575 27795 tablet_bootstrap.cc:492] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:42.549041 27795 ts_tablet_manager.cc:1403] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.267s	user 0.022s	sys 0.018s
I20260709 12:19:42.553133 27794 tablet_bootstrap.cc:654] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.554293 27601 raft_consensus.cc:2468] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:42.556234 27792 tablet_bootstrap.cc:654] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.558698 27795 raft_consensus.cc:359] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.559412 27795 raft_consensus.cc:385] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.559690 27795 raft_consensus.cc:740] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.560310 27795 consensus_queue.cc:260] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.562244 27795 ts_tablet_manager.cc:1434] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
I20260709 12:19:42.572257 27795 tablet_bootstrap.cc:492] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:42.575462 27715 leader_election.cc:304] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:42.577217 27846 raft_consensus.cc:2804] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:42.577697 27846 raft_consensus.cc:697] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:42.578495 27846 consensus_queue.cc:237] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.580120 27800 consensus_queue.cc:1048] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:42.583851 27795 tablet_bootstrap.cc:654] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:42.586834 27568 consensus_peers.cc:597] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:42.587431 27793 tablet_bootstrap.cc:492] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:42.587992 27793 ts_tablet_manager.cc:1403] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.111s	user 0.025s	sys 0.027s
I20260709 12:19:42.591395 27793 raft_consensus.cc:359] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.591768 27794 tablet_bootstrap.cc:492] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:42.595359 27793 raft_consensus.cc:385] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.595744 27794 ts_tablet_manager.cc:1403] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.001s
I20260709 12:19:42.595818 27793 raft_consensus.cc:740] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.596812 27793 consensus_queue.cc:260] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.598485 27794 raft_consensus.cc:359] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.599174 27794 raft_consensus.cc:385] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.599435 27794 raft_consensus.cc:740] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.594411 27792 tablet_bootstrap.cc:492] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:42.600088 27794 consensus_queue.cc:260] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.600627 27792 ts_tablet_manager.cc:1403] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.005s
I20260709 12:19:42.599505 27793 ts_tablet_manager.cc:1434] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:19:42.607539 27793 tablet_bootstrap.cc:492] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:42.605929 27425 catalog_manager.cc:5697] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:42.611928 27794 ts_tablet_manager.cc:1434] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:19:42.612893 27794 tablet_bootstrap.cc:492] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:42.617863 27793 tablet_bootstrap.cc:654] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.618104 27794 tablet_bootstrap.cc:654] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.617817 27802 raft_consensus.cc:493] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.619298 27802 raft_consensus.cc:515] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.621490 27802 leader_election.cc:290] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:42.623095 27836 consensus_queue.cc:1048] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:42.623682 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304ee4c1b5cd4dcf992f38355c86bb62" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:42.624307 27527 raft_consensus.cc:2468] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:42.624984 27795 tablet_bootstrap.cc:492] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:42.625449 27795 ts_tablet_manager.cc:1403] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.015s
I20260709 12:19:42.627282 27642 leader_election.cc:304] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:42.628842 27811 raft_consensus.cc:493] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.630599 27811 raft_consensus.cc:515] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.630826 27802 consensus_queue.cc:1048] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:42.631759 27424 catalog_manager.cc:5697] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:42.632735 27811 leader_election.cc:290] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:42.633980 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:42.634410 27846 raft_consensus.cc:493] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.634943 27846 raft_consensus.cc:515] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.632419 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304ee4c1b5cd4dcf992f38355c86bb62" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:42.635365 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:42.636827 27795 raft_consensus.cc:359] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.637274 27600 raft_consensus.cc:2468] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:42.636569 27801 raft_consensus.cc:493] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.638469 27801 raft_consensus.cc:515] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.637533 27795 raft_consensus.cc:385] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.639370 27795 raft_consensus.cc:740] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.630782 27836 raft_consensus.cc:2804] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.641268 27836 raft_consensus.cc:493] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.641069 27492 leader_election.cc:304] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:42.641660 27836 raft_consensus.cc:3060] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.640942 27795 consensus_queue.cc:260] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.643750 27749 raft_consensus.cc:2468] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
W20260709 12:19:42.679888 27878 log.cc:927] Time spent T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:19:42.682855 27601 raft_consensus.cc:2468] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:42.715094 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:42.720522 27811 raft_consensus.cc:2804] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.721017 27811 raft_consensus.cc:493] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.721352 27811 raft_consensus.cc:3060] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.721704 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:42.725981 27792 raft_consensus.cc:359] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.726999 27792 raft_consensus.cc:385] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.727258 27792 raft_consensus.cc:740] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.729667 27792 consensus_queue.cc:260] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:42.731849 27795 ts_tablet_manager.cc:1434] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.106s	user 0.015s	sys 0.028s
I20260709 12:19:42.732818 27795 tablet_bootstrap.cc:492] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:42.731053 27846 leader_election.cc:290] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:42.737010 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:42.737645 27601 raft_consensus.cc:2468] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:42.738535 27795 tablet_bootstrap.cc:654] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.738775 27715 leader_election.cc:304] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:42.739907 27846 raft_consensus.cc:2804] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.740283 27846 raft_consensus.cc:493] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.740619 27846 raft_consensus.cc:3060] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.740513 27811 raft_consensus.cc:515] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.741966 27527 raft_consensus.cc:2393] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate de15618bc48545b6986320ca2292fc60 in this term.
I20260709 12:19:42.742950 27811 leader_election.cc:290] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:42.743480 27811 raft_consensus.cc:493] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.743885 27811 raft_consensus.cc:515] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.745689 27811 leader_election.cc:290] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:42.754138 27836 raft_consensus.cc:515] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.756614 27792 ts_tablet_manager.cc:1434] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.156s	user 0.011s	sys 0.002s
I20260709 12:19:42.768656 27836 leader_election.cc:290] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:42.769375 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304ee4c1b5cd4dcf992f38355c86bb62" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:42.769878 27527 raft_consensus.cc:3060] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.770228 27793 tablet_bootstrap.cc:492] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:42.770720 27793 ts_tablet_manager.cc:1403] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.163s	user 0.006s	sys 0.008s
I20260709 12:19:42.771688 27792 tablet_bootstrap.cc:492] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
W20260709 12:19:42.720642 27492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:38235, user_credentials={real_user=slave}} blocked reactor thread for 79718.9us
I20260709 12:19:42.775595 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:42.776227 27602 raft_consensus.cc:3060] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.780071 27750 raft_consensus.cc:3060] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.783574 27794 tablet_bootstrap.cc:492] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:42.781152 27801 leader_election.cc:290] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:42.785120 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:42.787823 27526 raft_consensus.cc:2393] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:42.788357 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:42.789022 27716 leader_election.cc:304] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:42.791294 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53924e99bd64e01be6cf5fbd86a0abc" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:42.792004 27601 raft_consensus.cc:2468] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:42.792318 27527 raft_consensus.cc:2468] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:42.793637 27642 leader_election.cc:304] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:42.785305 27846 raft_consensus.cc:515] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.786361 27794 ts_tablet_manager.cc:1403] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.174s	user 0.061s	sys 0.045s
I20260709 12:19:42.786871 27795 tablet_bootstrap.cc:492] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:42.800554 27795 ts_tablet_manager.cc:1403] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.012s
I20260709 12:19:42.793730 27492 leader_election.cc:304] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:42.809489 27795 raft_consensus.cc:359] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.810220 27795 raft_consensus.cc:385] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.810494 27795 raft_consensus.cc:740] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.807019 27811 raft_consensus.cc:2804] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.812403 27811 raft_consensus.cc:493] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.812903 27811 raft_consensus.cc:3060] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.812433 27795 consensus_queue.cc:260] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.815014 27795 ts_tablet_manager.cc:1434] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:42.814882 27602 raft_consensus.cc:2468] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:42.816203 27795 tablet_bootstrap.cc:492] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:42.816216 27749 raft_consensus.cc:2393] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate de15618bc48545b6986320ca2292fc60 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:42.818926 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:42.818742 27802 raft_consensus.cc:2804] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:42.819682 27601 raft_consensus.cc:2393] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate de15618bc48545b6986320ca2292fc60 in this term.
I20260709 12:19:42.824230 27793 raft_consensus.cc:359] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:42.832444 27793 raft_consensus.cc:385] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.832664 27793 raft_consensus.cc:740] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.833477 27792 tablet_bootstrap.cc:654] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.833117 27793 consensus_queue.cc:260] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
W20260709 12:19:42.811829 27641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:38235, user_credentials={real_user=slave}} blocked reactor thread for 51187.2us
I20260709 12:19:42.820196 27846 leader_election.cc:290] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:42.836333 27801 raft_consensus.cc:2749] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:42.836731 27793 ts_tablet_manager.cc:1434] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 12:19:42.822551 27492 leader_election.cc:304] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: be117ea016214236abda478b04f7f70c
I20260709 12:19:42.821998 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:42.844061 27527 raft_consensus.cc:2393] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate de15618bc48545b6986320ca2292fc60 in this term.
W20260709 12:19:42.842594 27473 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:42.845265 27888 raft_consensus.cc:2804] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:42.845726 27888 raft_consensus.cc:697] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:42.842991 27795 tablet_bootstrap.cc:654] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.847126 27793 tablet_bootstrap.cc:492] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:42.848239 27888 consensus_queue.cc:237] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.849004 27716 leader_election.cc:304] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:19:42.853433 27811 raft_consensus.cc:515] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.835523 27802 raft_consensus.cc:697] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:42.859308 27802 consensus_queue.cc:237] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.859653 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304ee4c1b5cd4dcf992f38355c86bb62" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:42.855644 27811 leader_election.cc:290] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:42.870151 27601 raft_consensus.cc:3060] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.862406 27846 consensus_queue.cc:1048] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:19:42.860913 27673 raft_consensus.cc:3060] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.857497 27801 raft_consensus.cc:2749] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:42.879015 27793 tablet_bootstrap.cc:654] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.881256 27794 raft_consensus.cc:359] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.881752 27794 raft_consensus.cc:385] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.881942 27794 raft_consensus.cc:740] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.888079 27601 raft_consensus.cc:2468] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:42.888522 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53924e99bd64e01be6cf5fbd86a0abc" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:42.889142 27674 raft_consensus.cc:3060] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:42.882702 27492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:38235, user_credentials={real_user=slave}} blocked reactor thread for 59709.4us
I20260709 12:19:42.891891 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53924e99bd64e01be6cf5fbd86a0abc" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:42.892474 27601 raft_consensus.cc:3060] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.888058 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53924e99bd64e01be6cf5fbd86a0abc" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:42.895161 27794 consensus_queue.cc:260] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.897480 27794 ts_tablet_manager.cc:1434] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.097s	user 0.003s	sys 0.002s
I20260709 12:19:42.897675 27674 raft_consensus.cc:2468] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:42.898375 27794 tablet_bootstrap.cc:492] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:42.899051 27491 leader_election.cc:304] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:42.865458 27891 consensus_queue.cc:1048] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:19:42.900079 27836 consensus_queue.cc:1048] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:42.900297 27894 raft_consensus.cc:2804] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:42.900950 27894 raft_consensus.cc:697] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:42.902688 27894 consensus_queue.cc:237] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.913193 27792 tablet_bootstrap.cc:492] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:42.914443 27792 ts_tablet_manager.cc:1403] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.148s	user 0.019s	sys 0.000s
I20260709 12:19:42.905306 27601 raft_consensus.cc:2468] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:42.925165 27801 consensus_queue.cc:1048] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:42.933696 27792 raft_consensus.cc:359] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.934535 27792 raft_consensus.cc:385] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.934028 27422 catalog_manager.cc:5697] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:42.935389 27792 raft_consensus.cc:740] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.937040 27792 consensus_queue.cc:260] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.942600 27795 tablet_bootstrap.cc:492] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:42.943235 27795 ts_tablet_manager.cc:1403] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.127s	user 0.028s	sys 0.007s
I20260709 12:19:42.943337 27793 tablet_bootstrap.cc:492] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:42.943915 27793 ts_tablet_manager.cc:1403] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.008s
I20260709 12:19:42.946815 27793 raft_consensus.cc:359] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.940448 27800 raft_consensus.cc:493] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.947666 27793 raft_consensus.cc:385] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.948506 27793 raft_consensus.cc:740] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.948261 27800 raft_consensus.cc:515] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.949342 27793 consensus_queue.cc:260] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:42.950544 27800 leader_election.cc:290] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:42.951728 27793 ts_tablet_manager.cc:1434] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:19:42.951713 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e71c9ead48ec81fc9271d7844e53" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:42.954278 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e71c9ead48ec81fc9271d7844e53" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:42.958060 27749 raft_consensus.cc:2468] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:42.959230 27802 raft_consensus.cc:493] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.959720 27802 raft_consensus.cc:515] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:42.961696 27802 leader_election.cc:290] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:42.967422 27793 tablet_bootstrap.cc:492] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:42.968719 27792 ts_tablet_manager.cc:1434] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 12:19:42.969697 27792 tablet_bootstrap.cc:492] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:42.972611 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4c36c14e1343f2a56f2fd93787f29b" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:42.974155 27642 leader_election.cc:343] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.982576 27792 tablet_bootstrap.cc:654] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.975520 27566 leader_election.cc:304] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:42.986682 27794 tablet_bootstrap.cc:654] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.989815 27425 catalog_manager.cc:5697] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:42.988391 27568 leader_election.cc:343] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.995525 27793 tablet_bootstrap.cc:654] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.989272 27800 raft_consensus.cc:2804] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.999718 27800 raft_consensus.cc:493] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.000334 27800 raft_consensus.cc:3060] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.003762 27795 raft_consensus.cc:359] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.004500 27795 raft_consensus.cc:385] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.004755 27795 raft_consensus.cc:740] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.005519 27795 consensus_queue.cc:260] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.007443 27857 consensus_queue.cc:1048] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.007714 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4c36c14e1343f2a56f2fd93787f29b" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:43.008387 27601 raft_consensus.cc:2468] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:43.011332 27800 raft_consensus.cc:515] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.011492 27641 leader_election.cc:304] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.012671 27802 raft_consensus.cc:2804] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.014170 27802 raft_consensus.cc:493] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.014544 27802 raft_consensus.cc:3060] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.999473 27894 raft_consensus.cc:493] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.021716 27795 ts_tablet_manager.cc:1434] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.002s
I20260709 12:19:43.022586 27795 tablet_bootstrap.cc:492] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.031471 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e71c9ead48ec81fc9271d7844e53" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:43.032725 27857 consensus_queue.cc:1048] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.032719 27748 raft_consensus.cc:3060] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.022437 27894 raft_consensus.cc:515] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.035634 27527 raft_consensus.cc:3060] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.038003 27802 raft_consensus.cc:515] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.040726 27894 leader_election.cc:290] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:43.032851 27801 consensus_queue.cc:1048] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.042627 27802 leader_election.cc:290] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:43.047978 27747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab21d2c166f4303beb2fa0bbc3868cc" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.049186 27425 catalog_manager.cc:5697] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.051084 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab21d2c166f4303beb2fa0bbc3868cc" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:43.051424 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4c36c14e1343f2a56f2fd93787f29b" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:43.051983 27601 raft_consensus.cc:3060] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:43.052700 27714 consensus_peers.cc:597] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c -> Peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Couldn't send request to peer 2e2faf2971ea4c7ab7f426935b9e6d96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:43.052970 27748 raft_consensus.cc:2468] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:43.053478 27492 leader_election.cc:304] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:43.055477 27566 leader_election.cc:304] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:43.057081 27857 raft_consensus.cc:2804] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.057590 27857 raft_consensus.cc:697] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:43.065593 27857 consensus_queue.cc:237] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.066587 27792 tablet_bootstrap.cc:492] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:43.067160 27792 ts_tablet_manager.cc:1403] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.098s	user 0.017s	sys 0.001s
I20260709 12:19:43.071507 27792 raft_consensus.cc:359] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.072149 27792 raft_consensus.cc:385] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.072424 27792 raft_consensus.cc:740] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.073200 27792 consensus_queue.cc:260] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.049991 27525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4c36c14e1343f2a56f2fd93787f29b" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
W20260709 12:19:43.077523 27642 leader_election.cc:343] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.076152 27792 ts_tablet_manager.cc:1434] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:19:43.079703 27792 tablet_bootstrap.cc:492] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:43.089378 27793 tablet_bootstrap.cc:492] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:43.089879 27793 ts_tablet_manager.cc:1403] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.133s	user 0.002s	sys 0.010s
I20260709 12:19:43.090346 27795 tablet_bootstrap.cc:654] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.091497 27525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e71c9ead48ec81fc9271d7844e53" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:43.092541 27793 raft_consensus.cc:359] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.094089 27793 raft_consensus.cc:385] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.094300 27793 raft_consensus.cc:740] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.081966 27800 leader_election.cc:290] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.095304 27793 consensus_queue.cc:260] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.102937 27890 consensus_queue.cc:1048] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:43.107216 27568 leader_election.cc:343] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.112159 27601 raft_consensus.cc:2468] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:43.113436 27641 leader_election.cc:304] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.114614 27890 raft_consensus.cc:2804] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.115136 27890 raft_consensus.cc:697] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:43.116022 27890 consensus_queue.cc:237] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.122089 27424 catalog_manager.cc:5697] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.127554 27793 ts_tablet_manager.cc:1434] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:19:43.128499 27793 tablet_bootstrap.cc:492] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:43.128655 27792 tablet_bootstrap.cc:654] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.146500 27795 tablet_bootstrap.cc:492] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.147013 27795 ts_tablet_manager.cc:1403] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.125s	user 0.043s	sys 0.017s
I20260709 12:19:43.148741 27794 tablet_bootstrap.cc:492] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:43.149333 27794 ts_tablet_manager.cc:1403] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.251s	user 0.018s	sys 0.011s
I20260709 12:19:43.153110 27794 raft_consensus.cc:359] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.155858 27525 raft_consensus.cc:3060] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.161865 27794 raft_consensus.cc:385] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.162194 27794 raft_consensus.cc:740] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.162890 27794 consensus_queue.cc:260] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.165114 27794 ts_tablet_manager.cc:1434] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:19:43.159772 27425 catalog_manager.cc:5697] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.160840 27795 raft_consensus.cc:359] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.166014 27794 tablet_bootstrap.cc:492] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:43.166054 27795 raft_consensus.cc:385] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.166479 27795 raft_consensus.cc:740] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.167169 27795 consensus_queue.cc:260] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.167595 27888 raft_consensus.cc:2749] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.169189 27795 ts_tablet_manager.cc:1434] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:19:43.170050 27795 tablet_bootstrap.cc:492] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.172288 27794 tablet_bootstrap.cc:654] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.176379 27795 tablet_bootstrap.cc:654] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.190025 27890 consensus_queue.cc:1048] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:43.201440 27794 tablet_bootstrap.cc:492] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:43.201726 27795 tablet_bootstrap.cc:492] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.201941 27794 ts_tablet_manager.cc:1403] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.019s
I20260709 12:19:43.202351 27795 ts_tablet_manager.cc:1403] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.012s
I20260709 12:19:43.204761 27794 raft_consensus.cc:359] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.204990 27795 raft_consensus.cc:359] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.205466 27794 raft_consensus.cc:385] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.205860 27795 raft_consensus.cc:385] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.205899 27794 raft_consensus.cc:740] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.206362 27795 raft_consensus.cc:740] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.206768 27794 consensus_queue.cc:260] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.207113 27795 consensus_queue.cc:260] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.209162 27795 ts_tablet_manager.cc:1434] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:43.209995 27795 tablet_bootstrap.cc:492] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.211242 27793 tablet_bootstrap.cc:654] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.215622 27795 tablet_bootstrap.cc:654] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.216096 27794 ts_tablet_manager.cc:1434] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:43.217070 27794 tablet_bootstrap.cc:492] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:43.217968 27792 tablet_bootstrap.cc:492] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:43.218619 27792 ts_tablet_manager.cc:1403] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.002s
I20260709 12:19:43.221489 27792 raft_consensus.cc:359] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.223220 27792 raft_consensus.cc:385] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.223587 27792 raft_consensus.cc:740] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.224226 27792 consensus_queue.cc:260] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.222398 27794 tablet_bootstrap.cc:654] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.226150 27792 ts_tablet_manager.cc:1434] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:19:43.230167 27800 raft_consensus.cc:493] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.230683 27800 raft_consensus.cc:515] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.232451 27795 tablet_bootstrap.cc:492] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.232918 27793 tablet_bootstrap.cc:492] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:43.233408 27793 ts_tablet_manager.cc:1403] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.002s
I20260709 12:19:43.234158 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a11bd7b16c4cf7bbfcecc5fa6170e7" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.235523 27792 tablet_bootstrap.cc:492] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
W20260709 12:19:43.235746 27568 leader_election.cc:343] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.236786 27800 leader_election.cc:290] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:43.238368 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a11bd7b16c4cf7bbfcecc5fa6170e7" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:43.241652 27792 tablet_bootstrap.cc:654] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:43.242795 27566 leader_election.cc:343] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.243327 27566 leader_election.cc:304] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.244172 27793 raft_consensus.cc:359] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.244489 27794 tablet_bootstrap.cc:492] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:43.244402 27800 raft_consensus.cc:2749] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.245162 27794 ts_tablet_manager.cc:1403] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 12:19:43.244853 27793 raft_consensus.cc:385] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.245707 27793 raft_consensus.cc:740] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.246378 27793 consensus_queue.cc:260] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.248229 27794 raft_consensus.cc:359] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.232929 27795 ts_tablet_manager.cc:1403] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 12:19:43.248646 27793 ts_tablet_manager.cc:1434] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:19:43.249070 27794 raft_consensus.cc:385] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.249434 27794 raft_consensus.cc:740] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.250061 27793 tablet_bootstrap.cc:492] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:43.250154 27794 consensus_queue.cc:260] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.251485 27795 raft_consensus.cc:359] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.252130 27795 raft_consensus.cc:385] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.252369 27795 raft_consensus.cc:740] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.253129 27795 consensus_queue.cc:260] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.255350 27795 ts_tablet_manager.cc:1434] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:19:43.256227 27794 ts_tablet_manager.cc:1434] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:43.256271 27795 tablet_bootstrap.cc:492] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.257447 27794 tablet_bootstrap.cc:492] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:43.262569 27795 tablet_bootstrap.cc:654] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.264173 27801 raft_consensus.cc:493] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.264775 27794 tablet_bootstrap.cc:654] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.264665 27801 raft_consensus.cc:515] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.266868 27801 leader_election.cc:290] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:43.268831 27793 tablet_bootstrap.cc:654] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.269430 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae19825ecd9430ebb84254135a9b43d" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.270794 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae19825ecd9430ebb84254135a9b43d" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
W20260709 12:19:43.272950 27715 leader_election.cc:343] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.273262 27890 raft_consensus.cc:493] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.273793 27890 raft_consensus.cc:515] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
W20260709 12:19:43.274135 27716 leader_election.cc:343] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.274727 27795 tablet_bootstrap.cc:492] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.274631 27716 leader_election.cc:304] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.275823 27890 leader_election.cc:290] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:43.275931 27887 raft_consensus.cc:2749] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.277683 27795 ts_tablet_manager.cc:1403] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:19:43.278203 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27eb2f13d7e642e9b623762ab04241c0" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:43.278208 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27eb2f13d7e642e9b623762ab04241c0" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.281885 27640 leader_election.cc:304] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:43.282727 27792 tablet_bootstrap.cc:492] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:43.282972 27890 raft_consensus.cc:2749] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.283504 27792 ts_tablet_manager.cc:1403] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.002s
I20260709 12:19:43.283619 27795 raft_consensus.cc:359] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.284299 27795 raft_consensus.cc:385] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.284552 27795 raft_consensus.cc:740] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.286350 27792 raft_consensus.cc:359] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.287024 27794 tablet_bootstrap.cc:492] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:43.286826 27795 consensus_queue.cc:260] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.287583 27794 ts_tablet_manager.cc:1403] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.003s
I20260709 12:19:43.288479 27793 tablet_bootstrap.cc:492] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:43.288929 27795 ts_tablet_manager.cc:1434] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:19:43.288933 27793 ts_tablet_manager.cc:1403] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.008s
I20260709 12:19:43.290158 27794 raft_consensus.cc:359] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.290539 27795 tablet_bootstrap.cc:492] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.290827 27794 raft_consensus.cc:385] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.291169 27794 raft_consensus.cc:740] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.291709 27793 raft_consensus.cc:359] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.291924 27794 consensus_queue.cc:260] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.292371 27793 raft_consensus.cc:385] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.289299 27792 raft_consensus.cc:385] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.292897 27792 raft_consensus.cc:740] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.293685 27792 consensus_queue.cc:260] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.294273 27794 ts_tablet_manager.cc:1434] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:43.294636 27793 raft_consensus.cc:740] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.295686 27794 tablet_bootstrap.cc:492] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:43.296700 27795 tablet_bootstrap.cc:654] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.301204 27793 consensus_queue.cc:260] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.303365 27793 ts_tablet_manager.cc:1434] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:43.304289 27793 tablet_bootstrap.cc:492] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:43.308276 27800 raft_consensus.cc:493] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.308782 27800 raft_consensus.cc:515] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.309695 27794 tablet_bootstrap.cc:654] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.311616 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2259e0eb900541c7b9d47a4406bce163" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:43.313133 27568 leader_election.cc:343] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.313431 27793 tablet_bootstrap.cc:654] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.310851 27800 leader_election.cc:290] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:43.315894 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2259e0eb900541c7b9d47a4406bce163" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:43.307896 27795 tablet_bootstrap.cc:492] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.317174 27795 ts_tablet_manager.cc:1403] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.003s
W20260709 12:19:43.317301 27566 leader_election.cc:343] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.317770 27566 leader_election.cc:304] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.318495 27800 raft_consensus.cc:2749] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.320760 27795 raft_consensus.cc:359] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.321406 27795 raft_consensus.cc:385] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.321661 27795 raft_consensus.cc:740] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.322464 27795 consensus_queue.cc:260] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.323668 27792 ts_tablet_manager.cc:1434] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:19:43.324635 27795 ts_tablet_manager.cc:1434] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:43.325852 27795 tablet_bootstrap.cc:492] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.327440 27792 tablet_bootstrap.cc:492] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:43.329867 27888 consensus_queue.cc:1048] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.331646 27795 tablet_bootstrap.cc:654] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.334403 27888 raft_consensus.cc:493] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.334937 27888 raft_consensus.cc:515] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.338008 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e71c9ead48ec81fc9271d7844e53" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.338922 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8153e71c9ead48ec81fc9271d7844e53" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:43.342037 27888 leader_election.cc:290] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:43.345068 27803 raft_consensus.cc:493] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.345604 27803 raft_consensus.cc:515] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.338753 27750 raft_consensus.cc:2393] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de15618bc48545b6986320ca2292fc60 in current term 1: Already voted for candidate aee9fc0a34154b1d81b6ad3393c17b67 in this term.
I20260709 12:19:43.348531 27795 tablet_bootstrap.cc:492] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.349002 27795 ts_tablet_manager.cc:1403] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.009s
I20260709 12:19:43.349300 27491 leader_election.cc:304] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:43.351029 27803 leader_election.cc:290] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:43.351194 27888 raft_consensus.cc:3060] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.351655 27795 raft_consensus.cc:359] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.352504 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8567b5a62d02414f90f1c2141914a76b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:43.352833 27795 raft_consensus.cc:385] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.352890 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8567b5a62d02414f90f1c2141914a76b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:43.353189 27795 raft_consensus.cc:740] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.354194 27795 consensus_queue.cc:260] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.353206 27601 raft_consensus.cc:2468] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
W20260709 12:19:43.354661 27714 leader_election.cc:343] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.356367 27795 ts_tablet_manager.cc:1434] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:43.356199 27715 leader_election.cc:304] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:43.357304 27795 tablet_bootstrap.cc:492] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.357475 27803 raft_consensus.cc:2804] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.357890 27803 raft_consensus.cc:493] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.358229 27803 raft_consensus.cc:3060] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.359964 27792 tablet_bootstrap.cc:654] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.360932 27794 tablet_bootstrap.cc:492] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:43.361405 27794 ts_tablet_manager.cc:1403] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.066s	user 0.003s	sys 0.014s
I20260709 12:19:43.364108 27794 raft_consensus.cc:359] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.364738 27794 raft_consensus.cc:385] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.365010 27794 raft_consensus.cc:740] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.365641 27794 consensus_queue.cc:260] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.367786 27794 ts_tablet_manager.cc:1434] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:19:43.368690 27794 tablet_bootstrap.cc:492] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:43.372134 27793 tablet_bootstrap.cc:492] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:43.372664 27793 ts_tablet_manager.cc:1403] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.069s	user 0.032s	sys 0.011s
I20260709 12:19:43.375272 27795 tablet_bootstrap.cc:654] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.375417 27793 raft_consensus.cc:359] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.376178 27793 raft_consensus.cc:385] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.376458 27793 raft_consensus.cc:740] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.377130 27793 consensus_queue.cc:260] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.377453 27894 consensus_queue.cc:1048] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.379271 27793 ts_tablet_manager.cc:1434] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:43.378983 27803 raft_consensus.cc:515] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.380220 27793 tablet_bootstrap.cc:492] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:43.380857 27795 tablet_bootstrap.cc:492] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.381371 27795 ts_tablet_manager.cc:1403] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 12:19:43.382047 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8567b5a62d02414f90f1c2141914a76b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:43.382591 27890 raft_consensus.cc:493] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.383092 27890 raft_consensus.cc:515] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
W20260709 12:19:43.383512 27714 leader_election.cc:343] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.384336 27803 leader_election.cc:290] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:43.384454 27888 raft_consensus.cc:2749] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.385182 27890 leader_election.cc:290] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.385922 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8567b5a62d02414f90f1c2141914a76b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:43.386255 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c35d6286faf45d4af1a9dfcd42a2819" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.386507 27601 raft_consensus.cc:3060] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.386996 27527 raft_consensus.cc:2468] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:43.387229 27795 raft_consensus.cc:359] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.388298 27642 leader_election.cc:304] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:43.388881 27795 raft_consensus.cc:385] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.389508 27795 raft_consensus.cc:740] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.389762 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c35d6286faf45d4af1a9dfcd42a2819" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.390534 27794 tablet_bootstrap.cc:654] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.391003 27749 raft_consensus.cc:2468] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:43.391355 27795 consensus_queue.cc:260] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.390992 27890 raft_consensus.cc:2804] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.392750 27792 tablet_bootstrap.cc:492] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:43.393323 27792 ts_tablet_manager.cc:1403] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.006s
I20260709 12:19:43.393936 27795 ts_tablet_manager.cc:1434] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:19:43.394922 27795 tablet_bootstrap.cc:492] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.397378 27793 tablet_bootstrap.cc:654] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.397908 27890 raft_consensus.cc:493] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.398311 27890 raft_consensus.cc:3060] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.400539 27795 tablet_bootstrap.cc:654] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.401163 27792 raft_consensus.cc:359] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.401845 27792 raft_consensus.cc:385] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.402104 27792 raft_consensus.cc:740] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.402859 27792 consensus_queue.cc:260] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.409797 27793 tablet_bootstrap.cc:492] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:43.410338 27793 ts_tablet_manager.cc:1403] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.002s
I20260709 12:19:43.412313 27792 ts_tablet_manager.cc:1434] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:19:43.413291 27792 tablet_bootstrap.cc:492] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:43.416740 27601 raft_consensus.cc:2468] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:43.417338 27793 raft_consensus.cc:359] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.418035 27715 leader_election.cc:304] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:43.419278 27803 raft_consensus.cc:2804] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.419440 27792 tablet_bootstrap.cc:654] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.419796 27803 raft_consensus.cc:697] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:43.421113 27803 consensus_queue.cc:237] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.418008 27793 raft_consensus.cc:385] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.422055 27793 raft_consensus.cc:740] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.423616 27793 consensus_queue.cc:260] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.426299 27795 tablet_bootstrap.cc:492] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.426893 27795 ts_tablet_manager.cc:1403] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.009s
I20260709 12:19:43.428124 27793 ts_tablet_manager.cc:1434] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 12:19:43.429049 27793 tablet_bootstrap.cc:492] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:43.430004 27800 raft_consensus.cc:493] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.430469 27800 raft_consensus.cc:515] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.432426 27800 leader_election.cc:290] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:43.434188 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc249d99a354b2ba8dfb84856dbbb01" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.434800 27749 raft_consensus.cc:2468] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:43.435148 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc249d99a354b2ba8dfb84856dbbb01" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:43.436556 27566 leader_election.cc:343] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.436594 27895 consensus_queue.cc:1048] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:43.437477 27566 leader_election.cc:304] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:43.438266 27800 raft_consensus.cc:2804] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.438613 27800 raft_consensus.cc:493] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.440584 27800 raft_consensus.cc:3060] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.441430 27793 tablet_bootstrap.cc:654] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.453715 27794 tablet_bootstrap.cc:492] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:43.454233 27794 ts_tablet_manager.cc:1403] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.028s
I20260709 12:19:43.457015 27794 raft_consensus.cc:359] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.457705 27794 raft_consensus.cc:385] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.457873 27794 raft_consensus.cc:740] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.458981 27794 consensus_queue.cc:260] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.466495 27795 raft_consensus.cc:359] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.467269 27795 raft_consensus.cc:385] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.467525 27795 raft_consensus.cc:740] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.468173 27795 consensus_queue.cc:260] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.469422 27895 consensus_queue.cc:1048] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.470293 27890 raft_consensus.cc:515] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.470430 27425 catalog_manager.cc:5697] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.472783 27890 leader_election.cc:290] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.472956 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c35d6286faf45d4af1a9dfcd42a2819" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:43.458755 27800 raft_consensus.cc:515] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.473538 27749 raft_consensus.cc:3060] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.473804 27525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c35d6286faf45d4af1a9dfcd42a2819" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:43.474390 27525 raft_consensus.cc:3060] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.475023 27800 leader_election.cc:290] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:43.478510 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc249d99a354b2ba8dfb84856dbbb01" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:43.479103 27750 raft_consensus.cc:3060] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.476744 27794 ts_tablet_manager.cc:1434] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:19:43.481357 27820 raft_consensus.cc:493] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.481962 27794 tablet_bootstrap.cc:492] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:43.481799 27820 raft_consensus.cc:515] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.485150 27795 ts_tablet_manager.cc:1434] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 12:19:43.485905 27795 tablet_bootstrap.cc:492] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.488759 27793 tablet_bootstrap.cc:492] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:43.489228 27793 ts_tablet_manager.cc:1403] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.007s
I20260709 12:19:43.491127 27792 tablet_bootstrap.cc:492] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:43.490980 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc249d99a354b2ba8dfb84856dbbb01" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:43.491673 27888 consensus_queue.cc:1048] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.492168 27820 leader_election.cc:290] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.491914 27793 raft_consensus.cc:359] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.492640 27793 raft_consensus.cc:385] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.493302 27525 raft_consensus.cc:2468] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:43.492908 27793 raft_consensus.cc:740] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.494447 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae19825ecd9430ebb84254135a9b43d" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.495198 27674 raft_consensus.cc:3060] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.495406 27793 consensus_queue.cc:260] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
W20260709 12:19:43.496109 27566 leader_election.cc:343] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.497447 27793 ts_tablet_manager.cc:1434] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:43.498340 27793 tablet_bootstrap.cc:492] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:43.494482 27792 ts_tablet_manager.cc:1403] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.004s
I20260709 12:19:43.507772 27857 consensus_queue.cc:1048] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.507951 27642 leader_election.cc:304] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:43.509202 27890 raft_consensus.cc:2804] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.509655 27890 raft_consensus.cc:697] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:43.502976 27749 raft_consensus.cc:2468] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:43.497381 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae19825ecd9430ebb84254135a9b43d" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.515591 27748 raft_consensus.cc:2468] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:43.510463 27890 consensus_queue.cc:237] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.517414 27857 raft_consensus.cc:493] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.517895 27857 raft_consensus.cc:515] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.503189 27526 raft_consensus.cc:2468] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:43.502727 27750 raft_consensus.cc:2468] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:43.534796 27891 raft_consensus.cc:493] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.535199 27566 leader_election.cc:304] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:43.535532 27795 tablet_bootstrap.cc:654] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.535349 27891 raft_consensus.cc:515] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.536131 27820 raft_consensus.cc:2804] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.536538 27820 raft_consensus.cc:493] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.536886 27820 raft_consensus.cc:3060] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.537566 27891 leader_election.cc:290] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:43.541389 27811 consensus_queue.cc:1048] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.543110 27857 leader_election.cc:290] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.543550 27793 tablet_bootstrap.cc:654] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.544370 27811 raft_consensus.cc:493] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.544863 27811 raft_consensus.cc:515] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.551048 27794 tablet_bootstrap.cc:654] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.552551 27811 leader_election.cc:290] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:43.553727 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4c36c14e1343f2a56f2fd93787f29b" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:43.559448 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a11bd7b16c4cf7bbfcecc5fa6170e7" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.559712 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fecbf499aff740c39b815de4701ab51b" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.560240 27523 raft_consensus.cc:2468] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:43.562038 27642 leader_election.cc:304] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:43.563225 27836 raft_consensus.cc:2804] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.563591 27836 raft_consensus.cc:493] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.563901 27836 raft_consensus.cc:3060] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.555099 27566 leader_election.cc:304] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:43.565008 27857 raft_consensus.cc:2804] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.565492 27857 raft_consensus.cc:697] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:43.566300 27857 consensus_queue.cc:237] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.566634 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a11bd7b16c4cf7bbfcecc5fa6170e7" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:43.567278 27600 raft_consensus.cc:2468] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:43.569015 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4c36c14e1343f2a56f2fd93787f29b" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:43.569841 27602 raft_consensus.cc:2393] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de15618bc48545b6986320ca2292fc60 in current term 1: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:43.570672 27803 raft_consensus.cc:493] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.571306 27891 raft_consensus.cc:493] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.571190 27803 raft_consensus.cc:515] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.571820 27891 raft_consensus.cc:515] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.573825 27891 leader_election.cc:290] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.569058 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fecbf499aff740c39b815de4701ab51b" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.575354 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.575593 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:43.576015 27526 raft_consensus.cc:2468] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:43.576238 27676 raft_consensus.cc:2468] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:43.576495 27803 leader_election.cc:290] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.574483 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.577263 27748 raft_consensus.cc:2468] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:43.577389 27642 leader_election.cc:304] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:43.576095 27836 raft_consensus.cc:515] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.575920 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.590925 27714 leader_election.cc:304] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:43.589449 27802 raft_consensus.cc:2804] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.592273 27802 raft_consensus.cc:493] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.592383 27801 raft_consensus.cc:2804] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.592669 27802 raft_consensus.cc:3060] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.594813 27801 raft_consensus.cc:493] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.595000 27523 raft_consensus.cc:2468] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:43.595253 27801 raft_consensus.cc:3060] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.587977 27803 raft_consensus.cc:493] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.596153 27803 raft_consensus.cc:515] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.598168 27803 leader_election.cc:290] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:43.600946 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a11bd7b16c4cf7bbfcecc5fa6170e7" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:43.601531 27523 raft_consensus.cc:3060] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.601771 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:43.566533 27566 leader_election.cc:343] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:43.603122 27716 leader_election.cc:343] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:43.603719 27568 leader_election.cc:343] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.604588 27568 leader_election.cc:304] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.605178 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a11bd7b16c4cf7bbfcecc5fa6170e7" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:43.590160 27792 raft_consensus.cc:359] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.608904 27792 raft_consensus.cc:385] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.609208 27792 raft_consensus.cc:740] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.609918 27792 consensus_queue.cc:260] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.612082 27792 ts_tablet_manager.cc:1434] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 12:19:43.583479 27836 leader_election.cc:290] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:43.616091 27802 raft_consensus.cc:515] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.617337 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:43.618011 27599 raft_consensus.cc:2468] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:43.618995 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:43.611651 27600 raft_consensus.cc:3060] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.611615 27492 leader_election.cc:304] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67
I20260709 12:19:43.619069 27820 raft_consensus.cc:515] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.623960 27811 raft_consensus.cc:3060] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.625267 27820 leader_election.cc:290] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.627144 27802 leader_election.cc:290] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.628075 27792 tablet_bootstrap.cc:492] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:43.629159 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:43.629748 27524 raft_consensus.cc:3060] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.631880 27600 raft_consensus.cc:2468] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:43.635004 27523 raft_consensus.cc:2468] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:43.636163 27642 leader_election.cc:304] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:43.636317 27795 tablet_bootstrap.cc:492] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.638440 27795 ts_tablet_manager.cc:1403] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.007s
I20260709 12:19:43.638787 27524 raft_consensus.cc:2468] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:43.602476 27801 raft_consensus.cc:515] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.639923 27750 raft_consensus.cc:2393] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:43.640763 27811 raft_consensus.cc:2749] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.633699 27425 catalog_manager.cc:5697] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.643055 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:43.644207 27675 raft_consensus.cc:2393] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:43.645135 27792 tablet_bootstrap.cc:654] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.647111 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:43.651254 27891 raft_consensus.cc:2804] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.651749 27891 raft_consensus.cc:697] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:43.651957 27800 raft_consensus.cc:493] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.652546 27800 raft_consensus.cc:515] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.659406 27795 raft_consensus.cc:359] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.660614 27795 raft_consensus.cc:385] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.648764 27801 leader_election.cc:290] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.661031 27795 raft_consensus.cc:740] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.662108 27793 tablet_bootstrap.cc:492] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:43.662495 27793 ts_tablet_manager.cc:1403] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.004s
I20260709 12:19:43.661451 27951 raft_consensus.cc:2749] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.661769 27524 raft_consensus.cc:2393] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:43.652591 27891 consensus_queue.cc:237] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.657156 27642 leader_election.cc:304] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: be117ea016214236abda478b04f7f70c
I20260709 12:19:43.671775 27890 raft_consensus.cc:2804] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.672295 27890 raft_consensus.cc:697] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:43.673130 27890 consensus_queue.cc:237] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.675980 27800 leader_election.cc:290] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.684967 27716 leader_election.cc:304] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.686264 27803 raft_consensus.cc:2749] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.686825 27836 consensus_queue.cc:1048] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:43.693763 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae19825ecd9430ebb84254135a9b43d" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:43.694450 27750 raft_consensus.cc:3060] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.699177 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.699820 27748 raft_consensus.cc:2468] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:43.704439 27836 consensus_queue.cc:1048] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.704734 27793 raft_consensus.cc:359] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.705493 27793 raft_consensus.cc:385] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.705744 27793 raft_consensus.cc:740] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.706681 27793 consensus_queue.cc:260] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.707731 27750 raft_consensus.cc:2468] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:43.708292 27951 raft_consensus.cc:493] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.708837 27951 raft_consensus.cc:515] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.711179 27795 consensus_queue.cc:260] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.714767 27566 leader_election.cc:304] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:43.717444 27793 ts_tablet_manager.cc:1434] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:19:43.719647 27793 tablet_bootstrap.cc:492] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:43.712338 27568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:34993, user_credentials={real_user=slave}} blocked reactor thread for 92778.2us
I20260709 12:19:43.720602 27795 ts_tablet_manager.cc:1434] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.001s
I20260709 12:19:43.724169 27715 leader_election.cc:304] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.726528 27801 raft_consensus.cc:2804] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.726920 27801 raft_consensus.cc:493] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.727252 27801 raft_consensus.cc:3060] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.718964 27857 consensus_queue.cc:1048] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:19:43.729077 27566 leader_election.cc:304] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:43.733891 27794 tablet_bootstrap.cc:492] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:43.734365 27794 ts_tablet_manager.cc:1403] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.253s	user 0.037s	sys 0.041s
I20260709 12:19:43.723369 27951 leader_election.cc:290] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:43.731662 27857 raft_consensus.cc:2804] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.731184 27955 raft_consensus.cc:2804] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.739050 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae19825ecd9430ebb84254135a9b43d" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:43.742494 27857 raft_consensus.cc:697] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:43.744750 27795 tablet_bootstrap.cc:492] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.747546 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e820d15af94d0d8c63cd76f44ee8ec" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:43.748138 27793 tablet_bootstrap.cc:654] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.749101 27524 raft_consensus.cc:3060] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.751358 27857 consensus_queue.cc:237] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.751516 27422 catalog_manager.cc:5697] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.743436 27955 raft_consensus.cc:493] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.762936 27955 raft_consensus.cc:3060] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.762598 27794 raft_consensus.cc:359] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.763629 27794 raft_consensus.cc:385] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.763963 27794 raft_consensus.cc:740] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.764657 27794 consensus_queue.cc:260] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.765985 27425 catalog_manager.cc:5697] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.766700 27794 ts_tablet_manager.cc:1434] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 12:19:43.768553 27794 tablet_bootstrap.cc:492] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:43.770823 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e820d15af94d0d8c63cd76f44ee8ec" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.771569 27750 raft_consensus.cc:2468] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:43.771241 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.773277 27795 tablet_bootstrap.cc:654] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.775426 27792 tablet_bootstrap.cc:492] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:43.775929 27792 ts_tablet_manager.cc:1403] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.148s	user 0.024s	sys 0.008s
W20260709 12:19:43.778234 27568 leader_election.cc:343] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.779475 27792 raft_consensus.cc:359] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.780179 27792 raft_consensus.cc:385] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.780460 27792 raft_consensus.cc:740] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.794909 27566 leader_election.cc:304] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:43.796139 27801 raft_consensus.cc:515] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.799052 27951 raft_consensus.cc:2804] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.799451 27951 raft_consensus.cc:493] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.783846 27820 raft_consensus.cc:493] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.799816 27951 raft_consensus.cc:3060] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.800123 27820 raft_consensus.cc:515] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.800880 27801 leader_election.cc:290] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:43.802306 27820 leader_election.cc:290] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:43.803246 27795 tablet_bootstrap.cc:492] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.803730 27795 ts_tablet_manager.cc:1403] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.006s
I20260709 12:19:43.799626 27793 tablet_bootstrap.cc:492] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:43.806613 27793 ts_tablet_manager.cc:1403] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.004s
I20260709 12:19:43.806421 27792 consensus_queue.cc:260] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.806886 27951 raft_consensus.cc:515] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.808013 27792 ts_tablet_manager.cc:1434] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:19:43.808804 27951 leader_election.cc:290] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:43.809217 27793 raft_consensus.cc:359] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
W20260709 12:19:43.809566 27566 leader_election.cc:343] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.809875 27793 raft_consensus.cc:385] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.810127 27792 tablet_bootstrap.cc:492] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:43.810185 27793 raft_consensus.cc:740] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.811446 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb38284310a4a308dbb1da8b4325596" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:43.811443 27795 raft_consensus.cc:359] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.812229 27795 raft_consensus.cc:385] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.812507 27795 raft_consensus.cc:740] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.813138 27795 consensus_queue.cc:260] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.813472 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e820d15af94d0d8c63cd76f44ee8ec" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:43.814610 27795 ts_tablet_manager.cc:1434] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.001s
I20260709 12:19:43.815532 27795 tablet_bootstrap.cc:492] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.815429 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e820d15af94d0d8c63cd76f44ee8ec" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:43.816074 27749 raft_consensus.cc:3060] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.809633 27794 tablet_bootstrap.cc:654] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.816542 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:43.818329 27793 consensus_queue.cc:260] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
W20260709 12:19:43.822324 27716 leader_election.cc:343] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.823658 27793 ts_tablet_manager.cc:1434] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:19:43.823535 27749 raft_consensus.cc:2468] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:43.824621 27793 tablet_bootstrap.cc:492] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:43.825156 27795 tablet_bootstrap.cc:654] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.825572 27566 leader_election.cc:304] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:43.826736 27951 raft_consensus.cc:2804] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.827400 27951 raft_consensus.cc:697] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:43.828322 27951 consensus_queue.cc:237] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.831003 27793 tablet_bootstrap.cc:654] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.831931 27955 raft_consensus.cc:515] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.816152 27792 tablet_bootstrap.cc:654] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.787959 27524 raft_consensus.cc:2468] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:43.837791 27955 leader_election.cc:290] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:43.848922 27674 raft_consensus.cc:3060] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.851271 27425 catalog_manager.cc:5697] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:43.840166 27566 leader_election.cc:343] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.853791 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
W20260709 12:19:43.861902 27566 leader_election.cc:343] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.872614 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:43.877736 27601 raft_consensus.cc:2393] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate aee9fc0a34154b1d81b6ad3393c17b67 in this term.
I20260709 12:19:43.881532 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb38284310a4a308dbb1da8b4325596" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:43.882200 27524 raft_consensus.cc:2468] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
W20260709 12:19:43.872740 27568 leader_election.cc:343] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.889585 27568 leader_election.cc:304] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:43.890372 27857 raft_consensus.cc:2804] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.890746 27857 raft_consensus.cc:493] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.891121 27857 raft_consensus.cc:3060] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.893311 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:43.894176 27750 raft_consensus.cc:2393] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aee9fc0a34154b1d81b6ad3393c17b67 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:43.901387 27715 leader_election.cc:304] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.903959 27801 raft_consensus.cc:2749] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.908003 27794 tablet_bootstrap.cc:492] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:43.908548 27794 ts_tablet_manager.cc:1403] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.003s
I20260709 12:19:43.909125 27566 leader_election.cc:304] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:43.910815 27955 raft_consensus.cc:2749] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.911887 27795 tablet_bootstrap.cc:492] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:43.912279 27795 ts_tablet_manager.cc:1403] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.012s
I20260709 12:19:43.911000 27801 consensus_queue.cc:1048] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:43.918594 27794 raft_consensus.cc:359] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.919459 27794 raft_consensus.cc:385] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.919726 27794 raft_consensus.cc:740] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.920876 27794 consensus_queue.cc:260] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.923336 27795 raft_consensus.cc:359] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.924105 27795 raft_consensus.cc:385] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.924415 27795 raft_consensus.cc:740] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.925297 27795 consensus_queue.cc:260] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.928876 27795 ts_tablet_manager.cc:1434] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:19:43.929865 27795 tablet_bootstrap.cc:492] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:43.932564 27794 ts_tablet_manager.cc:1434] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:19:43.933610 27794 tablet_bootstrap.cc:492] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:43.935734 27795 tablet_bootstrap.cc:654] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.905422 27857 raft_consensus.cc:515] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.940577 27792 tablet_bootstrap.cc:492] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:43.941035 27792 ts_tablet_manager.cc:1403] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.000s
I20260709 12:19:43.942000 27857 leader_election.cc:290] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:43.942739 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb38284310a4a308dbb1da8b4325596" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:43.943488 27524 raft_consensus.cc:3060] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:43.943104 27473 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:43.948114 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb38284310a4a308dbb1da8b4325596" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
W20260709 12:19:43.950119 27566 leader_election.cc:343] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.950294 27524 raft_consensus.cc:2468] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:43.951654 27568 leader_election.cc:304] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:43.952067 27794 tablet_bootstrap.cc:654] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.953272 27802 raft_consensus.cc:493] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.953153 27801 consensus_queue.cc:1048] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.953766 27802 raft_consensus.cc:515] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:43.956712 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc249d99a354b2ba8dfb84856dbbb01" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:43.956947 27955 raft_consensus.cc:2804] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.957465 27955 raft_consensus.cc:697] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:43.958266 27955 consensus_queue.cc:237] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.962764 27802 leader_election.cc:290] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:43.963924 27792 raft_consensus.cc:359] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.964603 27792 raft_consensus.cc:385] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.964861 27792 raft_consensus.cc:740] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.965548 27792 consensus_queue.cc:260] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:43.967841 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc249d99a354b2ba8dfb84856dbbb01" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:43.968586 27750 raft_consensus.cc:2393] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in current term 1: Already voted for candidate aee9fc0a34154b1d81b6ad3393c17b67 in this term.
I20260709 12:19:43.968578 27794 tablet_bootstrap.cc:492] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:43.969756 27640 leader_election.cc:304] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:43.970108 27794 ts_tablet_manager.cc:1403] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260709 12:19:43.970927 27802 raft_consensus.cc:3060] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.970180 27422 catalog_manager.cc:5697] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.973052 27794 raft_consensus.cc:359] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.973812 27794 raft_consensus.cc:385] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.974145 27794 raft_consensus.cc:740] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.974923 27794 consensus_queue.cc:260] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:43.977816 27794 ts_tablet_manager.cc:1434] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:19:43.977459 27802 raft_consensus.cc:2749] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.978468 27422 catalog_manager.cc:5697] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.979300 27794 tablet_bootstrap.cc:492] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:43.978390 27792 ts_tablet_manager.cc:1434] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:19:43.981904 27793 tablet_bootstrap.cc:492] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:43.982371 27793 ts_tablet_manager.cc:1403] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.014s
I20260709 12:19:43.984891 27793 raft_consensus.cc:359] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.985471 27793 raft_consensus.cc:385] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.985723 27793 raft_consensus.cc:740] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.986416 27793 consensus_queue.cc:260] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:43.987980 27794 tablet_bootstrap.cc:654] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.991575 27793 ts_tablet_manager.cc:1434] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:19:43.992486 27793 tablet_bootstrap.cc:492] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:44.001756 27792 tablet_bootstrap.cc:492] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:44.008601 27795 tablet_bootstrap.cc:492] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.009557 27795 ts_tablet_manager.cc:1403] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.080s	user 0.006s	sys 0.004s
I20260709 12:19:44.011191 27421 catalog_manager.cc:5697] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.015533 27793 tablet_bootstrap.cc:654] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.012558 27795 raft_consensus.cc:359] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.018467 27795 raft_consensus.cc:385] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.018873 27795 raft_consensus.cc:740] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.019586 27795 consensus_queue.cc:260] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.022688 27795 ts_tablet_manager.cc:1434] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:19:44.024189 27795 tablet_bootstrap.cc:492] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:44.019933 27951 consensus_queue.cc:1048] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:19:44.027240 27794 tablet_bootstrap.cc:492] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:44.027819 27794 ts_tablet_manager.cc:1403] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.027s
I20260709 12:19:44.030592 27794 raft_consensus.cc:359] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.031302 27794 raft_consensus.cc:385] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.031628 27794 raft_consensus.cc:740] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.032408 27794 consensus_queue.cc:260] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.035993 27794 ts_tablet_manager.cc:1434] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:19:44.036275 27951 raft_consensus.cc:493] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.037086 27794 tablet_bootstrap.cc:492] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:44.036775 27951 raft_consensus.cc:515] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.039908 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b31e2427a143d2be9c66d5831fb40e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:44.040642 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b31e2427a143d2be9c66d5831fb40e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:44.041862 27568 leader_election.cc:343] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:44.042335 27566 leader_election.cc:343] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.042713 27566 leader_election.cc:304] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.043344 27857 raft_consensus.cc:2749] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.043437 27794 tablet_bootstrap.cc:654] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.046082 27951 leader_election.cc:290] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:44.046237 27795 tablet_bootstrap.cc:654] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.048934 27811 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.049391 27811 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.050077 27792 tablet_bootstrap.cc:654] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.051465 27811 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:44.052513 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.053184 27750 raft_consensus.cc:2468] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:44.055372 27491 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:44.056175 27811 raft_consensus.cc:2804] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.056550 27811 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.056466 27951 consensus_queue.cc:1048] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.057049 27811 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.052721 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:44.066758 27811 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
W20260709 12:19:44.067466 27491 leader_election.cc:343] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.068871 27811 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:44.071940 27802 consensus_queue.cc:1048] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.074589 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:44.075186 27749 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.081606 27888 raft_consensus.cc:493] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.082145 27888 raft_consensus.cc:515] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.084263 27888 leader_election.cc:290] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:44.085361 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2259e0eb900541c7b9d47a4406bce163" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:44.086200 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2259e0eb900541c7b9d47a4406bce163" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:44.086787 27749 raft_consensus.cc:2468] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:44.086822 27601 raft_consensus.cc:2468] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
W20260709 12:19:44.086874 27491 leader_election.cc:343] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.089679 27492 leader_election.cc:304] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:44.091342 27802 consensus_queue.cc:1048] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.096184 27894 raft_consensus.cc:2804] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.096566 27894 raft_consensus.cc:493] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.096896 27894 raft_consensus.cc:3060] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.103592 27802 consensus_queue.cc:1048] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.104242 27491 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:44.105150 27888 raft_consensus.cc:2804] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.105649 27888 raft_consensus.cc:697] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:44.106993 27888 consensus_queue.cc:237] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.114940 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:44.110778 27894 raft_consensus.cc:515] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
W20260709 12:19:44.119097 27491 leader_election.cc:343] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.120571 27793 tablet_bootstrap.cc:492] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:44.121145 27792 tablet_bootstrap.cc:492] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:44.124048 27793 ts_tablet_manager.cc:1403] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.132s	user 0.018s	sys 0.001s
I20260709 12:19:44.124485 27792 ts_tablet_manager.cc:1403] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.023s
I20260709 12:19:44.123560 27794 tablet_bootstrap.cc:492] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:44.125097 27794 ts_tablet_manager.cc:1403] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.008s
I20260709 12:19:44.122494 27951 raft_consensus.cc:493] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.128786 27795 tablet_bootstrap.cc:492] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.137851 27792 raft_consensus.cc:359] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.142908 27891 consensus_queue.cc:1048] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.143419 27792 raft_consensus.cc:385] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.143872 27792 raft_consensus.cc:740] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.146273 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2259e0eb900541c7b9d47a4406bce163" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:44.140717 27794 raft_consensus.cc:359] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.142110 27793 raft_consensus.cc:359] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.144366 27802 consensus_queue.cc:1048] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.146884 27601 raft_consensus.cc:3060] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.146422 27792 consensus_queue.cc:260] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.151080 27793 raft_consensus.cc:385] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.130273 27951 raft_consensus.cc:515] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.146903 27794 raft_consensus.cc:385] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.151432 27793 raft_consensus.cc:740] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.154835 27794 raft_consensus.cc:740] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.155731 27793 consensus_queue.cc:260] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.157904 27792 ts_tablet_manager.cc:1434] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 12:19:44.130662 27795 ts_tablet_manager.cc:1403] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.107s	user 0.025s	sys 0.013s
I20260709 12:19:44.160383 27792 tablet_bootstrap.cc:492] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:44.182713 27836 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.183126 27973 raft_consensus.cc:493] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.183321 27836 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.183648 27973 raft_consensus.cc:515] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.185490 27836 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:44.185678 27894 leader_election.cc:290] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:44.185490 27973 leader_election.cc:290] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:44.187167 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2259e0eb900541c7b9d47a4406bce163" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:44.188277 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fecbf499aff740c39b815de4701ab51b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:44.188889 27600 raft_consensus.cc:2468] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
W20260709 12:19:44.188946 27491 leader_election.cc:343] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.190269 27795 raft_consensus.cc:359] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.186779 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.191864 27749 raft_consensus.cc:2393] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in current term 1: Already voted for candidate de15618bc48545b6986320ca2292fc60 in this term.
I20260709 12:19:44.190290 27715 leader_election.cc:304] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:44.194569 27973 raft_consensus.cc:2804] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.194928 27973 raft_consensus.cc:493] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.195261 27973 raft_consensus.cc:3060] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.191021 27795 raft_consensus.cc:385] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.199220 27795 raft_consensus.cc:740] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.201782 27792 tablet_bootstrap.cc:654] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.202337 27795 consensus_queue.cc:260] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.200665 27601 raft_consensus.cc:2468] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:44.205394 27793 ts_tablet_manager.cc:1434] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.081s	user 0.013s	sys 0.025s
I20260709 12:19:44.205674 27795 ts_tablet_manager.cc:1434] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:19:44.206439 27951 leader_election.cc:290] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:44.209723 27795 tablet_bootstrap.cc:492] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:44.210033 27793 tablet_bootstrap.cc:492] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:44.211258 27492 leader_election.cc:304] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:44.212510 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9dad5b0ab6435aaf307e6816020451" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:44.215338 27888 raft_consensus.cc:2804] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.215741 27795 tablet_bootstrap.cc:654] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.215845 27888 raft_consensus.cc:697] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:44.217010 27793 tablet_bootstrap.cc:654] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.216763 27888 consensus_queue.cc:237] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.210224 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9dad5b0ab6435aaf307e6816020451" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.239624 27794 consensus_queue.cc:260] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
W20260709 12:19:44.224745 27566 leader_election.cc:343] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.243556 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fecbf499aff740c39b815de4701ab51b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:44.241556 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:44.245755 27716 leader_election.cc:343] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:44.248708 27566 leader_election.cc:343] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.249226 27566 leader_election.cc:304] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:44.250996 27794 ts_tablet_manager.cc:1434] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.126s	user 0.011s	sys 0.000s
I20260709 12:19:44.251132 27890 consensus_queue.cc:1048] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.230628 27973 raft_consensus.cc:515] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.254282 27794 tablet_bootstrap.cc:492] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:44.255615 27973 leader_election.cc:290] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:44.257079 27951 raft_consensus.cc:2749] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.259238 27424 catalog_manager.cc:5697] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:44.258492 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fecbf499aff740c39b815de4701ab51b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:44.264520 27601 raft_consensus.cc:3060] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.266659 27794 tablet_bootstrap.cc:654] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.272476 27951 consensus_queue.cc:1048] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:44.272487 27988 raft_consensus.cc:493] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.279660 27988 raft_consensus.cc:515] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.280900 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fecbf499aff740c39b815de4701ab51b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:44.282112 27988 leader_election.cc:290] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
W20260709 12:19:44.282305 27716 leader_election.cc:343] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.283897 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb38284310a4a308dbb1da8b4325596" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
W20260709 12:19:44.285562 27984 log.cc:927] Time spent T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:19:44.287222 27601 raft_consensus.cc:2468] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:44.288409 27715 leader_election.cc:304] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.289594 27973 raft_consensus.cc:2804] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.290045 27973 raft_consensus.cc:697] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
W20260709 12:19:44.290423 27991 log.cc:927] Time spent T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 12:19:44.290871 27973 consensus_queue.cc:237] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.301090 27642 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.303934 27792 tablet_bootstrap.cc:492] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:44.304471 27792 ts_tablet_manager.cc:1403] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.146s	user 0.035s	sys 0.051s
I20260709 12:19:44.304701 27988 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.307339 27792 raft_consensus.cc:359] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.308024 27792 raft_consensus.cc:385] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.308266 27792 raft_consensus.cc:740] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.309048 27792 consensus_queue.cc:260] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.317452 27888 raft_consensus.cc:493] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.318017 27888 raft_consensus.cc:515] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.319275 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb38284310a4a308dbb1da8b4325596" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:44.320078 27523 raft_consensus.cc:2393] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in current term 1: Already voted for candidate aee9fc0a34154b1d81b6ad3393c17b67 in this term.
I20260709 12:19:44.320822 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.320127 27888 leader_election.cc:290] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:44.321585 27749 raft_consensus.cc:2393] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de15618bc48545b6986320ca2292fc60 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:44.321794 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:44.308350 27951 raft_consensus.cc:493] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.322561 27601 raft_consensus.cc:2393] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de15618bc48545b6986320ca2292fc60 in current term 1: Already voted for candidate aee9fc0a34154b1d81b6ad3393c17b67 in this term.
I20260709 12:19:44.325932 27642 leader_election.cc:304] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.327016 27891 raft_consensus.cc:3060] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.335418 27820 consensus_queue.cc:1048] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.337160 27795 tablet_bootstrap.cc:492] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.337709 27795 ts_tablet_manager.cc:1403] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.025s
I20260709 12:19:44.334571 27951 raft_consensus.cc:515] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.343143 27973 raft_consensus.cc:493] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.343703 27973 raft_consensus.cc:515] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.347220 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0103e954b4ec472a9b561d0a4a1cbb10" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:44.348848 27714 leader_election.cc:343] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.352174 27792 ts_tablet_manager.cc:1434] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:19:44.353890 27792 tablet_bootstrap.cc:492] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:44.354777 27820 raft_consensus.cc:493] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.355296 27820 raft_consensus.cc:515] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.358212 27491 leader_election.cc:304] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:44.359004 27888 raft_consensus.cc:3060] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.359547 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0103e954b4ec472a9b561d0a4a1cbb10" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:44.359368 27422 catalog_manager.cc:5697] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.361384 27988 raft_consensus.cc:2749] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.361557 27793 tablet_bootstrap.cc:492] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:44.362112 27793 ts_tablet_manager.cc:1403] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.029s
I20260709 12:19:44.363883 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ccaa3a32e64320ac39060852b877fc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:44.364782 27793 raft_consensus.cc:359] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
W20260709 12:19:44.365226 27568 leader_election.cc:343] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.365432 27793 raft_consensus.cc:385] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.365696 27793 raft_consensus.cc:740] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.369948 27888 raft_consensus.cc:2749] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.372063 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ccaa3a32e64320ac39060852b877fc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.372426 27820 leader_election.cc:290] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:44.372890 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b28984fc9c44e9fb4b3df581a269923" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.373564 27749 raft_consensus.cc:2468] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
W20260709 12:19:44.374307 27716 leader_election.cc:343] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.366326 27793 consensus_queue.cc:260] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.379668 27973 leader_election.cc:290] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:44.383631 27566 leader_election.cc:304] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:44.384518 27820 raft_consensus.cc:2804] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.384881 27820 raft_consensus.cc:493] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.385216 27820 raft_consensus.cc:3060] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.385824 27716 leader_election.cc:304] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
W20260709 12:19:44.387445 27566 leader_election.cc:343] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.387918 27566 leader_election.cc:304] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.388679 27792 tablet_bootstrap.cc:654] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.389343 27956 raft_consensus.cc:2749] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.390067 27973 raft_consensus.cc:2749] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.389736 27795 raft_consensus.cc:359] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.392078 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b28984fc9c44e9fb4b3df581a269923" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:44.392949 27794 tablet_bootstrap.cc:492] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:44.393417 27794 ts_tablet_manager.cc:1403] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.005s
I20260709 12:19:44.396445 27820 raft_consensus.cc:515] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.399000 27820 leader_election.cc:290] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:44.351025 27951 leader_election.cc:290] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
W20260709 12:19:44.400673 27566 leader_election.cc:343] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.402364 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b28984fc9c44e9fb4b3df581a269923" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:44.403029 27750 raft_consensus.cc:3060] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.404641 27795 raft_consensus.cc:385] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.400619 27794 raft_consensus.cc:359] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.405001 27795 raft_consensus.cc:740] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.405499 27794 raft_consensus.cc:385] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.405895 27794 raft_consensus.cc:740] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.406615 27794 consensus_queue.cc:260] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.406543 27795 consensus_queue.cc:260] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.411080 27794 ts_tablet_manager.cc:1434] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:19:44.413046 27794 tablet_bootstrap.cc:492] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:44.412060 27795 ts_tablet_manager.cc:1434] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 12:19:44.414134 27795 tablet_bootstrap.cc:492] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:44.424468 27750 raft_consensus.cc:2468] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:44.426167 27566 leader_election.cc:304] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:44.427088 27951 raft_consensus.cc:2804] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.427734 27951 raft_consensus.cc:697] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:44.428540 27951 consensus_queue.cc:237] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.437500 27424 catalog_manager.cc:5697] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.439190 27795 tablet_bootstrap.cc:654] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.439313 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b28984fc9c44e9fb4b3df581a269923" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:44.440826 27794 tablet_bootstrap.cc:654] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.445437 27793 ts_tablet_manager.cc:1434] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.000s
I20260709 12:19:44.408138 27888 raft_consensus.cc:493] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.459708 27793 tablet_bootstrap.cc:492] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:44.461267 27888 raft_consensus.cc:515] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
W20260709 12:19:44.471159 27566 leader_election.cc:343] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.465472 27676 raft_consensus.cc:3060] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.472606 27888 leader_election.cc:290] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:44.473827 27792 tablet_bootstrap.cc:492] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:44.474289 27792 ts_tablet_manager.cc:1403] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.121s	user 0.034s	sys 0.038s
I20260709 12:19:44.476886 27891 raft_consensus.cc:2749] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.477124 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0103e954b4ec472a9b561d0a4a1cbb10" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.484354 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0103e954b4ec472a9b561d0a4a1cbb10" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:44.482617 27792 raft_consensus.cc:359] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.485783 27792 raft_consensus.cc:385] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.486059 27792 raft_consensus.cc:740] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.485168 27749 raft_consensus.cc:2468] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:44.486681 27792 consensus_queue.cc:260] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.488196 27673 raft_consensus.cc:2468] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:44.489912 27491 leader_election.cc:304] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:44.491791 27888 raft_consensus.cc:2804] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.492081 27888 raft_consensus.cc:493] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.492341 27888 raft_consensus.cc:3060] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.493882 27793 tablet_bootstrap.cc:654] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.495662 27951 consensus_queue.cc:1048] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.500555 27422 catalog_manager.cc:5697] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.505210 27792 ts_tablet_manager.cc:1434] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:19:44.506454 27792 tablet_bootstrap.cc:492] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:44.507810 27956 consensus_queue.cc:1048] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.508657 27890 raft_consensus.cc:493] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.509159 27890 raft_consensus.cc:515] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.512198 27820 consensus_queue.cc:1048] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.514128 27888 raft_consensus.cc:515] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.515484 27890 leader_election.cc:290] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:44.521409 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e820d15af94d0d8c63cd76f44ee8ec" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.526221 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e820d15af94d0d8c63cd76f44ee8ec" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:44.532517 27641 leader_election.cc:304] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:44.533600 27951 consensus_queue.cc:1048] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.533831 27891 raft_consensus.cc:2749] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:44.538543 27951 raft_consensus.cc:493] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.539073 27951 raft_consensus.cc:515] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.541105 27951 leader_election.cc:290] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:44.545176 27792 tablet_bootstrap.cc:654] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.544977 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:44.546128 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
W20260709 12:19:44.547823 27568 leader_election.cc:343] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.548480 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0103e954b4ec472a9b561d0a4a1cbb10" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:44.549086 27675 raft_consensus.cc:3060] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.549468 27888 leader_election.cc:290] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:44.550407 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0103e954b4ec472a9b561d0a4a1cbb10" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:44.550992 27749 raft_consensus.cc:3060] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:44.556291 27566 leader_election.cc:343] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.556756 27566 leader_election.cc:304] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.558857 27956 raft_consensus.cc:2749] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.559441 27795 tablet_bootstrap.cc:492] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.559958 27795 ts_tablet_manager.cc:1403] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.146s	user 0.009s	sys 0.004s
I20260709 12:19:44.559077 27675 raft_consensus.cc:2468] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:44.562505 27795 raft_consensus.cc:359] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.564064 27795 raft_consensus.cc:385] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.564337 27795 raft_consensus.cc:740] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.564960 27795 consensus_queue.cc:260] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.563444 27491 leader_election.cc:304] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:44.571544 27794 tablet_bootstrap.cc:492] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:44.572053 27794 ts_tablet_manager.cc:1403] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.159s	user 0.008s	sys 0.005s
I20260709 12:19:44.572396 27795 ts_tablet_manager.cc:1434] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:19:44.573644 27795 tablet_bootstrap.cc:492] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:44.573516 27749 raft_consensus.cc:2468] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:44.575016 27990 raft_consensus.cc:2804] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.575976 27990 raft_consensus.cc:697] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:44.576846 27990 consensus_queue.cc:237] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.578121 27794 raft_consensus.cc:359] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.578761 27794 raft_consensus.cc:385] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.579051 27794 raft_consensus.cc:740] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.580539 27794 consensus_queue.cc:260] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.586433 27794 ts_tablet_manager.cc:1434] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:19:44.587558 27793 tablet_bootstrap.cc:492] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:44.588088 27793 ts_tablet_manager.cc:1403] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.129s	user 0.020s	sys 0.013s
I20260709 12:19:44.595201 27794 tablet_bootstrap.cc:492] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:44.601152 27793 raft_consensus.cc:359] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.601809 27793 raft_consensus.cc:385] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.602083 27793 raft_consensus.cc:740] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.606041 27793 consensus_queue.cc:260] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.607915 27989 consensus_queue.cc:1048] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.608387 27793 ts_tablet_manager.cc:1434] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:19:44.609388 27793 tablet_bootstrap.cc:492] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:44.636121 27795 tablet_bootstrap.cc:654] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.644202 27794 tablet_bootstrap.cc:654] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.645220 27424 catalog_manager.cc:5697] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:44.652175 27793 tablet_bootstrap.cc:654] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.663028 27794 tablet_bootstrap.cc:492] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:44.663501 27794 ts_tablet_manager.cc:1403] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.001s
I20260709 12:19:44.666170 27794 raft_consensus.cc:359] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.666854 27794 raft_consensus.cc:385] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.667230 27794 raft_consensus.cc:740] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.672504 27792 tablet_bootstrap.cc:492] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:44.672994 27792 ts_tablet_manager.cc:1403] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.167s	user 0.015s	sys 0.002s
I20260709 12:19:44.676106 27792 raft_consensus.cc:359] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.676820 27792 raft_consensus.cc:385] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.677124 27792 raft_consensus.cc:740] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.677551 27811 consensus_queue.cc:1048] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.677870 27792 consensus_queue.cc:260] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.679193 27793 tablet_bootstrap.cc:492] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:44.679724 27793 ts_tablet_manager.cc:1403] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.001s
I20260709 12:19:44.679975 27792 ts_tablet_manager.cc:1434] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:44.680855 27792 tablet_bootstrap.cc:492] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:44.683012 27794 consensus_queue.cc:260] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.687603 27795 tablet_bootstrap.cc:492] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.684675 27793 raft_consensus.cc:359] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.690688 27795 ts_tablet_manager.cc:1403] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.000s
I20260709 12:19:44.691514 27794 ts_tablet_manager.cc:1434] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:19:44.692719 27794 tablet_bootstrap.cc:492] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:44.694106 27795 raft_consensus.cc:359] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.694761 27795 raft_consensus.cc:385] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.695073 27795 raft_consensus.cc:740] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.695715 27795 consensus_queue.cc:260] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.697635 27795 ts_tablet_manager.cc:1434] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:19:44.698472 27795 tablet_bootstrap.cc:492] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:44.691385 27792 tablet_bootstrap.cc:654] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.698781 27794 tablet_bootstrap.cc:654] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.701185 27793 raft_consensus.cc:385] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.702551 27674 raft_consensus.cc:3060] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.701507 27793 raft_consensus.cc:740] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.707460 27793 consensus_queue.cc:260] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.709048 27894 consensus_queue.cc:1048] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.711437 27793 ts_tablet_manager.cc:1434] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.004s
I20260709 12:19:44.712088 27795 tablet_bootstrap.cc:654] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.715101 27793 tablet_bootstrap.cc:492] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:44.715402 27803 raft_consensus.cc:493] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.715898 27803 raft_consensus.cc:515] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.717902 27803 leader_election.cc:290] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:44.723729 27793 tablet_bootstrap.cc:654] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.723742 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:44.724987 27602 raft_consensus.cc:2468] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:44.728163 27792 tablet_bootstrap.cc:492] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:44.728703 27792 ts_tablet_manager.cc:1403] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.009s
I20260709 12:19:44.729377 27894 consensus_queue.cc:1048] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.730932 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:44.731700 27792 raft_consensus.cc:359] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.732404 27792 raft_consensus.cc:385] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.732707 27792 raft_consensus.cc:740] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.733522 27792 consensus_queue.cc:260] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
W20260709 12:19:44.732502 27716 leader_election.cc:343] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.736157 27715 leader_election.cc:304] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.737797 27792 ts_tablet_manager.cc:1434] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:44.738835 27792 tablet_bootstrap.cc:492] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:44.740337 27527 raft_consensus.cc:3060] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.736497 27795 tablet_bootstrap.cc:492] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.742815 27795 ts_tablet_manager.cc:1403] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 12:19:44.745642 27795 raft_consensus.cc:359] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.746305 27795 raft_consensus.cc:385] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.746577 27795 raft_consensus.cc:740] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.747323 27795 consensus_queue.cc:260] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.749722 27795 ts_tablet_manager.cc:1434] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:44.750706 27795 tablet_bootstrap.cc:492] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:44.759107 27801 consensus_queue.cc:1048] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.761188 27795 tablet_bootstrap.cc:654] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.762678 27793 tablet_bootstrap.cc:492] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:44.763181 27793 ts_tablet_manager.cc:1403] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 12:19:44.759410 27792 tablet_bootstrap.cc:654] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.740860 27803 raft_consensus.cc:2804] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.764446 27803 raft_consensus.cc:493] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.764869 27803 raft_consensus.cc:3060] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.766456 27793 raft_consensus.cc:359] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.767181 27793 raft_consensus.cc:385] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.767439 27793 raft_consensus.cc:740] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.768127 27988 raft_consensus.cc:493] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.768114 27793 consensus_queue.cc:260] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.768775 27988 raft_consensus.cc:515] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.770429 27793 ts_tablet_manager.cc:1434] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:44.777683 27988 leader_election.cc:290] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:44.778045 27793 tablet_bootstrap.cc:492] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:44.777803 27792 tablet_bootstrap.cc:492] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:44.778748 27792 ts_tablet_manager.cc:1403] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.003s
I20260709 12:19:44.779605 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b28984fc9c44e9fb4b3df581a269923" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.780395 27749 raft_consensus.cc:2393] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in current term 1: Already voted for candidate aee9fc0a34154b1d81b6ad3393c17b67 in this term.
I20260709 12:19:44.780536 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b28984fc9c44e9fb4b3df581a269923" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:44.781255 27792 raft_consensus.cc:359] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.781929 27792 raft_consensus.cc:385] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.781863 27641 leader_election.cc:304] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:44.778108 27795 tablet_bootstrap.cc:492] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.782881 27795 ts_tablet_manager.cc:1403] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.006s
I20260709 12:19:44.783198 27988 raft_consensus.cc:3060] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.784199 27793 tablet_bootstrap.cc:654] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.782274 27792 raft_consensus.cc:740] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.785283 27792 consensus_queue.cc:260] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.788506 27792 ts_tablet_manager.cc:1434] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:44.789474 27792 tablet_bootstrap.cc:492] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:44.789912 27988 raft_consensus.cc:2749] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.795863 27795 raft_consensus.cc:359] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.796582 27795 raft_consensus.cc:385] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.796821 27795 raft_consensus.cc:740] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.797459 27795 consensus_queue.cc:260] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.799836 27795 ts_tablet_manager.cc:1434] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:19:44.800737 27795 tablet_bootstrap.cc:492] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:44.803927 27801 consensus_queue.cc:1048] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:44.806882 27795 tablet_bootstrap.cc:654] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.809770 27792 tablet_bootstrap.cc:654] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.816952 27857 raft_consensus.cc:493] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.821686 27857 raft_consensus.cc:515] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.823822 27857 leader_election.cc:290] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:44.810829 27803 raft_consensus.cc:515] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.832304 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:44.832646 27795 tablet_bootstrap.cc:492] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.833168 27795 ts_tablet_manager.cc:1403] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.004s
W20260709 12:19:44.833473 27566 leader_election.cc:343] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.835717 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:44.836733 27795 raft_consensus.cc:359] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.837548 27795 raft_consensus.cc:385] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.837829 27795 raft_consensus.cc:740] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.838507 27795 consensus_queue.cc:260] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
W20260709 12:19:44.840464 27568 leader_election.cc:343] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.840916 27568 leader_election.cc:304] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.841150 27793 tablet_bootstrap.cc:492] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:44.841777 27793 ts_tablet_manager.cc:1403] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.003s
I20260709 12:19:44.843734 27857 raft_consensus.cc:2749] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.840989 27795 ts_tablet_manager.cc:1434] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:44.845079 27795 tablet_bootstrap.cc:492] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:44.846966 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
W20260709 12:19:44.848150 27716 leader_election.cc:343] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.849421 27793 raft_consensus.cc:359] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.850060 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:44.853976 27793 raft_consensus.cc:385] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.854133 27600 raft_consensus.cc:3060] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.854830 27794 tablet_bootstrap.cc:492] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:44.855320 27794 ts_tablet_manager.cc:1403] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.163s	user 0.031s	sys 0.030s
I20260709 12:19:44.855393 27795 tablet_bootstrap.cc:654] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.854342 27793 raft_consensus.cc:740] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.857846 27794 raft_consensus.cc:359] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.858601 27794 raft_consensus.cc:385] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.858896 27794 raft_consensus.cc:740] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.858994 27793 consensus_queue.cc:260] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.859707 27794 consensus_queue.cc:260] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.861129 27600 raft_consensus.cc:2468] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:44.861979 27794 ts_tablet_manager.cc:1434] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:44.850672 27803 leader_election.cc:290] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:44.862352 27715 leader_election.cc:304] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.862923 27794 tablet_bootstrap.cc:492] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:44.863209 27973 raft_consensus.cc:2804] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.863693 27973 raft_consensus.cc:697] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:44.864476 27973 consensus_queue.cc:237] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.868391 27792 tablet_bootstrap.cc:492] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:44.864465 27793 ts_tablet_manager.cc:1434] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:19:44.869890 27793 tablet_bootstrap.cc:492] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:44.868897 27792 ts_tablet_manager.cc:1403] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.014s
I20260709 12:19:44.871342 27803 raft_consensus.cc:493] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.871855 27803 raft_consensus.cc:515] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.873940 27792 raft_consensus.cc:359] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.874622 27792 raft_consensus.cc:385] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.874924 27792 raft_consensus.cc:740] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.875201 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ccaa3a32e64320ac39060852b877fc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:44.875856 27527 raft_consensus.cc:2468] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:44.875694 27792 consensus_queue.cc:260] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.871336 27794 tablet_bootstrap.cc:654] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.877709 27716 leader_election.cc:304] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:44.874425 27795 tablet_bootstrap.cc:492] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.878562 27801 raft_consensus.cc:2804] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.878974 27801 raft_consensus.cc:493] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.879312 27801 raft_consensus.cc:3060] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.879390 27803 leader_election.cc:290] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:44.880733 27792 ts_tablet_manager.cc:1434] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 12:19:44.881177 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ccaa3a32e64320ac39060852b877fc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:44.881696 27792 tablet_bootstrap.cc:492] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:44.881940 27600 raft_consensus.cc:2468] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:44.879201 27795 ts_tablet_manager.cc:1403] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 12:19:44.889098 27795 raft_consensus.cc:359] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.899566 27795 raft_consensus.cc:385] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.899909 27795 raft_consensus.cc:740] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.892426 27793 tablet_bootstrap.cc:654] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.897971 27792 tablet_bootstrap.cc:654] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.898726 27857 raft_consensus.cc:493] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.906419 27894 raft_consensus.cc:493] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.905997 27795 consensus_queue.cc:260] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.899614 27820 raft_consensus.cc:493] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.906949 27894 raft_consensus.cc:515] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.908622 27857 raft_consensus.cc:515] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.910821 27894 leader_election.cc:290] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:44.911746 27857 leader_election.cc:290] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:44.912374 27820 raft_consensus.cc:515] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.914501 27820 leader_election.cc:290] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:44.915019 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:44.916029 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
W20260709 12:19:44.916412 27566 leader_election.cc:343] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.917177 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:44.917415 27566 leader_election.cc:343] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:44.918419 27491 leader_election.cc:343] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.919970 27795 ts_tablet_manager.cc:1434] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.034s	user 0.001s	sys 0.004s
I20260709 12:19:44.915364 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:44.920629 27600 raft_consensus.cc:2468] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:44.921038 27795 tablet_bootstrap.cc:492] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:44.922062 27794 tablet_bootstrap.cc:492] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:44.922569 27794 ts_tablet_manager.cc:1403] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.005s
I20260709 12:19:44.923273 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:44.924634 27568 leader_election.cc:343] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.925072 27568 leader_election.cc:304] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:44.924993 27492 leader_election.cc:304] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:44.927649 27894 raft_consensus.cc:2804] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.919855 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:44.931090 27792 tablet_bootstrap.cc:492] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:44.931555 27792 ts_tablet_manager.cc:1403] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.006s
I20260709 12:19:44.932286 27857 raft_consensus.cc:2749] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.928090 27894 raft_consensus.cc:493] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.933297 27894 raft_consensus.cc:3060] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.934322 27792 raft_consensus.cc:359] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.934989 27794 raft_consensus.cc:359] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.942407 27794 raft_consensus.cc:385] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.942725 27794 raft_consensus.cc:740] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
W20260709 12:19:44.943562 27566 leader_election.cc:343] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.943397 27794 consensus_queue.cc:260] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.944022 27566 leader_election.cc:304] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:44.945555 27794 ts_tablet_manager.cc:1434] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:19:44.945933 27820 consensus_queue.cc:1048] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.946483 27794 tablet_bootstrap.cc:492] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:44.945672 27857 raft_consensus.cc:2749] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.935623 27795 tablet_bootstrap.cc:654] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.919957 27422 catalog_manager.cc:5697] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.936497 27988 raft_consensus.cc:493] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.948385 27988 raft_consensus.cc:515] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.950455 27792 raft_consensus.cc:385] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.950516 27988 leader_election.cc:290] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:44.950794 27792 raft_consensus.cc:740] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.951537 27792 consensus_queue.cc:260] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:44.952193 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b31e2427a143d2be9c66d5831fb40e" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:44.952803 27527 raft_consensus.cc:2468] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:44.958472 27642 leader_election.cc:304] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:44.963104 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b31e2427a143d2be9c66d5831fb40e" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:44.963744 27602 raft_consensus.cc:2468] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:44.963680 27988 raft_consensus.cc:2804] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.964316 27795 tablet_bootstrap.cc:492] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:44.964504 27988 raft_consensus.cc:493] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.964864 27988 raft_consensus.cc:3060] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.965898 27793 tablet_bootstrap.cc:492] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:44.961243 27894 raft_consensus.cc:515] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.966357 27793 ts_tablet_manager.cc:1403] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.005s
I20260709 12:19:44.966413 27857 consensus_queue.cc:1048] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:44.927279 27801 raft_consensus.cc:515] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:44.968287 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:44.961884 27792 ts_tablet_manager.cc:1434] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:19:44.969257 27795 ts_tablet_manager.cc:1403] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.001s
I20260709 12:19:44.970002 27792 tablet_bootstrap.cc:492] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:44.972424 27793 raft_consensus.cc:359] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.973241 27793 raft_consensus.cc:385] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.968952 27602 raft_consensus.cc:3060] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.973461 27793 raft_consensus.cc:740] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.979990 27793 consensus_queue.cc:260] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:44.982707 27792 tablet_bootstrap.cc:654] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.984674 27801 leader_election.cc:290] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:44.985435 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ccaa3a32e64320ac39060852b877fc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:44.986949 27793 ts_tablet_manager.cc:1434] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:19:44.986410 27795 raft_consensus.cc:359] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.987421 27795 raft_consensus.cc:385] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.987617 27795 raft_consensus.cc:740] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.986039 27527 raft_consensus.cc:3060] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.990860 27795 consensus_queue.cc:260] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:44.993006 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:44.993906 27793 tablet_bootstrap.cc:492] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:44.999410 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ccaa3a32e64320ac39060852b877fc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:45.000092 27793 tablet_bootstrap.cc:654] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.000015 27600 raft_consensus.cc:3060] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:45.002143 27491 leader_election.cc:343] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.988004 27894 leader_election.cc:290] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.006816 27888 consensus_queue.cc:1048] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.009199 27988 raft_consensus.cc:515] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
W20260709 12:19:45.024394 27473 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:45.025111 27956 raft_consensus.cc:493] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.025611 27956 raft_consensus.cc:515] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.027449 27602 raft_consensus.cc:2468] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:45.027680 27956 leader_election.cc:290] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.030010 27492 leader_election.cc:304] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:45.031149 27888 raft_consensus.cc:2804] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.032047 27888 raft_consensus.cc:697] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:45.032903 27888 consensus_queue.cc:237] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.036796 27894 consensus_queue.cc:1048] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.038196 27794 tablet_bootstrap.cc:654] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.041158 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:45.044946 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.046232 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b31e2427a143d2be9c66d5831fb40e" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:45.053319 27601 raft_consensus.cc:3060] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.046595 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62b31e2427a143d2be9c66d5831fb40e" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:45.047114 27988 leader_election.cc:290] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:45.048266 27527 raft_consensus.cc:2468] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.058409 27795 ts_tablet_manager.cc:1434] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.001s
I20260709 12:19:45.059506 27795 tablet_bootstrap.cc:492] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:45.057638 27801 raft_consensus.cc:493] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.067279 27801 raft_consensus.cc:515] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.056985 27524 raft_consensus.cc:3060] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.075594 27801 leader_election.cc:290] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.082008 27716 leader_election.cc:304] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:45.086195 27801 raft_consensus.cc:2804] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.087013 27803 raft_consensus.cc:493] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.087441 27803 raft_consensus.cc:515] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.089438 27803 leader_election.cc:290] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
W20260709 12:19:45.079183 27566 leader_election.cc:343] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.094074 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9dad5b0ab6435aaf307e6816020451" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.082509 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc70997e4048979966612dc07d9a47" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.095319 27673 raft_consensus.cc:2468] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.094769 27675 raft_consensus.cc:2468] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.098541 27714 leader_election.cc:304] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:45.099505 27714 leader_election.cc:304] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:45.101257 27973 raft_consensus.cc:2804] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.101655 27973 raft_consensus.cc:493] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.102039 27973 raft_consensus.cc:3060] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.103523 27601 raft_consensus.cc:2468] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:45.104293 27600 raft_consensus.cc:2468] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
W20260709 12:19:45.105178 27568 leader_election.cc:343] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.108575 27803 raft_consensus.cc:2804] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.108209 27641 leader_election.cc:304] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:45.108695 27956 raft_consensus.cc:493] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.109722 27956 raft_consensus.cc:515] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.111724 27793 tablet_bootstrap.cc:492] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:45.109162 27803 raft_consensus.cc:493] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.113049 27973 raft_consensus.cc:515] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.113499 27988 raft_consensus.cc:2804] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.113806 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f87bb1f2fd40e1b066d978660bf0fe" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:45.114051 27988 raft_consensus.cc:697] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:45.112210 27956 leader_election.cc:290] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.112258 27793 ts_tablet_manager.cc:1403] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.119s	user 0.027s	sys 0.020s
I20260709 12:19:45.101725 27524 raft_consensus.cc:2468] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:45.115481 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc70997e4048979966612dc07d9a47" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:45.117206 27566 leader_election.cc:343] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.113071 27803 raft_consensus.cc:3060] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.117291 27988 consensus_queue.cc:237] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.120008 27795 tablet_bootstrap.cc:654] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.121280 27527 raft_consensus.cc:2468] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.124416 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc70997e4048979966612dc07d9a47" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:45.124998 27673 raft_consensus.cc:3060] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.125392 27794 tablet_bootstrap.cc:492] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:45.125932 27794 ts_tablet_manager.cc:1403] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.001s
I20260709 12:19:45.131197 27568 leader_election.cc:304] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.133601 27673 raft_consensus.cc:2468] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.133882 27792 tablet_bootstrap.cc:492] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:45.134361 27792 ts_tablet_manager.cc:1403] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.165s	user 0.039s	sys 0.018s
I20260709 12:19:45.136389 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc70997e4048979966612dc07d9a47" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:45.137080 27524 raft_consensus.cc:3060] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.143985 27792 raft_consensus.cc:359] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.144639 27792 raft_consensus.cc:385] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.135411 27793 raft_consensus.cc:359] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.145861 27956 raft_consensus.cc:2749] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:45.146240 27568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:34993, user_credentials={real_user=slave}} blocked reactor thread for 67373.8us
I20260709 12:19:45.144884 27792 raft_consensus.cc:740] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.124747 27803 raft_consensus.cc:515] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.147336 27792 consensus_queue.cc:260] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.145766 27793 raft_consensus.cc:385] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.153329 27793 raft_consensus.cc:740] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.155426 27794 raft_consensus.cc:359] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.155584 27793 consensus_queue.cc:260] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.156107 27794 raft_consensus.cc:385] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.156385 27794 raft_consensus.cc:740] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.157043 27794 consensus_queue.cc:260] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.158754 27714 leader_election.cc:304] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:45.159405 27794 ts_tablet_manager.cc:1434] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:19:45.160144 27801 raft_consensus.cc:697] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:45.160511 28044 raft_consensus.cc:2804] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.161044 27801 consensus_queue.cc:237] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.164389 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f87bb1f2fd40e1b066d978660bf0fe" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:45.162075 27794 tablet_bootstrap.cc:492] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:45.135326 27973 leader_election.cc:290] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.171906 27793 ts_tablet_manager.cc:1434] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 12:19:45.178221 27794 tablet_bootstrap.cc:654] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.183640 27793 tablet_bootstrap.cc:492] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:45.185724 27792 ts_tablet_manager.cc:1434] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.003s
I20260709 12:19:45.186795 27792 tablet_bootstrap.cc:492] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:45.171844 27951 raft_consensus.cc:493] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.190680 28044 raft_consensus.cc:697] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:45.195097 27820 raft_consensus.cc:493] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.201114 27820 raft_consensus.cc:515] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.194563 27951 raft_consensus.cc:515] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.203332 27820 leader_election.cc:290] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.196540 27803 leader_election.cc:290] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.204519 27951 leader_election.cc:290] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.197264 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9dad5b0ab6435aaf307e6816020451" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:45.205782 27601 raft_consensus.cc:2468] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.208357 27792 tablet_bootstrap.cc:654] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.209411 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9dad5b0ab6435aaf307e6816020451" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:45.209990 27602 raft_consensus.cc:3060] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.211134 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f3f60349784a56b3225530bd5d5b14" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.211624 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61af26ee6a29463f8084851d49c5597c" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.214202 27793 tablet_bootstrap.cc:654] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.203450 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9dad5b0ab6435aaf307e6816020451" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:45.223275 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61af26ee6a29463f8084851d49c5597c" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:45.214370 27566 leader_election.cc:343] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:45.226677 27566 leader_election.cc:343] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.226305 27422 catalog_manager.cc:5697] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.215029 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f3f60349784a56b3225530bd5d5b14" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:45.215047 27673 raft_consensus.cc:3060] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.237574 27795 tablet_bootstrap.cc:492] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:45.238036 27795 ts_tablet_manager.cc:1403] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.179s	user 0.030s	sys 0.044s
I20260709 12:19:45.240638 27795 raft_consensus.cc:359] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.241250 27795 raft_consensus.cc:385] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.241508 27795 raft_consensus.cc:740] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.242134 27795 consensus_queue.cc:260] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.243605 27795 ts_tablet_manager.cc:1434] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:19:45.244488 27795 tablet_bootstrap.cc:492] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:45.246042 27820 raft_consensus.cc:493] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.248186 27524 raft_consensus.cc:2468] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.246620 27820 raft_consensus.cc:515] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.253258 27820 leader_election.cc:290] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:45.253611 27792 tablet_bootstrap.cc:492] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:45.254192 27792 ts_tablet_manager.cc:1403] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.014s
I20260709 12:19:45.254477 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a307ee39574103a5e8d0dbbc4311a9" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.256754 27792 raft_consensus.cc:359] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.257668 27792 raft_consensus.cc:385] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.257731 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a307ee39574103a5e8d0dbbc4311a9" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:45.258128 27792 raft_consensus.cc:740] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.258488 27673 raft_consensus.cc:2468] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
W20260709 12:19:45.251185 27568 leader_election.cc:343] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.262379 27568 leader_election.cc:304] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.253569 28044 consensus_queue.cc:237] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.263398 27795 tablet_bootstrap.cc:654] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:45.263427 27568 leader_election.cc:343] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.264024 27568 leader_election.cc:304] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.264868 27820 raft_consensus.cc:2749] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:45.265228 27568 leader_election.cc:343] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.261252 27602 raft_consensus.cc:2468] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.263029 27951 raft_consensus.cc:2749] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:45.257688 27566 leader_election.cc:343] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.258883 27792 consensus_queue.cc:260] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.265720 27568 leader_election.cc:304] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.267627 27951 raft_consensus.cc:2749] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.268056 27424 catalog_manager.cc:5697] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:45.269829 27566 leader_election.cc:343] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.270264 27566 leader_election.cc:304] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:45.270965 27951 raft_consensus.cc:2749] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.275451 27714 leader_election.cc:304] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:45.277040 27803 raft_consensus.cc:2804] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.277491 27803 raft_consensus.cc:697] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:45.278275 27803 consensus_queue.cc:237] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.281072 27792 ts_tablet_manager.cc:1434] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:19:45.282001 27792 tablet_bootstrap.cc:492] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:45.285005 28050 raft_consensus.cc:493] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.299134 28050 raft_consensus.cc:515] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.301398 28050 leader_election.cc:290] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.302311 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2c5c04c10e47208177d477008b8d8f" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.302563 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2c5c04c10e47208177d477008b8d8f" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:45.303020 27673 raft_consensus.cc:2468] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.303359 27524 raft_consensus.cc:2468] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.304858 27716 leader_election.cc:304] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:45.305794 28050 raft_consensus.cc:2804] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.306203 28050 raft_consensus.cc:493] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.306641 28050 raft_consensus.cc:3060] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.285959 27794 tablet_bootstrap.cc:492] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:45.295779 27421 catalog_manager.cc:5697] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.309394 27794 ts_tablet_manager.cc:1403] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.011s
I20260709 12:19:45.311977 27794 raft_consensus.cc:359] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.312590 27794 raft_consensus.cc:385] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.312846 27794 raft_consensus.cc:740] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.313480 27794 consensus_queue.cc:260] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.323794 27792 tablet_bootstrap.cc:654] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.328228 27793 tablet_bootstrap.cc:492] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:45.328715 27793 ts_tablet_manager.cc:1403] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.156s	user 0.012s	sys 0.000s
I20260709 12:19:45.330832 27794 ts_tablet_manager.cc:1434] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:19:45.331723 27794 tablet_bootstrap.cc:492] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:45.332862 27802 raft_consensus.cc:493] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.333323 27802 raft_consensus.cc:515] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.333222 27425 catalog_manager.cc:5697] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.334649 27793 raft_consensus.cc:359] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.335258 27802 leader_election.cc:290] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:45.335296 27793 raft_consensus.cc:385] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.336197 27793 raft_consensus.cc:740] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.337100 27803 raft_consensus.cc:493] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.337320 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:45.337579 27803 raft_consensus.cc:515] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.339546 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:45.340269 27600 raft_consensus.cc:2393] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in current term 1: Already voted for candidate de15618bc48545b6986320ca2292fc60 in this term.
I20260709 12:19:45.340827 27803 leader_election.cc:290] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.341256 27641 leader_election.cc:304] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.342367 27802 raft_consensus.cc:3060] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.343154 27792 tablet_bootstrap.cc:492] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:45.343595 27792 ts_tablet_manager.cc:1403] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.001s
I20260709 12:19:45.346166 27792 raft_consensus.cc:359] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.346737 27792 raft_consensus.cc:385] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.347023 27792 raft_consensus.cc:740] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.348737 27802 raft_consensus.cc:2749] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.349706 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:45.350821 27714 leader_election.cc:343] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.341562 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:45.352264 27716 leader_election.cc:343] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.336798 27793 consensus_queue.cc:260] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.352686 27716 leader_election.cc:304] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.353822 27794 tablet_bootstrap.cc:654] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.354147 27803 raft_consensus.cc:2749] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.356989 28050 raft_consensus.cc:515] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.357957 27793 ts_tablet_manager.cc:1434] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:19:45.359736 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2c5c04c10e47208177d477008b8d8f" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:45.360329 27673 raft_consensus.cc:3060] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.361789 28050 leader_election.cc:290] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.366549 27673 raft_consensus.cc:2468] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.367111 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2c5c04c10e47208177d477008b8d8f" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:45.368958 27524 raft_consensus.cc:3060] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:45.370982 27716 consensus_peers.cc:597] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:45.372139 27795 tablet_bootstrap.cc:492] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:45.372619 27795 ts_tablet_manager.cc:1403] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.011s
I20260709 12:19:45.374888 27524 raft_consensus.cc:2468] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.368104 27793 tablet_bootstrap.cc:492] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:45.375288 27795 raft_consensus.cc:359] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.375972 27795 raft_consensus.cc:385] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.376047 27716 leader_election.cc:304] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:45.377242 28050 raft_consensus.cc:2804] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.377974 28050 raft_consensus.cc:697] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:45.378834 28050 consensus_queue.cc:237] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.358466 27792 consensus_queue.cc:260] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.380797 27423 catalog_manager.cc:5697] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:45.387162 27792 ts_tablet_manager.cc:1434] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:19:45.376261 27795 raft_consensus.cc:740] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.388288 27795 consensus_queue.cc:260] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.390998 27794 tablet_bootstrap.cc:492] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:45.391496 27794 ts_tablet_manager.cc:1403] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 12:19:45.392407 27792 tablet_bootstrap.cc:492] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:45.393946 27795 ts_tablet_manager.cc:1434] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:19:45.395215 27793 tablet_bootstrap.cc:654] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.398936 27803 raft_consensus.cc:493] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.394876 27795 tablet_bootstrap.cc:492] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:45.399402 27803 raft_consensus.cc:515] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.404878 27803 leader_election.cc:290] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.405651 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:45.406370 27600 raft_consensus.cc:2468] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.406524 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.407197 27673 raft_consensus.cc:2468] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.407464 27794 raft_consensus.cc:359] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.407835 27715 leader_election.cc:304] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:45.408407 27794 raft_consensus.cc:385] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.408886 28050 raft_consensus.cc:2804] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.401232 27792 tablet_bootstrap.cc:654] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.409380 28050 raft_consensus.cc:493] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.409799 28050 raft_consensus.cc:3060] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.415592 27803 consensus_queue.cc:1048] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.416380 27794 raft_consensus.cc:740] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.420531 27794 consensus_queue.cc:260] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.422904 27795 tablet_bootstrap.cc:654] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.425890 28050 raft_consensus.cc:515] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.429142 27793 tablet_bootstrap.cc:492] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:45.430889 27794 ts_tablet_manager.cc:1434] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:19:45.433835 27951 raft_consensus.cc:493] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.434347 27951 raft_consensus.cc:515] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.434684 28050 leader_election.cc:290] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.435736 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:45.436303 27673 raft_consensus.cc:3060] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.436538 27951 leader_election.cc:290] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.437677 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:45.439090 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:45.439651 27600 raft_consensus.cc:3060] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.441287 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
W20260709 12:19:45.443058 27566 leader_election.cc:343] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.444196 27794 tablet_bootstrap.cc:492] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:45.443639 27423 catalog_manager.cc:5697] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.444564 27673 raft_consensus.cc:2468] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.445705 27714 leader_election.cc:304] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:45.446636 28050 raft_consensus.cc:2804] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.447278 28050 raft_consensus.cc:697] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
W20260709 12:19:45.447409 27568 leader_election.cc:343] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.447876 27568 leader_election.cc:304] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.448149 28050 consensus_queue.cc:237] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.448937 27951 raft_consensus.cc:2749] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.433590 27793 ts_tablet_manager.cc:1403] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.010s
I20260709 12:19:45.452307 27793 raft_consensus.cc:359] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.452905 27793 raft_consensus.cc:385] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.453145 27793 raft_consensus.cc:740] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.455232 27600 raft_consensus.cc:2468] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.458205 27794 tablet_bootstrap.cc:654] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.463617 27795 tablet_bootstrap.cc:492] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:45.464510 27795 ts_tablet_manager.cc:1403] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.002s
I20260709 12:19:45.467530 27795 raft_consensus.cc:359] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.468160 27795 raft_consensus.cc:385] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.468421 27795 raft_consensus.cc:740] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.470623 27793 consensus_queue.cc:260] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.472911 27793 ts_tablet_manager.cc:1434] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:19:45.475420 27792 tablet_bootstrap.cc:492] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:45.475930 27792 ts_tablet_manager.cc:1403] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.084s	user 0.028s	sys 0.013s
I20260709 12:19:45.478541 27792 raft_consensus.cc:359] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.479267 27792 raft_consensus.cc:385] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.478775 27795 consensus_queue.cc:260] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.479588 27792 raft_consensus.cc:740] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.480439 27792 consensus_queue.cc:260] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.481084 27793 tablet_bootstrap.cc:492] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:45.485144 27792 ts_tablet_manager.cc:1434] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:45.486191 27792 tablet_bootstrap.cc:492] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:45.491709 27792 tablet_bootstrap.cc:654] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.493680 27793 tablet_bootstrap.cc:654] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.496733 27794 tablet_bootstrap.cc:492] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:45.497283 27794 ts_tablet_manager.cc:1403] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 12:19:45.500030 27794 raft_consensus.cc:359] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.500684 27794 raft_consensus.cc:385] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.500970 27794 raft_consensus.cc:740] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.501709 27794 consensus_queue.cc:260] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.502130 27425 catalog_manager.cc:5697] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:45.503333 27792 tablet_bootstrap.cc:492] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:45.503767 27792 ts_tablet_manager.cc:1403] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:19:45.504632 27794 ts_tablet_manager.cc:1434] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:45.505543 27794 tablet_bootstrap.cc:492] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:45.506907 28050 raft_consensus.cc:493] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.507365 28050 raft_consensus.cc:515] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.509442 28050 leader_election.cc:290] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.511106 27794 tablet_bootstrap.cc:654] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.511765 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a307ee39574103a5e8d0dbbc4311a9" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.511951 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a307ee39574103a5e8d0dbbc4311a9" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:45.512799 27792 raft_consensus.cc:359] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.513284 27989 raft_consensus.cc:493] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.513490 27792 raft_consensus.cc:385] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.513445 27602 raft_consensus.cc:2468] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.513939 27792 raft_consensus.cc:740] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
W20260709 12:19:45.513881 27714 leader_election.cc:343] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.517629 27793 tablet_bootstrap.cc:492] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:45.517863 27715 leader_election.cc:304] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:45.518407 27989 raft_consensus.cc:515] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.519096 28050 raft_consensus.cc:2804] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.519462 28050 raft_consensus.cc:493] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.519774 28050 raft_consensus.cc:3060] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.520397 27988 consensus_queue.cc:1048] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.518087 27793 ts_tablet_manager.cc:1403] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.002s
I20260709 12:19:45.522957 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61af26ee6a29463f8084851d49c5597c" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.523557 27673 raft_consensus.cc:2468] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:45.523878 27793 raft_consensus.cc:359] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.525363 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61af26ee6a29463f8084851d49c5597c" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:45.525959 27601 raft_consensus.cc:2468] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:45.526782 28050 raft_consensus.cc:515] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.528002 27491 leader_election.cc:304] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:45.528844 27894 raft_consensus.cc:2804] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.528688 27792 consensus_queue.cc:260] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.529247 27894 raft_consensus.cc:493] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.529636 27894 raft_consensus.cc:3060] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.524530 27793 raft_consensus.cc:385] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.529991 27793 raft_consensus.cc:740] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.530907 27792 ts_tablet_manager.cc:1434] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:19:45.531589 27793 consensus_queue.cc:260] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.532932 27792 tablet_bootstrap.cc:492] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:45.535598 28050 leader_election.cc:290] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.536695 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a307ee39574103a5e8d0dbbc4311a9" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:45.537303 27601 raft_consensus.cc:3060] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.540501 27792 tablet_bootstrap.cc:654] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.541018 27793 ts_tablet_manager.cc:1434] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:19:45.541486 27820 raft_consensus.cc:493] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.541949 27793 tablet_bootstrap.cc:492] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:45.541972 27820 raft_consensus.cc:515] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.552597 27820 leader_election.cc:290] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:45.520561 27989 leader_election.cc:290] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.537065 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a307ee39574103a5e8d0dbbc4311a9" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:45.544256 27601 raft_consensus.cc:2468] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.548975 27951 raft_consensus.cc:493] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.550707 27795 ts_tablet_manager.cc:1434] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
W20260709 12:19:45.554338 27714 leader_election.cc:343] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.555171 27795 tablet_bootstrap.cc:492] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:45.555727 27715 leader_election.cc:304] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:45.556526 28050 raft_consensus.cc:2804] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.557018 28050 raft_consensus.cc:697] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:45.554342 27951 raft_consensus.cc:515] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.557811 28050 consensus_queue.cc:237] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.559393 27951 leader_election.cc:290] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:45.561949 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a8e7d5f765421391635cebebac4add" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:45.562461 27795 tablet_bootstrap.cc:654] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.563063 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a8e7d5f765421391635cebebac4add" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.563210 27888 raft_consensus.cc:493] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.563746 27888 raft_consensus.cc:515] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.565160 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f8b7dcacaf41f18a7974c565deffd4" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:45.566187 27888 leader_election.cc:290] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:45.562038 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f8b7dcacaf41f18a7974c565deffd4" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:45.568066 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:45.568651 27749 raft_consensus.cc:2468] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:45.569895 27795 tablet_bootstrap.cc:492] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:45.569778 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:45.566331 27794 tablet_bootstrap.cc:492] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:45.570053 27491 leader_election.cc:304] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:45.570385 27795 ts_tablet_manager.cc:1403] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
W20260709 12:19:45.568077 27566 leader_election.cc:343] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.570864 27989 raft_consensus.cc:2804] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.571388 27989 raft_consensus.cc:493] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.571774 27989 raft_consensus.cc:3060] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.573061 27795 raft_consensus.cc:359] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.573709 27795 raft_consensus.cc:385] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.573971 27795 raft_consensus.cc:740] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.574692 27795 consensus_queue.cc:260] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.577000 27795 ts_tablet_manager.cc:1434] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:45.577893 27795 tablet_bootstrap.cc:492] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:45.579159 27989 raft_consensus.cc:515] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.579675 27802 consensus_queue.cc:1048] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.600800 27792 tablet_bootstrap.cc:492] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:45.601431 27801 raft_consensus.cc:493] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.601919 27801 raft_consensus.cc:515] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.579988 27794 ts_tablet_manager.cc:1403] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.004s
I20260709 12:19:45.604094 27801 leader_election.cc:290] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:45.605614 27989 leader_election.cc:290] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:45.605628 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:45.606570 27602 raft_consensus.cc:2468] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.580366 27894 raft_consensus.cc:515] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.608075 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:45.608552 27792 ts_tablet_manager.cc:1403] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.010s
I20260709 12:19:45.608644 27750 raft_consensus.cc:3060] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.609920 27793 tablet_bootstrap.cc:654] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.612810 27794 raft_consensus.cc:359] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.613557 27794 raft_consensus.cc:385] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.613809 27794 raft_consensus.cc:740] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.616078 27894 leader_election.cc:290] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:45.580394 27601 raft_consensus.cc:2468] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
W20260709 12:19:45.571416 27566 leader_election.cc:343] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.617069 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61af26ee6a29463f8084851d49c5597c" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:45.592036 27888 consensus_queue.cc:1048] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.617674 27803 consensus_queue.cc:1048] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.596288 27795 tablet_bootstrap.cc:654] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:45.617383 27566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:45493, user_credentials={real_user=slave}} blocked reactor thread for 45996.5us
I20260709 12:19:45.618989 27803 consensus_queue.cc:1048] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.606791 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:45.620007 27523 raft_consensus.cc:2468] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
W20260709 12:19:45.620205 27566 leader_election.cc:343] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.616981 27715 leader_election.cc:304] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:45.621326 27566 leader_election.cc:304] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:45.621519 27673 raft_consensus.cc:3060] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:45.622335 27566 leader_election.cc:343] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.622596 27951 raft_consensus.cc:2749] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.622706 27566 leader_election.cc:304] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:45.623880 27820 raft_consensus.cc:2749] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.624539 28048 raft_consensus.cc:2804] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:45.624912 28048 raft_consensus.cc:493] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.625231 28048 raft_consensus.cc:3060] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:45.629364 27792 raft_consensus.cc:359] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.630092 27792 raft_consensus.cc:385] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.630340 27792 raft_consensus.cc:740] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.633316 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:45.633998 27599 raft_consensus.cc:3060] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.638775 27673 raft_consensus.cc:2468] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:45.648339 27491 leader_election.cc:304] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:45.641265 27599 raft_consensus.cc:2468] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:45.643213 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61af26ee6a29463f8084851d49c5597c" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:45.649279 27602 raft_consensus.cc:3060] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.649501 27888 raft_consensus.cc:2804] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.614491 27794 consensus_queue.cc:260] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.649986 27888 raft_consensus.cc:697] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:45.651239 27888 consensus_queue.cc:237] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.641924 28048 raft_consensus.cc:515] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.656610 27792 consensus_queue.cc:260] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.646556 27750 raft_consensus.cc:2468] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:45.666759 27793 tablet_bootstrap.cc:492] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:45.668128 27492 leader_election.cc:304] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:45.670065 27793 ts_tablet_manager.cc:1403] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.010s
I20260709 12:19:45.671221 27794 ts_tablet_manager.cc:1434] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
I20260709 12:19:45.673938 27794 tablet_bootstrap.cc:492] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:45.675817 27792 ts_tablet_manager.cc:1434] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 12:19:45.676898 27792 tablet_bootstrap.cc:492] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:45.684557 27802 raft_consensus.cc:493] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.684926 27802 raft_consensus.cc:515] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.681655 27990 raft_consensus.cc:2804] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.687856 27795 tablet_bootstrap.cc:492] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:45.673048 27894 consensus_queue.cc:1048] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:19:45.689373 27795 ts_tablet_manager.cc:1403] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.005s
I20260709 12:19:45.696945 28048 leader_election.cc:290] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:45.692752 27820 raft_consensus.cc:493] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.697635 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:45.698247 27526 raft_consensus.cc:3060] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:45.701450 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43107870acfc4582affbc438751f8144" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:45.702054 27599 raft_consensus.cc:3060] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:45.701372 27422 catalog_manager.cc:5697] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:45.704617 27820 raft_consensus.cc:515] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.705518 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:45.706122 27750 raft_consensus.cc:2468] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:45.691067 27990 raft_consensus.cc:697] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:45.709100 27990 consensus_queue.cc:237] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.711483 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:45.713443 27568 leader_election.cc:343] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.711658 27602 raft_consensus.cc:2468] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:45.714147 27802 leader_election.cc:290] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.715811 27795 raft_consensus.cc:359] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.718526 27795 raft_consensus.cc:385] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.718746 27795 raft_consensus.cc:740] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.719725 27803 raft_consensus.cc:493] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.720141 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:45.722175 27794 tablet_bootstrap.cc:654] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.706627 27820 leader_election.cc:290] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.720194 27803 raft_consensus.cc:515] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.728971 27793 raft_consensus.cc:359] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.731563 27793 raft_consensus.cc:385] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.731861 27793 raft_consensus.cc:740] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.732554 27793 consensus_queue.cc:260] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.730235 27795 consensus_queue.cc:260] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:45.741907 27803 leader_election.cc:290] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:45.743650 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f87bb1f2fd40e1b066d978660bf0fe" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:45.744270 27601 raft_consensus.cc:2468] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:45.746153 27715 leader_election.cc:304] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:45.746970 28050 consensus_queue.cc:1048] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.748257 28050 raft_consensus.cc:2804] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.748596 28050 raft_consensus.cc:493] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.748920 28050 raft_consensus.cc:3060] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:45.744163 27642 leader_election.cc:343] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.752802 27640 leader_election.cc:304] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.753734 27988 raft_consensus.cc:2804] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.754098 27988 raft_consensus.cc:493] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.754416 27988 raft_consensus.cc:3060] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.759877 27793 ts_tablet_manager.cc:1434] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 12:19:45.760937 27793 tablet_bootstrap.cc:492] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:45.763585 27795 ts_tablet_manager.cc:1434] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260709 12:19:45.764638 27795 tablet_bootstrap.cc:492] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:45.758644 27526 raft_consensus.cc:2468] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 2.
I20260709 12:19:45.767594 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:45.791281 27794 tablet_bootstrap.cc:492] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:45.791836 27794 ts_tablet_manager.cc:1403] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.014s
I20260709 12:19:45.800685 27794 raft_consensus.cc:359] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.801628 27794 raft_consensus.cc:385] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.802003 27794 raft_consensus.cc:740] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.802564 28050 raft_consensus.cc:515] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.803081 27794 consensus_queue.cc:260] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.804809 28050 leader_election.cc:290] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
W20260709 12:19:45.807802 27566 leader_election.cc:343] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.808138 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f87bb1f2fd40e1b066d978660bf0fe" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:45.808840 27602 raft_consensus.cc:3060] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.811691 27424 catalog_manager.cc:5697] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.812855 27716 leader_election.cc:304] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:45.814396 27566 leader_election.cc:304] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.815946 27956 raft_consensus.cc:2749] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.817251 27599 raft_consensus.cc:2468] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 2.
I20260709 12:19:45.817790 28050 raft_consensus.cc:2804] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:45.801893 28048 consensus_queue.cc:1048] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:19:45.822466 28050 raft_consensus.cc:697] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:45.823053 27988 raft_consensus.cc:515] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.823350 28050 consensus_queue.cc:237] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.825102 27988 leader_election.cc:290] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:45.826128 27525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:45.826692 27525 raft_consensus.cc:3060] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.831053 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:45.831640 27750 raft_consensus.cc:3060] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.806835 27794 ts_tablet_manager.cc:1434] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:19:45.833761 27794 tablet_bootstrap.cc:492] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:45.842113 27527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f87bb1f2fd40e1b066d978660bf0fe" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:45.845814 27521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f87bb1f2fd40e1b066d978660bf0fe" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:45.849912 27793 tablet_bootstrap.cc:654] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.851709 27792 tablet_bootstrap.cc:654] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.860312 27525 raft_consensus.cc:2468] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:45.865001 27642 leader_election.cc:304] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:45.866101 27890 raft_consensus.cc:2804] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.866559 27890 raft_consensus.cc:697] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:45.867352 27890 consensus_queue.cc:237] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:45.870401 27888 raft_consensus.cc:493] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.870930 27888 raft_consensus.cc:515] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
W20260709 12:19:45.879842 27716 leader_election.cc:343] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:45.881140 27716 leader_election.cc:343] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.882364 27803 consensus_queue.cc:1048] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.883231 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:45.883760 27803 consensus_queue.cc:1048] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.884229 27888 leader_election.cc:290] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:45.885149 27425 catalog_manager.cc:5697] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.838433 27988 raft_consensus.cc:493] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.889901 27750 raft_consensus.cc:2468] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:45.896370 27795 tablet_bootstrap.cc:654] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.908640 28044 consensus_queue.cc:1048] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.909289 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:45.895970 27602 raft_consensus.cc:2468] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:45.917296 27492 leader_election.cc:304] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:45.923640 27990 raft_consensus.cc:2749] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:45.924376 28086 log.cc:927] Time spent T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:19:45.917081 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:34993, user_credentials={real_user=slave}} blocked reactor thread for 52151.2us
I20260709 12:19:45.932224 27715 leader_election.cc:304] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:45.933447 28050 raft_consensus.cc:2804] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.933905 28050 raft_consensus.cc:697] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:45.934732 28050 consensus_queue.cc:237] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:45.901463 27988 raft_consensus.cc:515] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:45.952888 27425 catalog_manager.cc:5697] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 2, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 2 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.938683 27801 consensus_queue.cc:1048] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:19:45.956733 28048 consensus_queue.cc:1048] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.080778 27794 tablet_bootstrap.cc:654] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.081700 27793 tablet_bootstrap.cc:492] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:46.082221 27793 ts_tablet_manager.cc:1403] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.321s	user 0.009s	sys 0.007s
W20260709 12:19:46.080668 27714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:45493, user_credentials={real_user=slave}} blocked reactor thread for 92614.6us
W20260709 12:19:46.117728 28092 log.cc:927] Time spent T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Append to log took a long time: real 0.103s	user 0.002s	sys 0.001s
I20260709 12:19:46.121062 27793 raft_consensus.cc:359] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.121783 27793 raft_consensus.cc:385] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.122061 27793 raft_consensus.cc:740] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.123873 27424 catalog_manager.cc:5697] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.122699 27793 consensus_queue.cc:260] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.106046 27523 raft_consensus.cc:3060] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.143792 27793 ts_tablet_manager.cc:1434] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:19:46.153077 27793 tablet_bootstrap.cc:492] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:46.174649 28087 log.cc:927] Time spent T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96: Append to log took a long time: real 0.181s	user 0.005s	sys 0.000s
I20260709 12:19:46.176627 27795 tablet_bootstrap.cc:492] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:46.177358 27795 ts_tablet_manager.cc:1403] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.413s	user 0.017s	sys 0.008s
I20260709 12:19:46.178926 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a307ee39574103a5e8d0dbbc4311a9" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
W20260709 12:19:46.199134 28093 log.cc:927] Time spent T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:19:46.207194 27598 raft_consensus.cc:2393] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:46.207326 27792 tablet_bootstrap.cc:492] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:46.207809 27792 ts_tablet_manager.cc:1403] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.531s	user 0.020s	sys 0.016s
I20260709 12:19:46.211889 27792 raft_consensus.cc:359] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.212531 27792 raft_consensus.cc:385] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.212785 27792 raft_consensus.cc:740] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.213546 27792 consensus_queue.cc:260] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.218066 27792 ts_tablet_manager.cc:1434] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:19:46.218976 27792 tablet_bootstrap.cc:492] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
W20260709 12:19:46.220116 28097 log.cc:927] Time spent T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:19:46.226804 27792 tablet_bootstrap.cc:654] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.231930 27793 tablet_bootstrap.cc:654] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.237861 28050 consensus_queue.cc:1048] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.239007 28102 raft_consensus.cc:493] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.241274 28102 raft_consensus.cc:515] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.244597 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a307ee39574103a5e8d0dbbc4311a9" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:46.247378 28102 leader_election.cc:290] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:46.296612 27795 raft_consensus.cc:359] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.297435 27795 raft_consensus.cc:385] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.297708 27795 raft_consensus.cc:740] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.298444 27795 consensus_queue.cc:260] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.295439 28048 raft_consensus.cc:493] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.303346 27988 leader_election.cc:290] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:46.317996 27795 ts_tablet_manager.cc:1434] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.140s	user 0.006s	sys 0.000s
I20260709 12:19:46.337567 27795 tablet_bootstrap.cc:492] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:46.333264 27520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cb727b47e94021b993343a72045259" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:46.324190 28048 raft_consensus.cc:515] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.366634 28048 leader_election.cc:290] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:46.349258 27894 consensus_queue.cc:1048] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:19:46.369668 27792 tablet_bootstrap.cc:492] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:46.340785 27990 consensus_queue.cc:1048] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:19:46.370189 27792 ts_tablet_manager.cc:1403] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.151s	user 0.037s	sys 0.018s
I20260709 12:19:46.370478 27794 tablet_bootstrap.cc:492] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:46.371003 27794 ts_tablet_manager.cc:1403] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.538s	user 0.021s	sys 0.031s
W20260709 12:19:46.373283 27568 leader_election.cc:343] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.373135 27792 raft_consensus.cc:359] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.373847 27792 raft_consensus.cc:385] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.374140 27792 raft_consensus.cc:740] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.374740 27792 consensus_queue.cc:260] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.376696 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cb727b47e94021b993343a72045259" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:46.377384 27988 raft_consensus.cc:493] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.377876 27988 raft_consensus.cc:515] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.378654 27956 raft_consensus.cc:493] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.379155 27956 raft_consensus.cc:515] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.379841 27988 leader_election.cc:290] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:46.381108 27956 leader_election.cc:290] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:46.349524 27640 leader_election.cc:304] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:46.382079 27520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f3f60349784a56b3225530bd5d5b14" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:46.389035 27793 tablet_bootstrap.cc:492] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:46.389586 27793 ts_tablet_manager.cc:1403] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.245s	user 0.012s	sys 0.010s
I20260709 12:19:46.393288 27746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf91225062d4c728d8ff49b308ebf18" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
W20260709 12:19:46.396198 27642 leader_election.cc:343] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.383469 27792 ts_tablet_manager.cc:1434] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:19:46.398780 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf91225062d4c728d8ff49b308ebf18" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:46.399160 27792 tablet_bootstrap.cc:492] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
W20260709 12:19:46.398048 27640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:38323, user_credentials={real_user=slave}} blocked reactor thread for 53876.6us
I20260709 12:19:46.400183 27525 raft_consensus.cc:1275] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Refusing update from remote peer be117ea016214236abda478b04f7f70c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:46.401031 28090 raft_consensus.cc:3060] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.401265 27795 tablet_bootstrap.cc:654] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.401420 27793 raft_consensus.cc:359] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.402087 27793 raft_consensus.cc:385] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.402333 27793 raft_consensus.cc:740] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
W20260709 12:19:46.386582 27566 leader_election.cc:343] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.402779 27566 leader_election.cc:304] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:46.399014 27990 consensus_queue.cc:1048] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.403434 27793 consensus_queue.cc:260] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.404187 27951 raft_consensus.cc:2749] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.408181 28090 raft_consensus.cc:2749] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.396004 27794 raft_consensus.cc:359] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.411902 27794 raft_consensus.cc:385] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.412176 27794 raft_consensus.cc:740] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
W20260709 12:19:46.412436 27566 leader_election.cc:343] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.412756 27794 consensus_queue.cc:260] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.414534 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f3f60349784a56b3225530bd5d5b14" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:46.415200 27601 raft_consensus.cc:2468] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:46.416342 27794 ts_tablet_manager.cc:1434] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.001s
I20260709 12:19:46.417286 27794 tablet_bootstrap.cc:492] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
W20260709 12:19:46.419574 27566 leader_election.cc:343] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.422462 27793 ts_tablet_manager.cc:1434] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 12:19:46.423416 27793 tablet_bootstrap.cc:492] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:46.419981 27566 leader_election.cc:304] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:46.426333 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a8e7d5f765421391635cebebac4add" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:46.426735 28108 raft_consensus.cc:2749] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.429276 27801 consensus_queue.cc:1048] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.432376 27990 consensus_queue.cc:1048] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.432917 27641 leader_election.cc:304] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:46.434564 27988 raft_consensus.cc:2804] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.435180 27988 raft_consensus.cc:493] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:46.434598 27714 leader_election.cc:343] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.435868 27988 raft_consensus.cc:3060] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.441148 27801 consensus_queue.cc:1048] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.447250 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a8e7d5f765421391635cebebac4add" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:46.448180 27600 raft_consensus.cc:2468] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:46.448650 28098 consensus_queue.cc:1048] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:46.450073 27794 tablet_bootstrap.cc:654] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.451249 27425 catalog_manager.cc:5697] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:46.455597 27473 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:46.460541 27602 raft_consensus.cc:1275] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Refusing update from remote peer be117ea016214236abda478b04f7f70c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:46.482061 27795 tablet_bootstrap.cc:492] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:46.485277 27795 ts_tablet_manager.cc:1403] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.001s
I20260709 12:19:46.487018 27715 leader_election.cc:304] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:46.487488 27988 raft_consensus.cc:515] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.491146 27792 tablet_bootstrap.cc:654] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.488073 27795 raft_consensus.cc:359] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.493615 27795 raft_consensus.cc:385] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.494118 27801 raft_consensus.cc:2804] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.495967 27795 raft_consensus.cc:740] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.496048 27801 raft_consensus.cc:493] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.496531 27801 raft_consensus.cc:3060] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.500643 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f3f60349784a56b3225530bd5d5b14" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:46.502310 27523 raft_consensus.cc:3060] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.504834 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f3f60349784a56b3225530bd5d5b14" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:46.506829 27602 raft_consensus.cc:3060] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.513597 27602 raft_consensus.cc:2468] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:46.482733 27793 tablet_bootstrap.cc:654] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.529127 28050 consensus_queue.cc:1048] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.530531 27990 raft_consensus.cc:493] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.531069 27990 raft_consensus.cc:515] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.531535 28050 consensus_queue.cc:1048] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.533689 28090 consensus_queue.cc:1048] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.533928 27990 leader_election.cc:290] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:46.542073 27641 leader_election.cc:304] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:46.543110 28098 raft_consensus.cc:2804] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.543606 28098 raft_consensus.cc:697] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:46.544425 28098 consensus_queue.cc:237] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.555565 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f87bb1f2fd40e1b066d978660bf0fe" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:46.505417 27988 leader_election.cc:290] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:46.505971 27801 raft_consensus.cc:515] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.496764 27795 consensus_queue.cc:260] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.557603 27951 raft_consensus.cc:493] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.558058 27951 raft_consensus.cc:515] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.558444 27801 leader_election.cc:290] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:46.561008 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a8e7d5f765421391635cebebac4add" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:46.561609 27951 leader_election.cc:290] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:46.562208 27523 raft_consensus.cc:2468] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:46.563764 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:46.564774 27793 tablet_bootstrap.cc:492] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
W20260709 12:19:46.565143 27568 leader_election.cc:343] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.566082 27795 ts_tablet_manager.cc:1434] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.001s
I20260709 12:19:46.567041 27795 tablet_bootstrap.cc:492] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
W20260709 12:19:46.567293 27714 leader_election.cc:343] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.571719 27525 raft_consensus.cc:3060] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.575475 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f87bb1f2fd40e1b066d978660bf0fe" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:46.576550 27600 raft_consensus.cc:2393] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de15618bc48545b6986320ca2292fc60 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:46.565255 27793 ts_tablet_manager.cc:1403] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.142s	user 0.007s	sys 0.002s
I20260709 12:19:46.578408 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a8e7d5f765421391635cebebac4add" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:46.579015 27601 raft_consensus.cc:3060] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.585382 28044 consensus_queue.cc:1048] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.590749 27793 raft_consensus.cc:359] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.591446 27793 raft_consensus.cc:385] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.591719 27793 raft_consensus.cc:740] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.597129 27792 tablet_bootstrap.cc:492] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:46.597608 27792 ts_tablet_manager.cc:1403] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.010s
I20260709 12:19:46.598726 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:46.600158 27792 raft_consensus.cc:359] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.600859 27792 raft_consensus.cc:385] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.601121 27792 raft_consensus.cc:740] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.604770 27492 leader_election.cc:304] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:46.605680 27794 tablet_bootstrap.cc:492] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:46.606133 27794 ts_tablet_manager.cc:1403] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.189s	user 0.017s	sys 0.005s
I20260709 12:19:46.609146 27793 consensus_queue.cc:260] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.611265 27792 consensus_queue.cc:260] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.612239 27794 raft_consensus.cc:359] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.613122 27794 raft_consensus.cc:385] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.613371 27794 raft_consensus.cc:740] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.613494 27792 ts_tablet_manager.cc:1434] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:19:46.614260 27794 consensus_queue.cc:260] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.614949 27792 tablet_bootstrap.cc:492] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:46.620088 27792 tablet_bootstrap.cc:654] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.621068 27794 ts_tablet_manager.cc:1434] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:19:46.622100 27794 tablet_bootstrap.cc:492] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
W20260709 12:19:46.624199 27566 leader_election.cc:343] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.624641 27566 leader_election.cc:304] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:46.629246 27794 tablet_bootstrap.cc:654] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.631366 27795 tablet_bootstrap.cc:654] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.640228 27794 tablet_bootstrap.cc:492] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:46.642268 27794 ts_tablet_manager.cc:1403] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.004s
I20260709 12:19:46.644356 27793 ts_tablet_manager.cc:1434] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.067s	user 0.003s	sys 0.003s
I20260709 12:19:46.645102 27422 catalog_manager.cc:5697] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.646060 27795 tablet_bootstrap.cc:492] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:46.646570 27795 ts_tablet_manager.cc:1403] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.002s
I20260709 12:19:46.646786 27990 raft_consensus.cc:2749] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.614185 27601 raft_consensus.cc:2468] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:46.649307 27793 tablet_bootstrap.cc:492] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:46.653052 27794 raft_consensus.cc:359] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.653719 27794 raft_consensus.cc:385] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.653962 27794 raft_consensus.cc:740] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.654585 27794 consensus_queue.cc:260] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.655911 27801 consensus_queue.cc:1048] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.657296 27793 tablet_bootstrap.cc:654] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.656279 27715 leader_election.cc:304] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96
I20260709 12:19:46.659116 27951 raft_consensus.cc:2749] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.669296 27795 raft_consensus.cc:359] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.672081 27795 raft_consensus.cc:385] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.672415 27795 raft_consensus.cc:740] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.673187 27795 consensus_queue.cc:260] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.675011 27795 ts_tablet_manager.cc:1434] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:19:46.675979 27795 tablet_bootstrap.cc:492] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:46.677959 27794 ts_tablet_manager.cc:1434] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:19:46.680696 27792 tablet_bootstrap.cc:492] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:46.683037 27801 raft_consensus.cc:2804] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.687686 27792 ts_tablet_manager.cc:1403] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.004s
I20260709 12:19:46.683502 28044 raft_consensus.cc:493] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.688185 28044 raft_consensus.cc:515] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
W20260709 12:19:46.670784 27566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.4:38323, user_credentials={real_user=slave}} blocked reactor thread for 46618.3us
I20260709 12:19:46.690263 28044 leader_election.cc:290] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:46.691560 27794 tablet_bootstrap.cc:492] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:46.691951 27990 raft_consensus.cc:493] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.696579 27990 raft_consensus.cc:515] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.699208 27801 raft_consensus.cc:697] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:46.692636 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:46.700002 27801 consensus_queue.cc:237] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.701154 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:46.693166 27792 raft_consensus.cc:359] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.703167 27792 raft_consensus.cc:385] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.703701 27792 raft_consensus.cc:740] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
W20260709 12:19:46.704360 27716 leader_election.cc:343] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.705191 27792 consensus_queue.cc:260] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.716110 27792 ts_tablet_manager.cc:1434] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 12:19:46.698762 27990 leader_election.cc:290] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:46.714043 27673 raft_consensus.cc:2468] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:46.719619 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:46.720299 27601 raft_consensus.cc:2468] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:46.720548 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:46.721215 27600 raft_consensus.cc:2468] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:46.720424 27491 leader_election.cc:304] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:46.720104 27795 tablet_bootstrap.cc:654] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.722501 27894 raft_consensus.cc:2804] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.722873 27894 raft_consensus.cc:493] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.723188 27894 raft_consensus.cc:3060] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.725800 27792 tablet_bootstrap.cc:492] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:46.735544 27792 tablet_bootstrap.cc:654] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.738996 27715 leader_election.cc:304] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:46.740322 27801 raft_consensus.cc:2804] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.741276 27801 raft_consensus.cc:493] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.741958 27801 raft_consensus.cc:3060] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.750715 27801 raft_consensus.cc:515] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.740831 27894 raft_consensus.cc:515] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.754180 27801 leader_election.cc:290] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:46.759663 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:46.760306 27600 raft_consensus.cc:3060] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.759682 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:46.765762 27988 raft_consensus.cc:493] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.766326 27988 raft_consensus.cc:515] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.768471 27988 leader_election.cc:290] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:46.770174 27794 tablet_bootstrap.cc:654] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.771708 27525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a629b1a82d14248a102eec847a92754" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:46.772729 27793 tablet_bootstrap.cc:492] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
W20260709 12:19:46.772940 27716 leader_election.cc:343] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.773201 27793 ts_tablet_manager.cc:1403] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.036s
W20260709 12:19:46.774015 27642 leader_election.cc:343] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.774703 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:46.775300 27601 raft_consensus.cc:3060] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.775947 27793 raft_consensus.cc:359] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.776600 27793 raft_consensus.cc:385] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.776841 27793 raft_consensus.cc:740] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.777500 27793 consensus_queue.cc:260] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.778996 27793 ts_tablet_manager.cc:1434] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:19:46.779894 27793 tablet_bootstrap.cc:492] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:46.781773 27601 raft_consensus.cc:2468] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:46.778291 27425 catalog_manager.cc:5697] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.783692 27492 leader_election.cc:304] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:46.786129 27894 leader_election.cc:290] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:46.786772 27990 raft_consensus.cc:2804] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.787235 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:46.801540 27990 raft_consensus.cc:697] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:46.795492 27746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a629b1a82d14248a102eec847a92754" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:46.802659 27746 raft_consensus.cc:2468] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:46.802453 27990 consensus_queue.cc:237] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.801615 27673 raft_consensus.cc:3060] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.794061 27600 raft_consensus.cc:2468] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:46.809705 27640 leader_election.cc:304] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:46.810811 27988 raft_consensus.cc:2804] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.811182 27988 raft_consensus.cc:493] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.811718 27988 raft_consensus.cc:3060] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.811892 27792 tablet_bootstrap.cc:492] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:46.813748 27792 ts_tablet_manager.cc:1403] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.089s	user 0.031s	sys 0.017s
I20260709 12:19:46.811235 28098 raft_consensus.cc:493] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.815088 28098 raft_consensus.cc:515] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.817178 28098 leader_election.cc:290] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:46.817942 27792 raft_consensus.cc:359] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.818646 27792 raft_consensus.cc:385] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.819216 27988 raft_consensus.cc:515] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.821429 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a8e7d5f765421391635cebebac4add" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:46.823227 27988 leader_election.cc:290] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:46.823815 27600 raft_consensus.cc:2393] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:46.822611 27715 leader_election.cc:304] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:46.822727 27525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a629b1a82d14248a102eec847a92754" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:46.826041 27794 tablet_bootstrap.cc:492] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:46.825564 27673 raft_consensus.cc:2468] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:46.826275 27525 raft_consensus.cc:3060] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.826787 27794 ts_tablet_manager.cc:1403] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.003s
I20260709 12:19:46.829475 27794 raft_consensus.cc:359] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.830070 27794 raft_consensus.cc:385] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.830312 27794 raft_consensus.cc:740] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.830902 27794 consensus_queue.cc:260] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.834830 27525 raft_consensus.cc:2468] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:46.835390 27801 raft_consensus.cc:2804] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.836195 27801 raft_consensus.cc:697] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:46.836930 27801 consensus_queue.cc:237] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.837885 27794 ts_tablet_manager.cc:1434] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:19:46.838832 27794 tablet_bootstrap.cc:492] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:46.843217 27642 leader_election.cc:304] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:46.842777 27421 catalog_manager.cc:5697] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.843930 27988 raft_consensus.cc:2804] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.844388 27988 raft_consensus.cc:697] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:46.845147 27988 consensus_queue.cc:237] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.846657 27795 tablet_bootstrap.cc:492] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:46.847164 27795 ts_tablet_manager.cc:1403] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.171s	user 0.022s	sys 0.023s
I20260709 12:19:46.847652 27746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a8e7d5f765421391635cebebac4add" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:46.849218 27746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a629b1a82d14248a102eec847a92754" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:46.818921 27792 raft_consensus.cc:740] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.849686 27795 raft_consensus.cc:359] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.850808 27795 raft_consensus.cc:385] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.851075 27795 raft_consensus.cc:740] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.851714 27795 consensus_queue.cc:260] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.853619 27795 ts_tablet_manager.cc:1434] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 12:19:46.854079 27792 consensus_queue.cc:260] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.849730 27746 raft_consensus.cc:3060] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.856498 27792 ts_tablet_manager.cc:1434] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:19:46.861518 27794 tablet_bootstrap.cc:654] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.862358 27792 tablet_bootstrap.cc:492] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:46.863626 27793 tablet_bootstrap.cc:654] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.864818 27795 tablet_bootstrap.cc:492] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:46.873441 27792 tablet_bootstrap.cc:654] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.864921 27425 catalog_manager.cc:5697] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.866307 27421 catalog_manager.cc:5697] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.881515 27795 tablet_bootstrap.cc:654] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.877674 27820 raft_consensus.cc:493] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.889042 27820 raft_consensus.cc:515] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.891156 27820 leader_election.cc:290] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:46.892125 27640 leader_election.cc:304] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:46.897907 27793 tablet_bootstrap.cc:492] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:46.898695 27793 ts_tablet_manager.cc:1403] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.004s
I20260709 12:19:46.904639 28098 raft_consensus.cc:3060] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.902321 27793 raft_consensus.cc:359] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.906932 27793 raft_consensus.cc:385] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.907220 27793 raft_consensus.cc:740] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.907873 27793 consensus_queue.cc:260] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.910805 27793 ts_tablet_manager.cc:1434] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:19:46.912940 27793 tablet_bootstrap.cc:492] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:46.892177 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:46.892961 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:46.892289 27746 raft_consensus.cc:2468] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
W20260709 12:19:46.919159 27566 leader_election.cc:343] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:46.920666 27566 leader_election.cc:343] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.921070 27566 leader_election.cc:304] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:46.922356 27820 raft_consensus.cc:2749] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.912856 28098 raft_consensus.cc:2749] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.925541 27793 tablet_bootstrap.cc:654] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.929570 27795 tablet_bootstrap.cc:492] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:46.930416 27792 tablet_bootstrap.cc:492] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:46.930810 27792 ts_tablet_manager.cc:1403] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.012s
I20260709 12:19:46.931119 27795 ts_tablet_manager.cc:1403] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.007s
I20260709 12:19:46.933705 27792 raft_consensus.cc:359] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.933770 27795 raft_consensus.cc:359] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.934484 27792 raft_consensus.cc:385] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.934551 27795 raft_consensus.cc:385] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.934957 27792 raft_consensus.cc:740] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.935099 27795 raft_consensus.cc:740] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.935807 27795 consensus_queue.cc:260] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.935915 27792 consensus_queue.cc:260] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:46.937989 27792 ts_tablet_manager.cc:1434] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:19:46.940027 27792 tablet_bootstrap.cc:492] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:46.942765 27795 ts_tablet_manager.cc:1434] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:19:46.944712 27795 tablet_bootstrap.cc:492] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67: Bootstrap starting.
I20260709 12:19:46.945698 27792 tablet_bootstrap.cc:654] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.949565 27794 tablet_bootstrap.cc:492] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:46.950024 27794 ts_tablet_manager.cc:1403] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.017s
I20260709 12:19:46.957324 27801 raft_consensus.cc:493] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.957839 27801 raft_consensus.cc:515] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.959609 27795 tablet_bootstrap.cc:654] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.959880 27801 leader_election.cc:290] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:46.962005 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:46.962260 27794 raft_consensus.cc:359] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.963052 27794 raft_consensus.cc:385] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.963338 27794 raft_consensus.cc:740] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.962714 27600 raft_consensus.cc:2468] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:46.964030 27794 consensus_queue.cc:260] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:46.965292 28107 raft_consensus.cc:493] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.966104 27794 ts_tablet_manager.cc:1434] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:19:46.965830 28107 raft_consensus.cc:515] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:46.966658 27715 leader_election.cc:304] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:46.968348 28116 raft_consensus.cc:2804] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.968726 28116 raft_consensus.cc:493] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.969066 28116 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.963510 27525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:46.976948 27716 leader_election.cc:343] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.980072 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3cbf0efe649f592da4a1f3a3b331a" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:46.980892 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3cbf0efe649f592da4a1f3a3b331a" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:46.982121 27566 leader_election.cc:343] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.982385 28048 raft_consensus.cc:493] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:46.982702 27568 leader_election.cc:343] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.983191 27568 leader_election.cc:304] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:46.983901 27820 raft_consensus.cc:2749] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.985663 27795 tablet_bootstrap.cc:492] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67: No bootstrap required, opened a new log
I20260709 12:19:46.986129 27795 ts_tablet_manager.cc:1403] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 12:19:46.979909 28107 leader_election.cc:290] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:46.989411 27795 raft_consensus.cc:359] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.990080 27795 raft_consensus.cc:385] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.990402 27795 raft_consensus.cc:740] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.991685 27795 consensus_queue.cc:260] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:46.993408 27795 ts_tablet_manager.cc:1434] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:46.996133 27793 tablet_bootstrap.cc:492] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:46.996616 27793 ts_tablet_manager.cc:1403] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.084s	user 0.020s	sys 0.003s
I20260709 12:19:47.000192 27793 raft_consensus.cc:359] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.000938 27793 raft_consensus.cc:385] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.001205 27793 raft_consensus.cc:740] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.001842 27793 consensus_queue.cc:260] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.007694 27793 ts_tablet_manager.cc:1434] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:19:47.008726 27793 tablet_bootstrap.cc:492] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:47.005256 27792 tablet_bootstrap.cc:492] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:47.010156 27792 ts_tablet_manager.cc:1403] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.038s
I20260709 12:19:47.000176 27794 tablet_bootstrap.cc:492] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:47.012820 27792 raft_consensus.cc:359] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.013500 27792 raft_consensus.cc:385] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.013809 27792 raft_consensus.cc:740] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.014472 27792 consensus_queue.cc:260] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.016821 27792 ts_tablet_manager.cc:1434] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:47.018582 27792 tablet_bootstrap.cc:492] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:46.982928 28048 raft_consensus.cc:515] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.020716 28048 leader_election.cc:290] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:47.023631 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec8141371c04e69b06fc2f3b1fffef9" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:47.024242 27673 raft_consensus.cc:2468] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:47.025125 27792 tablet_bootstrap.cc:654] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.026160 27714 leader_election.cc:304] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:47.031034 28048 raft_consensus.cc:2804] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.031487 28048 raft_consensus.cc:493] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.031869 28048 raft_consensus.cc:3060] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.035307 27794 tablet_bootstrap.cc:654] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.037427 27792 tablet_bootstrap.cc:492] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:47.037865 27792 ts_tablet_manager.cc:1403] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 12:19:47.018450 27793 tablet_bootstrap.cc:654] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.041136 28098 consensus_queue.cc:1048] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:47.040509 27792 raft_consensus.cc:359] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.043231 27792 raft_consensus.cc:385] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.043574 27792 raft_consensus.cc:740] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.044332 27792 consensus_queue.cc:260] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.048231 27792 ts_tablet_manager.cc:1434] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:47.049580 27792 tablet_bootstrap.cc:492] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:47.051792 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec8141371c04e69b06fc2f3b1fffef9" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:47.059159 27792 tablet_bootstrap.cc:654] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.062312 28098 consensus_queue.cc:1048] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:47.076727 27794 tablet_bootstrap.cc:492] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:47.077242 27794 ts_tablet_manager.cc:1403] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.001s
I20260709 12:19:47.078658 27820 raft_consensus.cc:493] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.079243 27820 raft_consensus.cc:515] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.080138 27793 tablet_bootstrap.cc:492] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:47.080611 27793 ts_tablet_manager.cc:1403] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.000s
I20260709 12:19:47.081236 27820 leader_election.cc:290] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:47.083164 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438693ab12264201bb1a9cf7690d128a" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
W20260709 12:19:47.084630 27566 leader_election.cc:343] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.087020 27793 raft_consensus.cc:359] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.087721 27793 raft_consensus.cc:385] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.087981 27793 raft_consensus.cc:740] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.088368 27523 raft_consensus.cc:2468] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:47.088492 27794 raft_consensus.cc:359] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.088606 27793 consensus_queue.cc:260] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.089303 27794 raft_consensus.cc:385] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.090157 27794 raft_consensus.cc:740] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.090664 27793 ts_tablet_manager.cc:1434] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:47.090992 27794 consensus_queue.cc:260] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.091601 27793 tablet_bootstrap.cc:492] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:47.096820 27801 consensus_queue.cc:1048] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:47.098183 28111 raft_consensus.cc:493] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.099179 28111 raft_consensus.cc:515] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.101418 27792 tablet_bootstrap.cc:492] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:47.101886 27792 ts_tablet_manager.cc:1403] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.012s
I20260709 12:19:47.101969 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f8b7dcacaf41f18a7974c565deffd4" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:47.102613 28111 leader_election.cc:290] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:47.102617 27598 raft_consensus.cc:2468] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:47.104537 27794 ts_tablet_manager.cc:1434] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:19:47.105136 27715 leader_election.cc:304] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:47.105492 27794 tablet_bootstrap.cc:492] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:47.106011 28111 raft_consensus.cc:2804] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.106418 28111 raft_consensus.cc:493] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.098456 27793 tablet_bootstrap.cc:654] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.106797 28111 raft_consensus.cc:3060] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.114410 27792 raft_consensus.cc:359] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.115108 27792 raft_consensus.cc:385] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.115371 27792 raft_consensus.cc:740] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.118815 27792 consensus_queue.cc:260] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.121604 28111 raft_consensus.cc:515] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.122268 27792 ts_tablet_manager.cc:1434] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 12:19:47.124711 27792 tablet_bootstrap.cc:492] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:47.127715 27793 tablet_bootstrap.cc:492] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:47.127875 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f8b7dcacaf41f18a7974c565deffd4" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:47.122532 27794 tablet_bootstrap.cc:654] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.128418 27793 ts_tablet_manager.cc:1403] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 12:19:47.128695 27598 raft_consensus.cc:3060] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.129729 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438693ab12264201bb1a9cf7690d128a" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:47.131099 27793 raft_consensus.cc:359] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.131750 27793 raft_consensus.cc:385] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.132072 27793 raft_consensus.cc:740] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.132664 27793 consensus_queue.cc:260] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
W20260709 12:19:47.133311 27568 leader_election.cc:343] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.133752 27568 leader_election.cc:304] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:47.134207 27793 ts_tablet_manager.cc:1434] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:19:47.134418 27820 raft_consensus.cc:2749] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:47.136667 27793 tablet_bootstrap.cc:492] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:47.143798 27792 tablet_bootstrap.cc:654] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:47.144047 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:34993, user_credentials={real_user=slave}} blocked reactor thread for 48859.8us
I20260709 12:19:47.149425 28111 leader_election.cc:290] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:47.153193 27793 tablet_bootstrap.cc:654] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.152307 28116 raft_consensus.cc:515] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.147826 28048 raft_consensus.cc:515] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.156911 28116 leader_election.cc:290] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:47.157974 28048 leader_election.cc:290] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
W20260709 12:19:47.203274 27640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:38323, user_credentials={real_user=slave}} blocked reactor thread for 102233us
W20260709 12:19:47.208611 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:34993, user_credentials={real_user=slave}} blocked reactor thread for 61626us
I20260709 12:19:47.209538 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f8b7dcacaf41f18a7974c565deffd4" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:47.211118 27670 raft_consensus.cc:3060] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.209388 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f8b7dcacaf41f18a7974c565deffd4" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:47.223124 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec8141371c04e69b06fc2f3b1fffef9" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:47.224246 27524 raft_consensus.cc:3060] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.231395 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:47.240206 27894 raft_consensus.cc:493] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.241362 27894 raft_consensus.cc:515] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.243714 27600 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.251835 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:47.252949 27523 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.268596 27894 leader_election.cc:290] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:47.233613 27820 raft_consensus.cc:493] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.272563 27820 raft_consensus.cc:515] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.276240 27596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:47.277328 27596 raft_consensus.cc:2393] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de15618bc48545b6986320ca2292fc60 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:47.286279 27988 raft_consensus.cc:493] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.296758 27820 leader_election.cc:290] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:47.303531 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec8141371c04e69b06fc2f3b1fffef9" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:47.304435 27673 raft_consensus.cc:3060] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.307479 27988 raft_consensus.cc:515] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.310252 27988 leader_election.cc:290] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:47.320555 27794 tablet_bootstrap.cc:492] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:47.322063 28163 raft_consensus.cc:493] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.322981 28163 raft_consensus.cc:515] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.323590 27794 ts_tablet_manager.cc:1403] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.218s	user 0.011s	sys 0.010s
I20260709 12:19:47.330170 27793 tablet_bootstrap.cc:492] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:47.333385 27792 tablet_bootstrap.cc:492] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:47.333663 27794 raft_consensus.cc:359] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.334169 27792 ts_tablet_manager.cc:1403] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.210s	user 0.019s	sys 0.014s
I20260709 12:19:47.334477 27794 raft_consensus.cc:385] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.334777 27794 raft_consensus.cc:740] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.335067 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3cbf0efe649f592da4a1f3a3b331a" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:47.335856 27601 raft_consensus.cc:2468] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:47.335558 27794 consensus_queue.cc:260] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.338779 27524 raft_consensus.cc:2468] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.340075 27641 leader_election.cc:304] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:47.340622 28048 raft_consensus.cc:493] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.342948 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cb727b47e94021b993343a72045259" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:47.342808 28048 raft_consensus.cc:515] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.343677 27601 raft_consensus.cc:2468] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:47.345664 27792 raft_consensus.cc:359] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.346362 27792 raft_consensus.cc:385] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.348047 28048 leader_election.cc:290] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:47.346515 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf91225062d4c728d8ff49b308ebf18" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:47.349107 27988 raft_consensus.cc:2804] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.349805 27641 leader_election.cc:304] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:47.332937 27746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:47.341724 27523 raft_consensus.cc:2468] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.351591 27792 raft_consensus.cc:740] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.350696 27988 raft_consensus.cc:493] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:47.351624 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.1:34993, user_credentials={real_user=slave}} blocked reactor thread for 134741us
I20260709 12:19:47.325742 28163 leader_election.cc:290] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:47.364313 27988 raft_consensus.cc:3060] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.376260 27989 raft_consensus.cc:493] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.376863 27989 raft_consensus.cc:515] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.381508 28164 raft_consensus.cc:2804] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.382042 28164 raft_consensus.cc:493] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.382421 28164 raft_consensus.cc:3060] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.388937 27792 consensus_queue.cc:260] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.392081 27672 raft_consensus.cc:2468] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:47.401732 27714 leader_election.cc:304] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:47.394903 28048 consensus_queue.cc:1048] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:19:47.403229 27803 raft_consensus.cc:2804] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.403683 27803 raft_consensus.cc:493] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.404031 27803 raft_consensus.cc:3060] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.400733 27716 leader_election.cc:304] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:47.409129 27597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf91225062d4c728d8ff49b308ebf18" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:47.409415 28111 raft_consensus.cc:2804] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.409988 27597 raft_consensus.cc:2468] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:47.413570 27793 ts_tablet_manager.cc:1403] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.277s	user 0.010s	sys 0.011s
I20260709 12:19:47.414101 27673 raft_consensus.cc:2468] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.398686 27794 ts_tablet_manager.cc:1434] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.003s
I20260709 12:19:47.410012 28111 raft_consensus.cc:697] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
W20260709 12:19:47.401635 27492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:38235, user_credentials={real_user=slave}} blocked reactor thread for 53803us
I20260709 12:19:47.422320 28111 consensus_queue.cc:237] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.423516 27714 leader_election.cc:304] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:47.424232 27600 raft_consensus.cc:2468] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.425657 28044 raft_consensus.cc:2804] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.431998 28044 raft_consensus.cc:697] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:47.428262 27793 raft_consensus.cc:359] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.433156 27793 raft_consensus.cc:385] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.435698 28116 consensus_queue.cc:1048] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:47.434018 27793 raft_consensus.cc:740] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
W20260709 12:19:47.434031 27491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.4:38323, user_credentials={real_user=slave}} blocked reactor thread for 70260us
I20260709 12:19:47.439343 27801 raft_consensus.cc:493] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.439824 27801 raft_consensus.cc:515] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.441876 27801 leader_election.cc:290] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:47.452185 27523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf3cff3a1874453ab1973cc35091fa0" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:47.444245 27793 consensus_queue.cc:260] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.456120 27596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:47.456864 27596 raft_consensus.cc:2468] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:47.455389 27792 ts_tablet_manager.cc:1434] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.121s	user 0.005s	sys 0.005s
I20260709 12:19:47.436045 27989 leader_election.cc:290] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:47.456228 27524 raft_consensus.cc:3060] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.466272 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af49c4f1e7b4c12a9985f530fc9603b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:47.472103 27673 raft_consensus.cc:2468] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:47.461171 27670 raft_consensus.cc:2468] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.478030 27793 ts_tablet_manager.cc:1434] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.003s
I20260709 12:19:47.480077 28173 consensus_queue.cc:1048] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:19:47.482636 27714 leader_election.cc:304] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:47.433261 28044 consensus_queue.cc:237] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.491735 27794 tablet_bootstrap.cc:492] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c: Bootstrap starting.
W20260709 12:19:47.502686 27568 leader_election.cc:343] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.492846 28164 raft_consensus.cc:515] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.516273 27792 tablet_bootstrap.cc:492] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:47.528359 27714 leader_election.cc:304] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:47.521673 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3cbf0efe649f592da4a1f3a3b331a" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:47.533516 27792 tablet_bootstrap.cc:654] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.539562 27988 raft_consensus.cc:515] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.552874 27988 leader_election.cc:290] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:47.536258 28048 raft_consensus.cc:2804] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.535879 27598 raft_consensus.cc:2468] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.563002 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf3cff3a1874453ab1973cc35091fa0" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:47.550649 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cb727b47e94021b993343a72045259" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:47.572275 28111 raft_consensus.cc:2804] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.572913 28111 raft_consensus.cc:697] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:47.574065 28111 consensus_queue.cc:237] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.572276 27526 raft_consensus.cc:2468] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:47.556527 28048 raft_consensus.cc:493] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.576627 28164 leader_election.cc:290] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:47.576766 28048 raft_consensus.cc:3060] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:47.579620 27714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:45493, user_credentials={real_user=slave}} blocked reactor thread for 51338.8us
W20260709 12:19:47.591043 27715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.2:38235, user_credentials={real_user=slave}} blocked reactor thread for 54894.7us
I20260709 12:19:47.566141 27492 leader_election.cc:304] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:47.606700 28174 raft_consensus.cc:2804] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:47.607172 28174 raft_consensus.cc:493] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.608317 28174 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:47.605369 27492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.2:38235, user_credentials={real_user=slave}} blocked reactor thread for 48330us
I20260709 12:19:47.621037 28174 raft_consensus.cc:515] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.623250 28174 leader_election.cc:290] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
W20260709 12:19:47.627220 28177 log.cc:927] Time spent T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:19:47.610136 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af49c4f1e7b4c12a9985f530fc9603b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:47.632892 27526 raft_consensus.cc:2468] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
W20260709 12:19:47.649813 27642 leader_election.cc:343] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.680241 27794 tablet_bootstrap.cc:654] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.691339 28187 consensus_queue.cc:1048] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:19:47.676010 27803 raft_consensus.cc:515] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.709796 28048 raft_consensus.cc:515] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.710294 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:47.717083 27792 tablet_bootstrap.cc:492] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:47.717751 27792 ts_tablet_manager.cc:1403] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.214s	user 0.023s	sys 0.022s
I20260709 12:19:47.723621 28048 leader_election.cc:290] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:47.734673 27491 leader_election.cc:304] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:47.735494 27894 raft_consensus.cc:2749] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:47.737478 27803 leader_election.cc:290] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:47.739102 28174 consensus_queue.cc:1048] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:47.742270 27566 leader_election.cc:343] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.742694 27566 leader_election.cc:304] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:47.744105 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:47.747430 27956 raft_consensus.cc:2749] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:47.749222 27794 tablet_bootstrap.cc:492] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:47.749714 27794 ts_tablet_manager.cc:1403] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.258s	user 0.021s	sys 0.012s
I20260709 12:19:47.752591 27794 raft_consensus.cc:359] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.753268 27794 raft_consensus.cc:385] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.753537 27794 raft_consensus.cc:740] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.754231 27794 consensus_queue.cc:260] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.755811 27794 ts_tablet_manager.cc:1434] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:19:47.755972 27525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3cbf0efe649f592da4a1f3a3b331a" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:47.757292 27792 raft_consensus.cc:359] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.757624 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cb727b47e94021b993343a72045259" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:47.757972 27792 raft_consensus.cc:385] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.758317 27792 raft_consensus.cc:740] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.761111 27793 tablet_bootstrap.cc:492] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:47.760689 27792 consensus_queue.cc:260] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.763090 27792 ts_tablet_manager.cc:1434] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 12:19:47.764213 27792 tablet_bootstrap.cc:492] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:47.767643 27601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:47.769937 27601 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:47.773147 27520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af49c4f1e7b4c12a9985f530fc9603b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:47.773790 27520 raft_consensus.cc:3060] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:47.774459 28178 log.cc:927] Time spent T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: Append to log took a long time: real 0.216s	user 0.000s	sys 0.003s
I20260709 12:19:47.783404 27524 raft_consensus.cc:3060] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.787256 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af49c4f1e7b4c12a9985f530fc9603b" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:47.787333 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf91225062d4c728d8ff49b308ebf18" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:47.789345 27674 raft_consensus.cc:3060] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:47.790522 28185 log.cc:927] Time spent T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:19:47.803702 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf91225062d4c728d8ff49b308ebf18" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:47.804538 27599 raft_consensus.cc:3060] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.806071 28172 consensus_queue.cc:1048] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:47.808701 27642 leader_election.cc:343] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.809243 27792 tablet_bootstrap.cc:654] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.788913 27670 raft_consensus.cc:3060] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:47.811499 28192 log.cc:927] Time spent T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:19:47.815430 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3cbf0efe649f592da4a1f3a3b331a" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:47.815841 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cb727b47e94021b993343a72045259" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:47.816128 27598 raft_consensus.cc:3060] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.816465 27602 raft_consensus.cc:3060] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.822930 27601 raft_consensus.cc:2468] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:19:47.837678 27492 leader_election.cc:304] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: be117ea016214236abda478b04f7f70c
I20260709 12:19:47.838670 27990 raft_consensus.cc:2804] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:47.839268 27990 raft_consensus.cc:697] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:47.840184 27990 consensus_queue.cc:237] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:47.847954 27794 tablet_bootstrap.cc:492] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:47.858032 28098 consensus_queue.cc:1048] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:47.858569 27674 raft_consensus.cc:2468] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.870729 27714 leader_election.cc:304] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:47.871706 28189 raft_consensus.cc:2804] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.872246 28189 raft_consensus.cc:697] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:47.873225 28189 consensus_queue.cc:237] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:47.876988 27520 raft_consensus.cc:2468] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.881676 27793 tablet_bootstrap.cc:654] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.880671 27716 leader_election.cc:304] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:47.889776 28111 raft_consensus.cc:2804] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.891628 27602 raft_consensus.cc:2468] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:47.891260 28111 raft_consensus.cc:697] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:47.893934 28111 consensus_queue.cc:237] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.897644 27423 catalog_manager.cc:5697] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:47.899997 27423 catalog_manager.cc:5697] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:47.901533 27423 catalog_manager.cc:5697] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.908878 27641 leader_election.cc:304] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:47.909742 28098 raft_consensus.cc:2804] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.910231 28098 raft_consensus.cc:697] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:47.911423 28098 consensus_queue.cc:237] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
W20260709 12:19:47.924827 27473 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:47.948828 27794 tablet_bootstrap.cc:654] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.951483 27670 raft_consensus.cc:2468] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.949975 28163 raft_consensus.cc:493] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.973810 27524 raft_consensus.cc:2468] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:47.974416 27599 raft_consensus.cc:2468] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:47.977409 27595 raft_consensus.cc:1240] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Rejecting Update request from peer be117ea016214236abda478b04f7f70c for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:47.966727 28163 raft_consensus.cc:515] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:47.970635 27598 raft_consensus.cc:2468] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:47.980361 28163 leader_election.cc:290] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:47.991240 27641 leader_election.cc:304] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:47.992426 28163 raft_consensus.cc:2804] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.996385 28163 raft_consensus.cc:697] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:47.997370 28163 consensus_queue.cc:237] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:47.997937 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a5aef7a6d84eb79c2a50447c018732" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:48.000154 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a5aef7a6d84eb79c2a50447c018732" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:47.996162 28184 consensus_queue.cc:1059] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:48.004168 27793 tablet_bootstrap.cc:492] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:48.004818 27793 ts_tablet_manager.cc:1403] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.244s	user 0.017s	sys 0.012s
W20260709 12:19:48.005321 27642 leader_election.cc:343] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:48.009475 27640 leader_election.cc:343] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be117ea016214236abda478b04f7f70c (127.19.108.4:38323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.009903 27640 leader_election.cc:304] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:48.012348 27988 raft_consensus.cc:2749] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.004755 28184 raft_consensus.cc:3055] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:48.014808 27793 raft_consensus.cc:359] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:48.004140 27792 tablet_bootstrap.cc:492] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:48.026835 28116 consensus_queue.cc:1048] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:19:48.032850 27793 raft_consensus.cc:385] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.040664 27793 raft_consensus.cc:740] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.034605 27792 ts_tablet_manager.cc:1403] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.271s	user 0.009s	sys 0.017s
I20260709 12:19:48.044236 27792 raft_consensus.cc:359] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:48.044880 27792 raft_consensus.cc:385] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.045126 27792 raft_consensus.cc:740] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.045771 27792 consensus_queue.cc:260] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:48.046759 27793 consensus_queue.cc:260] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:48.030907 28184 raft_consensus.cc:740] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:48.045918 27803 consensus_queue.cc:1048] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:48.048825 28184 consensus_queue.cc:260] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.049995 28184 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:48.053901 27792 ts_tablet_manager.cc:1434] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:19:48.055125 27792 tablet_bootstrap.cc:492] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:48.063089 28116 consensus_queue.cc:1048] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.075306 27792 tablet_bootstrap.cc:654] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.080381 27794 tablet_bootstrap.cc:492] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:48.080852 27794 ts_tablet_manager.cc:1403] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.249s	user 0.004s	sys 0.025s
I20260709 12:19:48.083511 27794 raft_consensus.cc:359] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:48.084410 27794 raft_consensus.cc:385] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.084697 27794 raft_consensus.cc:740] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.085287 27794 consensus_queue.cc:260] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:48.089429 27794 ts_tablet_manager.cc:1434] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:19:48.090616 27794 tablet_bootstrap.cc:492] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:48.095085 27793 ts_tablet_manager.cc:1434] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 12:19:48.096221 27793 tablet_bootstrap.cc:492] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:48.098603 27792 tablet_bootstrap.cc:492] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:48.099170 27792 ts_tablet_manager.cc:1403] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.003s
I20260709 12:19:48.101881 27792 raft_consensus.cc:359] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:48.102550 27792 raft_consensus.cc:385] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.117931 28116 consensus_queue.cc:1048] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.102808 27792 raft_consensus.cc:740] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.121237 27792 consensus_queue.cc:260] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:48.124218 27794 tablet_bootstrap.cc:654] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.135216 27794 tablet_bootstrap.cc:492] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:48.135676 27794 ts_tablet_manager.cc:1403] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.004s
I20260709 12:19:48.135774 27792 ts_tablet_manager.cc:1434] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:19:48.136992 27792 tablet_bootstrap.cc:492] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96: Bootstrap starting.
I20260709 12:19:48.146087 27792 tablet_bootstrap.cc:654] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.148065 27793 tablet_bootstrap.cc:654] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.158221 27794 raft_consensus.cc:359] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.160614 27794 raft_consensus.cc:385] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.160974 27794 raft_consensus.cc:740] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.162447 27990 raft_consensus.cc:493] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.163218 27990 raft_consensus.cc:515] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:48.163401 27794 consensus_queue.cc:260] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.162717 27792 tablet_bootstrap.cc:492] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96: No bootstrap required, opened a new log
I20260709 12:19:48.164672 27792 ts_tablet_manager.cc:1403] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.009s
I20260709 12:19:48.166569 27794 ts_tablet_manager.cc:1434] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 12:19:48.167601 27794 tablet_bootstrap.cc:492] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:48.167742 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3cbf0efe649f592da4a1f3a3b331a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:48.168500 27602 raft_consensus.cc:2393] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de15618bc48545b6986320ca2292fc60 in current term 1: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:48.169263 27990 leader_election.cc:290] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:48.170063 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3cbf0efe649f592da4a1f3a3b331a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:48.171825 27491 leader_election.cc:304] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67
I20260709 12:19:48.174021 27794 tablet_bootstrap.cc:654] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.176016 28108 raft_consensus.cc:493] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.176528 28108 raft_consensus.cc:515] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.177381 27990 raft_consensus.cc:3060] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.179639 28111 raft_consensus.cc:493] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.180039 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:48.181491 27568 leader_election.cc:343] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.182250 27793 tablet_bootstrap.cc:492] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:48.182459 28108 leader_election.cc:290] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:48.182794 27793 ts_tablet_manager.cc:1403] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.000s
I20260709 12:19:48.180142 28111 raft_consensus.cc:515] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.185137 28111 leader_election.cc:290] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:48.186216 27793 raft_consensus.cc:359] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.187048 27793 raft_consensus.cc:385] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.187327 27793 raft_consensus.cc:740] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.187528 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:48.187549 27746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:48.188722 27746 raft_consensus.cc:2468] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:48.188889 27793 consensus_queue.cc:260] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.190096 27566 leader_election.cc:304] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:48.191470 28108 raft_consensus.cc:2804] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.191752 27793 ts_tablet_manager.cc:1434] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:48.191926 28108 raft_consensus.cc:493] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.191998 27526 raft_consensus.cc:2468] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:48.186450 27596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:48.193797 28108 raft_consensus.cc:3060] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.193979 27990 raft_consensus.cc:2749] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.195572 27792 raft_consensus.cc:359] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.196765 27792 raft_consensus.cc:385] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.197139 27792 raft_consensus.cc:740] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.197912 27792 consensus_queue.cc:260] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.200197 27792 ts_tablet_manager.cc:1434] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:19:48.200747 27421 catalog_manager.cc:5697] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.203027 27793 tablet_bootstrap.cc:492] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:48.197389 27422 catalog_manager.cc:5697] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.208491 27716 leader_election.cc:304] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:48.209540 28111 raft_consensus.cc:2804] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.209872 28111 raft_consensus.cc:493] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.210178 28111 raft_consensus.cc:3060] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.211531 28108 raft_consensus.cc:515] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.219239 27596 raft_consensus.cc:2393] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate aee9fc0a34154b1d81b6ad3393c17b67 in this term.
I20260709 12:19:48.219930 28111 raft_consensus.cc:515] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.224735 27793 tablet_bootstrap.cc:654] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.233753 27746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:48.233753 28108 leader_election.cc:290] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:48.244335 27746 raft_consensus.cc:2393] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aee9fc0a34154b1d81b6ad3393c17b67 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:48.262333 28111 leader_election.cc:290] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:48.263947 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:48.264475 27524 raft_consensus.cc:3060] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.264539 27596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:48.264896 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:48.265434 27596 raft_consensus.cc:2393] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate aee9fc0a34154b1d81b6ad3393c17b67 in this term.
I20260709 12:19:48.266059 27568 leader_election.cc:304] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:48.267351 27956 raft_consensus.cc:2749] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.270709 27524 raft_consensus.cc:2468] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:48.271283 27424 catalog_manager.cc:5697] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.273757 27794 tablet_bootstrap.cc:492] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:48.274237 27794 ts_tablet_manager.cc:1403] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.026s
I20260709 12:19:48.277240 27794 raft_consensus.cc:359] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.277871 27794 raft_consensus.cc:385] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.278112 27794 raft_consensus.cc:740] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.278779 27794 consensus_queue.cc:260] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.280135 27716 leader_election.cc:304] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67
I20260709 12:19:48.280875 27794 ts_tablet_manager.cc:1434] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:19:48.281641 28184 raft_consensus.cc:2804] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:48.281868 27794 tablet_bootstrap.cc:492] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c: Bootstrap starting.
I20260709 12:19:48.282191 28184 raft_consensus.cc:697] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:48.283020 28184 consensus_queue.cc:237] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.282884 27424 catalog_manager.cc:5697] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.288076 27794 tablet_bootstrap.cc:654] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.288621 27793 tablet_bootstrap.cc:492] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:48.289186 27793 ts_tablet_manager.cc:1403] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.095s	user 0.020s	sys 0.028s
I20260709 12:19:48.291929 27793 raft_consensus.cc:359] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.292691 27793 raft_consensus.cc:385] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.293011 27793 raft_consensus.cc:740] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.293856 27794 tablet_bootstrap.cc:492] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c: No bootstrap required, opened a new log
I20260709 12:19:48.294363 27794 ts_tablet_manager.cc:1403] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:19:48.293808 27793 consensus_queue.cc:260] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.296847 27794 raft_consensus.cc:359] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.297014 27793 ts_tablet_manager.cc:1434] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:48.297338 27794 raft_consensus.cc:385] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.297632 27794 raft_consensus.cc:740] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.298158 27793 tablet_bootstrap.cc:492] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:48.298221 27794 consensus_queue.cc:260] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.301290 27794 ts_tablet_manager.cc:1434] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:19:48.303342 27421 catalog_manager.cc:5697] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.304385 27990 raft_consensus.cc:493] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.304766 27793 tablet_bootstrap.cc:654] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.304980 27990 raft_consensus.cc:515] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.307090 27990 leader_election.cc:290] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:48.308583 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a5aef7a6d84eb79c2a50447c018732" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:48.309207 27672 raft_consensus.cc:2468] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:48.310652 27746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a5aef7a6d84eb79c2a50447c018732" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:48.311367 27746 raft_consensus.cc:2468] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 0.
I20260709 12:19:48.311791 27491 leader_election.cc:304] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:48.315255 27990 raft_consensus.cc:2804] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.315654 27990 raft_consensus.cc:493] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.317376 27990 raft_consensus.cc:3060] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.324007 27793 tablet_bootstrap.cc:492] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:48.324522 27793 ts_tablet_manager.cc:1403] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 12:19:48.327231 27793 raft_consensus.cc:359] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:48.327973 27793 raft_consensus.cc:385] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.328233 27793 raft_consensus.cc:740] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.328815 27793 consensus_queue.cc:260] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:48.331945 28111 raft_consensus.cc:493] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.332440 28111 raft_consensus.cc:515] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.334394 28111 leader_election.cc:290] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:48.335032 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438693ab12264201bb1a9cf7690d128a" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:48.336674 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438693ab12264201bb1a9cf7690d128a" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
W20260709 12:19:48.336262 27716 leader_election.cc:343] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.337440 27602 raft_consensus.cc:2468] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:48.338554 27715 leader_election.cc:304] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:48.336953 27793 ts_tablet_manager.cc:1434] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:19:48.339519 28111 raft_consensus.cc:2804] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.339883 28111 raft_consensus.cc:493] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.340195 28111 raft_consensus.cc:3060] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.346392 27990 raft_consensus.cc:515] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.350179 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a5aef7a6d84eb79c2a50447c018732" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:48.350378 27990 leader_election.cc:290] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:48.350747 27672 raft_consensus.cc:3060] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.352494 27793 tablet_bootstrap.cc:492] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:48.359390 28048 consensus_queue.cc:1048] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.361092 27746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a5aef7a6d84eb79c2a50447c018732" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:48.361665 27746 raft_consensus.cc:3060] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.361986 28111 raft_consensus.cc:515] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.364485 27793 tablet_bootstrap.cc:654] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.364665 28184 consensus_queue.cc:1048] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.368253 28163 consensus_queue.cc:1048] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.371299 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438693ab12264201bb1a9cf7690d128a" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:48.373906 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438693ab12264201bb1a9cf7690d128a" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
W20260709 12:19:48.373981 27716 leader_election.cc:343] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.374579 27602 raft_consensus.cc:3060] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.376689 28098 raft_consensus.cc:493] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.377122 28098 raft_consensus.cc:515] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.378671 28098 leader_election.cc:290] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:48.380252 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcf1b0ba28942d0928c3c0e5bf3c95c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
W20260709 12:19:48.382138 27642 leader_election.cc:343] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.383417 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcf1b0ba28942d0928c3c0e5bf3c95c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:48.384101 27748 raft_consensus.cc:2468] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:48.385424 27640 leader_election.cc:304] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:48.386726 28163 raft_consensus.cc:2804] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.387179 28163 raft_consensus.cc:493] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.387581 28163 raft_consensus.cc:3060] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.398216 28163 raft_consensus.cc:515] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.398751 27596 raft_consensus.cc:1275] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:48.411623 27746 raft_consensus.cc:2468] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:48.400733 27602 raft_consensus.cc:2468] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:48.412562 27990 consensus_queue.cc:1048] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.414335 28163 leader_election.cc:290] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:48.415555 27715 leader_election.cc:304] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:48.416455 28184 raft_consensus.cc:2804] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:48.416910 28184 raft_consensus.cc:697] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:48.417246 27793 tablet_bootstrap.cc:492] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:48.417742 27793 ts_tablet_manager.cc:1403] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.078s	user 0.030s	sys 0.027s
I20260709 12:19:48.421222 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcf1b0ba28942d0928c3c0e5bf3c95c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:48.421901 27748 raft_consensus.cc:3060] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.417654 28184 consensus_queue.cc:237] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.426477 28188 consensus_queue.cc:1048] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.429752 27793 raft_consensus.cc:359] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.430439 27793 raft_consensus.cc:385] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.430701 27793 raft_consensus.cc:740] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.406239 27672 raft_consensus.cc:2468] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 1.
I20260709 12:19:48.432598 27750 raft_consensus.cc:1275] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:19:48.432963 27750 pending_rounds.cc:85] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: Aborting all ops after (but not including) 0
I20260709 12:19:48.433182 27750 pending_rounds.cc:107] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:19:48.433441 27491 leader_election.cc:304] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:48.434764 28175 raft_consensus.cc:2804] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:48.435258 28175 raft_consensus.cc:697] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:19:48.436100 28175 consensus_queue.cc:237] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.437083 27793 consensus_queue.cc:260] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.437623 27526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcf1b0ba28942d0928c3c0e5bf3c95c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:48.438678 27526 raft_consensus.cc:3060] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.433460 27750 raft_consensus.cc:2889] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:48.342264 27422 catalog_manager.cc:5697] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.399935 28098 consensus_queue.cc:1048] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.440006 27793 ts_tablet_manager.cc:1434] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:19:48.401280 28111 leader_election.cc:290] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:48.442580 27793 tablet_bootstrap.cc:492] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:48.432184 28188 raft_consensus.cc:493] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.442693 27894 consensus_queue.cc:1048] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.443315 28188 raft_consensus.cc:515] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:48.445258 27956 raft_consensus.cc:493] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.445734 27956 raft_consensus.cc:515] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:48.446130 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:48.446735 27598 raft_consensus.cc:2468] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:48.448725 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:48.449327 27673 raft_consensus.cc:2468] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 0.
I20260709 12:19:48.431895 27748 raft_consensus.cc:2468] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:48.448252 27715 leader_election.cc:304] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:48.468611 27793 tablet_bootstrap.cc:654] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.447737 27956 leader_election.cc:290] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:48.483399 27640 leader_election.cc:304] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:48.446787 28188 leader_election.cc:290] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:48.469274 28048 raft_consensus.cc:2804] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.487274 28098 raft_consensus.cc:2804] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:48.484603 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:48.487597 28048 raft_consensus.cc:493] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.499498 28048 raft_consensus.cc:3060] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.502940 27672 raft_consensus.cc:2468] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 0.
I20260709 12:19:48.503497 27526 raft_consensus.cc:2468] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:48.504354 27566 leader_election.cc:304] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:48.505142 27956 raft_consensus.cc:2804] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.505514 27956 raft_consensus.cc:493] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.505821 27956 raft_consensus.cc:3060] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.495739 28098 raft_consensus.cc:697] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:48.508267 28098 consensus_queue.cc:237] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:48.518860 28048 raft_consensus.cc:515] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:48.524606 28163 consensus_queue.cc:1048] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.536232 28181 raft_consensus.cc:493] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.536736 28181 raft_consensus.cc:515] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
W20260709 12:19:48.541047 27714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.3:45493, user_credentials={real_user=slave}} blocked reactor thread for 90753.8us
I20260709 12:19:48.541695 28111 consensus_queue.cc:1048] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.542891 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf3cff3a1874453ab1973cc35091fa0" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:48.544147 27956 raft_consensus.cc:515] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:48.547895 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:48.548661 27956 leader_election.cc:290] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:48.548770 27748 raft_consensus.cc:2393] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aee9fc0a34154b1d81b6ad3393c17b67 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:48.538786 28181 leader_election.cc:290] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:48.550741 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:48.554698 27672 raft_consensus.cc:3060] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.558439 27793 tablet_bootstrap.cc:492] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: No bootstrap required, opened a new log
I20260709 12:19:48.552524 27421 catalog_manager.cc:5697] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 0 to 1, leader changed from <none> to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 1 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.558944 27793 ts_tablet_manager.cc:1403] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.000s
I20260709 12:19:48.544102 27598 raft_consensus.cc:2468] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:48.562933 27641 leader_election.cc:304] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:48.563745 28181 raft_consensus.cc:2804] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.564116 28181 raft_consensus.cc:493] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.564529 28181 raft_consensus.cc:3060] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.564008 27672 raft_consensus.cc:2468] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:48.567420 27566 leader_election.cc:304] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:48.568277 27956 raft_consensus.cc:2804] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:48.568773 27956 raft_consensus.cc:697] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:48.569590 27956 consensus_queue.cc:237] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:48.571607 28048 leader_election.cc:290] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:48.563490 27793 raft_consensus.cc:359] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.577198 27793 raft_consensus.cc:385] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.577498 27793 raft_consensus.cc:740] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.578104 27793 consensus_queue.cc:260] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.580240 27793 ts_tablet_manager.cc:1434] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:19:48.580535 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:48.581387 27750 raft_consensus.cc:2393] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aee9fc0a34154b1d81b6ad3393c17b67 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:48.585413 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:48.586200 27672 raft_consensus.cc:2393] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 1: Already voted for candidate aee9fc0a34154b1d81b6ad3393c17b67 in this term.
I20260709 12:19:48.597404 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e24b3506bb747b18e327830848ab3fc" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:48.598101 27422 catalog_manager.cc:5697] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.620973 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf3cff3a1874453ab1973cc35091fa0" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:48.626371 27524 raft_consensus.cc:2468] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 0.
I20260709 12:19:48.632169 28172 consensus_queue.cc:1048] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.636952 27424 catalog_manager.cc:5697] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.643867 28181 raft_consensus.cc:515] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:48.647507 27596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf3cff3a1874453ab1973cc35091fa0" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:48.649780 28181 leader_election.cc:290] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:48.648079 27596 raft_consensus.cc:3060] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.654534 27524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf3cff3a1874453ab1973cc35091fa0" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:48.655109 27524 raft_consensus.cc:3060] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.661790 27524 raft_consensus.cc:2468] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:48.663139 27642 leader_election.cc:304] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:19:48.663962 28249 raft_consensus.cc:2804] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:48.664471 28249 raft_consensus.cc:697] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:48.666389 27714 leader_election.cc:304] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67
I20260709 12:19:48.667505 28191 raft_consensus.cc:2749] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.665283 28249 consensus_queue.cc:237] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:48.681954 27596 raft_consensus.cc:2468] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:48.684957 27422 catalog_manager.cc:5697] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.688658 27424 catalog_manager.cc:5697] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.743435 28241 raft_consensus.cc:493] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.743820 28241 raft_consensus.cc:515] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:48.745702 28241 leader_election.cc:290] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:48.746091 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438693ab12264201bb1a9cf7690d128a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:48.746557 28048 consensus_queue.cc:1048] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.746686 27602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438693ab12264201bb1a9cf7690d128a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:48.747449 27602 raft_consensus.cc:2393] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de15618bc48545b6986320ca2292fc60 in current term 1: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:48.748288 27492 leader_election.cc:304] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:48.749208 28241 raft_consensus.cc:3060] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.761881 28111 consensus_queue.cc:1048] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.765911 28241 raft_consensus.cc:2749] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.814941 28116 consensus_queue.cc:1048] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.827739 28048 consensus_queue.cc:1048] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.894371 28241 consensus_queue.cc:1048] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.896158 28249 consensus_queue.cc:1048] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.914198 28181 consensus_queue.cc:1048] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.918081 28242 consensus_queue.cc:1048] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.302922 28249 consensus_queue.cc:1048] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.307883 27956 consensus_queue.cc:1048] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.308981 28098 consensus_queue.cc:1048] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.355988 28262 consensus_queue.cc:1048] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:50.666877 27623 debug-util.cc:398] Leaking SignalData structure 0x7b080027ce80 after lost signal to thread 19891
W20260709 12:19:50.667834 27623 debug-util.cc:398] Leaking SignalData structure 0x7b08001c28e0 after lost signal to thread 27459
W20260709 12:19:50.668818 27623 debug-util.cc:398] Leaking SignalData structure 0x7b08000583a0 after lost signal to thread 27551
W20260709 12:19:50.669667 27623 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7da0 after lost signal to thread 27626
W20260709 12:19:50.670490 27623 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba100 after lost signal to thread 27700
W20260709 12:19:50.671377 27623 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcc40 after lost signal to thread 27774
I20260709 12:19:50.970353 19888 tablet_server.cc:179] TabletServer@127.19.108.1:0 shutting down...
W20260709 12:19:50.975795 27716 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:19:50.981232 27716 consensus_peers.cc:597] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:50.999221 27716 consensus_peers.cc:597] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.016578 27642 consensus_peers.cc:597] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.020608 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:51.021615 19888 tablet_replica.cc:333] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.022460 19888 raft_consensus.cc:2243] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.023046 19888 raft_consensus.cc:2272] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:51.024544 27716 consensus_peers.cc:597] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.025583 19888 tablet_replica.cc:333] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.026477 19888 raft_consensus.cc:2243] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.027060 19888 raft_consensus.cc:2272] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.029212 19888 tablet_replica.cc:333] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.029907 19888 raft_consensus.cc:2243] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.030284 19888 raft_consensus.cc:2272] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.032279 19888 tablet_replica.cc:333] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.032838 19888 raft_consensus.cc:2243] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.033226 19888 raft_consensus.cc:2272] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.035215 19888 tablet_replica.cc:333] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.035985 19888 raft_consensus.cc:2243] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.036438 19888 raft_consensus.cc:2272] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.038653 19888 tablet_replica.cc:333] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.039371 19888 raft_consensus.cc:2243] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.040551 19888 raft_consensus.cc:2272] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.042663 19888 tablet_replica.cc:333] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.043365 19888 raft_consensus.cc:2243] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.044144 19888 raft_consensus.cc:2272] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.046105 19888 tablet_replica.cc:333] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.046715 19888 raft_consensus.cc:2243] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.047173 19888 raft_consensus.cc:2272] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.048926 19888 tablet_replica.cc:333] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.049484 19888 raft_consensus.cc:2243] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.049842 19888 raft_consensus.cc:2272] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.051824 19888 tablet_replica.cc:333] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.052407 19888 raft_consensus.cc:2243] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.053216 19888 raft_consensus.cc:2272] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.055424 19888 tablet_replica.cc:333] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.056123 19888 raft_consensus.cc:2243] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.056617 19888 raft_consensus.cc:2272] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.059257 19888 tablet_replica.cc:333] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.059918 19888 raft_consensus.cc:2243] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.060381 19888 raft_consensus.cc:2272] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.062394 19888 tablet_replica.cc:333] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.063238 19888 raft_consensus.cc:2243] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.064082 19888 raft_consensus.cc:2272] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.067063 19888 tablet_replica.cc:333] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.067802 19888 raft_consensus.cc:2243] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:19:51.068385 27716 consensus_peers.cc:597] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.068825 19888 raft_consensus.cc:2272] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.071074 19888 tablet_replica.cc:333] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.071640 19888 raft_consensus.cc:2243] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.072057 19888 raft_consensus.cc:2272] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.074239 19888 tablet_replica.cc:333] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.074829 19888 raft_consensus.cc:2243] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.075810 19888 raft_consensus.cc:2272] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.078224 19888 tablet_replica.cc:333] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.079110 19888 raft_consensus.cc:2243] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.079629 19888 raft_consensus.cc:2272] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:51.081089 27568 consensus_peers.cc:597] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.082360 19888 tablet_replica.cc:333] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.082998 19888 raft_consensus.cc:2243] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.083396 19888 raft_consensus.cc:2272] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.085446 19888 tablet_replica.cc:333] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.085968 19888 raft_consensus.cc:2243] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.086346 19888 raft_consensus.cc:2272] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.088238 19888 tablet_replica.cc:333] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.088765 19888 raft_consensus.cc:2243] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.089496 19888 raft_consensus.cc:2272] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.091296 19888 tablet_replica.cc:333] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.092058 19888 raft_consensus.cc:2243] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.092540 19888 raft_consensus.cc:2272] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.095127 19888 tablet_replica.cc:333] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.095844 19888 raft_consensus.cc:2243] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.096830 19888 raft_consensus.cc:2272] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.099524 19888 tablet_replica.cc:333] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.100315 19888 raft_consensus.cc:2243] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:51.100652 27716 consensus_peers.cc:597] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.100790 19888 raft_consensus.cc:2272] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:51.101320 27716 consensus_peers.cc:597] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.103510 19888 tablet_replica.cc:333] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.104178 19888 raft_consensus.cc:2243] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.104653 19888 raft_consensus.cc:2272] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:51.104700 27642 consensus_peers.cc:597] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.107049 19888 tablet_replica.cc:333] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.107770 19888 raft_consensus.cc:2243] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.108287 19888 raft_consensus.cc:2272] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.110867 19888 tablet_replica.cc:333] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.111640 19888 raft_consensus.cc:2243] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.112524 19888 raft_consensus.cc:2272] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.114530 19888 tablet_replica.cc:333] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.115098 19888 raft_consensus.cc:2243] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.115477 19888 raft_consensus.cc:2272] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.117421 19888 tablet_replica.cc:333] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.117975 19888 raft_consensus.cc:2243] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.118376 19888 raft_consensus.cc:2272] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.120303 19888 tablet_replica.cc:333] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.120863 19888 raft_consensus.cc:2243] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.121336 19888 raft_consensus.cc:2272] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.123484 19888 tablet_replica.cc:333] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.123984 19888 raft_consensus.cc:2243] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.124840 19888 raft_consensus.cc:2272] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.126628 19888 tablet_replica.cc:333] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.127197 19888 raft_consensus.cc:2243] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.127643 19888 raft_consensus.cc:2272] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.129923 19888 tablet_replica.cc:333] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.130708 19888 raft_consensus.cc:2243] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.131186 19888 raft_consensus.cc:2272] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.133535 19888 tablet_replica.cc:333] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.134243 19888 raft_consensus.cc:2243] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.134693 19888 raft_consensus.cc:2272] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.136374 19888 tablet_replica.cc:333] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.136857 19888 raft_consensus.cc:2243] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.137262 19888 raft_consensus.cc:2272] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.139093 19888 tablet_replica.cc:333] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.139565 19888 raft_consensus.cc:2243] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.139938 19888 raft_consensus.cc:2272] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.141857 19888 tablet_replica.cc:333] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.142433 19888 raft_consensus.cc:2243] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.143379 19888 raft_consensus.cc:2272] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.145965 19888 tablet_replica.cc:333] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.146658 19888 raft_consensus.cc:2243] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.147177 19888 raft_consensus.cc:2272] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:51.149305 27642 consensus_peers.cc:597] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.149663 19888 tablet_replica.cc:333] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.150259 19888 raft_consensus.cc:2243] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.150626 19888 raft_consensus.cc:2272] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.152612 19888 tablet_replica.cc:333] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.153264 19888 raft_consensus.cc:2243] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.153697 19888 raft_consensus.cc:2272] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.156060 19888 tablet_replica.cc:333] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.156579 19888 raft_consensus.cc:2243] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.157025 19888 raft_consensus.cc:2272] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.159559 19888 tablet_replica.cc:333] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.160269 19888 raft_consensus.cc:2243] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.160755 19888 raft_consensus.cc:2272] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.162635 19888 tablet_replica.cc:333] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.163290 19888 raft_consensus.cc:2243] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.163761 19888 raft_consensus.cc:2272] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.165855 19888 tablet_replica.cc:333] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.166342 19888 raft_consensus.cc:2243] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.166706 19888 raft_consensus.cc:2272] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.168298 19888 tablet_replica.cc:333] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.168812 19888 raft_consensus.cc:2243] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:51.169481 19888 raft_consensus.cc:2272] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:51.171303 19888 tablet_replica.cc:333] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: stopping tablet replica
I20260709 12:19:51.171730 19888 raft_consensus.cc:2243] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:51.172127 19888 raft_consensus.cc:2272] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:51.212205 27716 consensus_peers.cc:597] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.223039 27568 consensus_peers.cc:597] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.252059 27716 consensus_peers.cc:597] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.260267 19888 tablet_server.cc:196] TabletServer@127.19.108.1:0 shutdown complete.
W20260709 12:19:51.267338 27716 consensus_peers.cc:597] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.268652 27642 consensus_peers.cc:597] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.284662 27642 consensus_peers.cc:597] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.301232 27716 consensus_peers.cc:597] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.316771 27642 consensus_peers.cc:597] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.332162 27568 consensus_peers.cc:597] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.347957 27642 consensus_peers.cc:597] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.354261 27716 consensus_peers.cc:597] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.351643 27642 consensus_peers.cc:597] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.355242 27568 consensus_peers.cc:597] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.355403 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:51.355238 27642 consensus_peers.cc:597] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.360391 27642 consensus_peers.cc:597] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.363729 28287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:51.365202 28288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:51.369612 27642 consensus_peers.cc:597] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.369656 28290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:51.377454 27642 consensus_peers.cc:597] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.379765 27642 consensus_peers.cc:597] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.380149 19888 server_base.cc:1061] running on GCE node
I20260709 12:19:51.382782 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:51.383039 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:51.383219 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599591383199 us; error 0 us; skew 500 ppm
I20260709 12:19:51.383877 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:51.393862 19888 webserver.cc:533] Webserver started at http://127.19.108.1:40227/ using document root <none> and password file <none>
I20260709 12:19:51.394578 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:51.395185 19888 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:19:51.397750 27568 consensus_peers.cc:597] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.400323 19888 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:51.418588 28296 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:51.419565 19888 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.006s	sys 0.004s
I20260709 12:19:51.420001 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "de15618bc48545b6986320ca2292fc60"
format_stamp: "Formatted at 2026-07-09 12:19:39 on dist-test-slave-0g1j"
I20260709 12:19:51.420570 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:19:51.426679 27642 consensus_peers.cc:597] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.439424 27716 consensus_peers.cc:597] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.440021 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:51.441642 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:51.443591 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:51.450367 28303 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:19:51.502461 27642 consensus_peers.cc:597] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.526927 27568 consensus_peers.cc:597] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.544520 27716 consensus_peers.cc:597] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.717378 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:19:51.718004 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.269s	user 0.009s	sys 0.001s
I20260709 12:19:51.718353 19888 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:19:51.728144 28303 tablet_bootstrap.cc:492] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:52.050302 28303 tablet_bootstrap.cc:492] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:52.053279 28303 tablet_bootstrap.cc:492] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:52.054062 28303 ts_tablet_manager.cc:1403] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.326s	user 0.107s	sys 0.156s
I20260709 12:19:52.056643 28303 raft_consensus.cc:359] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.057371 28303 raft_consensus.cc:740] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.058239 28303 consensus_queue.cc:260] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.064311 28303 ts_tablet_manager.cc:1434] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:52.065019 28303 tablet_bootstrap.cc:492] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:52.086122 28303 tablet_bootstrap.cc:492] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:52.087050 28303 tablet_bootstrap.cc:492] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:52.087661 28303 ts_tablet_manager.cc:1403] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 12:19:52.090174 28303 raft_consensus.cc:359] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.090940 28303 raft_consensus.cc:740] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.091693 28303 consensus_queue.cc:260] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.093359 28303 ts_tablet_manager.cc:1434] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:19:52.094086 28303 tablet_bootstrap.cc:492] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:52.096782 28279 raft_consensus.cc:493] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.097357 28279 raft_consensus.cc:515] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.099421 28279 leader_election.cc:290] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
W20260709 12:19:52.104847 27568 leader_election.cc:336] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.109447 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:52.119148 28303 tablet_bootstrap.cc:492] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:52.119758 27566 leader_election.cc:304] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.120128 28303 tablet_bootstrap.cc:492] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:52.120800 28303 ts_tablet_manager.cc:1403] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.001s
I20260709 12:19:52.123656 28303 raft_consensus.cc:359] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.124295 28303 raft_consensus.cc:740] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.125053 28303 consensus_queue.cc:260] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.125643 27956 raft_consensus.cc:2749] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.127054 28303 ts_tablet_manager.cc:1434] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:19:52.127923 28303 tablet_bootstrap.cc:492] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:52.153882 28279 raft_consensus.cc:493] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.154664 28279 raft_consensus.cc:515] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.157925 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53924e99bd64e01be6cf5fbd86a0abc" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:52.160727 19888 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:19:52.161105 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.443s	user 0.255s	sys 0.000s
I20260709 12:19:52.166996 28310 raft_consensus.cc:493] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.167598 28310 raft_consensus.cc:515] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.173707 28310 leader_election.cc:290] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
W20260709 12:19:52.176430 27642 leader_election.cc:336] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.180325 27600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:52.183799 27641 leader_election.cc:304] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.185137 28292 raft_consensus.cc:2749] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.186473 28292 raft_consensus.cc:493] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.187003 28292 raft_consensus.cc:515] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.189250 28292 leader_election.cc:290] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
W20260709 12:19:52.201344 27642 leader_election.cc:336] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
W20260709 12:19:52.220733 27568 leader_election.cc:336] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.385998 27568 leader_election.cc:304] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.224439 28116 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.387122 28116 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.226963 28279 leader_election.cc:290] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:52.233110 27594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61af26ee6a29463f8084851d49c5597c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:52.341109 28304 raft_consensus.cc:493] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.344635 28111 raft_consensus.cc:493] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.365891 27956 raft_consensus.cc:493] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.390558 28111 raft_consensus.cc:515] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.390671 27956 raft_consensus.cc:515] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.372155 28098 raft_consensus.cc:493] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.376592 28303 tablet_bootstrap.cc:492] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:52.391816 28098 raft_consensus.cc:515] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.394714 28111 leader_election.cc:290] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.379230 28309 raft_consensus.cc:493] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.397341 28111 raft_consensus.cc:493] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.397831 28111 raft_consensus.cc:515] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.395393 28304 raft_consensus.cc:515] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.399570 28111 leader_election.cc:290] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.395502 27594 raft_consensus.cc:2468] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:52.400571 28304 leader_election.cc:290] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.395663 28292 raft_consensus.cc:493] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.401392 28292 raft_consensus.cc:515] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.402086 28309 raft_consensus.cc:515] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.402889 27956 leader_election.cc:290] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.400077 28306 raft_consensus.cc:493] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.403324 28292 leader_election.cc:290] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.403669 28306 raft_consensus.cc:515] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.404095 28116 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.405584 28306 leader_election.cc:290] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:52.406718 28303 tablet_bootstrap.cc:492] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:52.407429 28303 ts_tablet_manager.cc:1403] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.280s	user 0.080s	sys 0.083s
I20260709 12:19:52.408694 28111 raft_consensus.cc:493] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.409201 28111 raft_consensus.cc:515] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.409989 28303 raft_consensus.cc:359] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.410646 28303 raft_consensus.cc:740] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.412072 28098 leader_election.cc:290] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.412485 28303 consensus_queue.cc:260] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.413280 28111 leader_election.cc:290] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.414623 28303 ts_tablet_manager.cc:1434] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:19:52.418260 27568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:34993, user_credentials={real_user=slave}} blocked reactor thread for 197554us
I20260709 12:19:52.423408 27956 raft_consensus.cc:2749] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.423834 28303 tablet_bootstrap.cc:492] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:52.426360 28309 leader_election.cc:290] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.430640 28325 raft_consensus.cc:493] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.431180 28325 raft_consensus.cc:515] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.423272 28279 raft_consensus.cc:493] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.433183 28325 leader_election.cc:290] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.433736 28325 raft_consensus.cc:493] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.434422 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53924e99bd64e01be6cf5fbd86a0abc" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:52.433234 28279 raft_consensus.cc:515] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.440004 27599 raft_consensus.cc:2468] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:52.436475 27641 leader_election.cc:304] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.441435 28279 leader_election.cc:290] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:52.441797 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:52.442162 28292 raft_consensus.cc:2804] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.442548 28292 raft_consensus.cc:493] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.442904 28292 raft_consensus.cc:3060] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.437929 27596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2259e0eb900541c7b9d47a4406bce163" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:52.445338 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61af26ee6a29463f8084851d49c5597c" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:52.445828 27641 leader_election.cc:304] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
W20260709 12:19:52.446782 27568 leader_election.cc:336] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.447060 28098 raft_consensus.cc:2804] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.447413 28098 raft_consensus.cc:493] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.447713 28098 raft_consensus.cc:3060] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:52.448019 27568 leader_election.cc:336] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.450791 28325 raft_consensus.cc:515] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.453107 28325 leader_election.cc:290] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:52.455453 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:52.456123 27599 raft_consensus.cc:2468] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
I20260709 12:19:52.456794 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a5aef7a6d84eb79c2a50447c018732" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:52.457409 27750 raft_consensus.cc:2468] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:52.457489 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:52.458235 27599 raft_consensus.cc:2468] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
W20260709 12:19:52.448678 27642 leader_election.cc:336] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.460135 28292 raft_consensus.cc:515] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.461268 27673 raft_consensus.cc:2393] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aee9fc0a34154b1d81b6ad3393c17b67 in current term 2: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:52.462914 27595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:52.467418 27642 leader_election.cc:304] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
W20260709 12:19:52.469272 27642 leader_election.cc:336] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.474340 27566 leader_election.cc:304] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.473510 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:52.475726 27673 raft_consensus.cc:2468] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:52.476079 28098 raft_consensus.cc:515] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.463569 27595 raft_consensus.cc:2468] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 2.
I20260709 12:19:52.479763 28325 raft_consensus.cc:2749] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.476572 28309 raft_consensus.cc:2804] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.479936 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61af26ee6a29463f8084851d49c5597c" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:52.467756 28292 leader_election.cc:290] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.483733 27599 raft_consensus.cc:3060] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.483299 28309 raft_consensus.cc:493] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.484287 28309 raft_consensus.cc:3060] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.487455 27566 leader_election.cc:304] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:52.489923 28098 leader_election.cc:290] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.493604 28309 raft_consensus.cc:515] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.495102 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53924e99bd64e01be6cf5fbd86a0abc" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:52.496202 27715 leader_election.cc:304] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: 
W20260709 12:19:52.496479 27568 leader_election.cc:336] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.496872 27568 leader_election.cc:304] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
W20260709 12:19:52.497485 27568 leader_election.cc:336] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.495745 27598 raft_consensus.cc:3060] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:52.498594 27716 leader_election.cc:336] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
W20260709 12:19:52.499162 27716 leader_election.cc:336] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
W20260709 12:19:52.499995 27642 leader_election.cc:336] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.500839 28111 raft_consensus.cc:2804] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.500867 27715 leader_election.cc:304] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
W20260709 12:19:52.500428 27716 leader_election.cc:336] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.501549 28111 raft_consensus.cc:493] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.502045 28111 raft_consensus.cc:3060] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:52.500869 27642 leader_election.cc:336] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.502629 27642 leader_election.cc:304] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
W20260709 12:19:52.502226 27716 leader_election.cc:336] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.503320 28116 raft_consensus.cc:2804] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.504087 28292 raft_consensus.cc:2749] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.503713 28116 raft_consensus.cc:493] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.505095 28116 raft_consensus.cc:3060] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:52.503799 27716 leader_election.cc:336] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
W20260709 12:19:52.507179 27642 leader_election.cc:336] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
W20260709 12:19:52.506821 27568 leader_election.cc:336] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.509094 28098 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.509547 28098 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.500033 28335 raft_consensus.cc:2804] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.511240 28335 raft_consensus.cc:493] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.511610 28335 raft_consensus.cc:3060] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.511499 28098 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.512319 27599 raft_consensus.cc:2468] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 2.
I20260709 12:19:52.513352 27641 leader_election.cc:304] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.514634 28098 raft_consensus.cc:2804] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.515395 28098 raft_consensus.cc:697] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:52.516069 28309 leader_election.cc:290] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.516281 28098 consensus_queue.cc:237] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.514902 27598 raft_consensus.cc:2468] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 2.
I20260709 12:19:52.518513 27641 leader_election.cc:304] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.519290 28309 raft_consensus.cc:2804] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.519801 28309 raft_consensus.cc:697] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:52.520941 28111 raft_consensus.cc:515] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.519824 28116 raft_consensus.cc:515] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.513288 28331 raft_consensus.cc:2749] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.524042 28116 leader_election.cc:290] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.520809 28309 consensus_queue.cc:237] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.525182 27715 leader_election.cc:304] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.527500 28327 raft_consensus.cc:2804] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:52.527871 28327 raft_consensus.cc:493] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.528199 28327 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.531644 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
W20260709 12:19:52.532459 27716 leader_election.cc:336] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.532934 28111 leader_election.cc:290] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.532253 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:52.533732 27599 raft_consensus.cc:3060] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.535218 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:52.532296 27748 raft_consensus.cc:2468] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:52.535790 27673 raft_consensus.cc:2468] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 1.
W20260709 12:19:52.538034 27642 leader_election.cc:336] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.537988 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a5aef7a6d84eb79c2a50447c018732" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:52.538712 27749 raft_consensus.cc:3060] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.539021 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a5aef7a6d84eb79c2a50447c018732" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:52.539922 27673 raft_consensus.cc:2393] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 2: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:52.542317 27594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:52.542936 27594 raft_consensus.cc:3060] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.552668 27749 raft_consensus.cc:2468] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 2.
I20260709 12:19:52.552824 27599 raft_consensus.cc:2468] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 2.
W20260709 12:19:52.553696 27716 leader_election.cc:336] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.557749 27640 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.558495 28292 raft_consensus.cc:2804] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.558868 28292 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.559271 27715 leader_election.cc:304] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.559563 27640 leader_election.cc:304] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:52.560317 28311 raft_consensus.cc:2804] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.560743 28311 raft_consensus.cc:697] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:52.556478 28335 raft_consensus.cc:515] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.561530 28311 consensus_queue.cc:237] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.563170 28249 raft_consensus.cc:493] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.563735 28249 raft_consensus.cc:515] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.565809 28249 leader_election.cc:290] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.559213 28292 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:52.568090 27642 leader_election.cc:336] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.567438 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:52.568796 27594 raft_consensus.cc:2468] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 2.
W20260709 12:19:52.577129 27568 leader_election.cc:336] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.577471 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:52.579162 27747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:52.567114 28327 raft_consensus.cc:515] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.573727 28111 raft_consensus.cc:2804] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.581233 28111 raft_consensus.cc:697] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:52.581959 28111 consensus_queue.cc:237] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.583249 28331 raft_consensus.cc:493] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.575906 27599 raft_consensus.cc:2468] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:52.585350 27641 leader_election.cc:304] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:19:52.588066 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b167e6443cee4e879c2294bb44197833" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:52.588937 27672 raft_consensus.cc:3060] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.589854 28327 leader_election.cc:290] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.583755 28331 raft_consensus.cc:515] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.588843 27747 raft_consensus.cc:2393] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aee9fc0a34154b1d81b6ad3393c17b67 in current term 3: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:52.597450 27672 raft_consensus.cc:2468] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 2.
I20260709 12:19:52.597884 28331 leader_election.cc:290] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
W20260709 12:19:52.598157 27716 leader_election.cc:336] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
W20260709 12:19:52.598505 27568 leader_election.cc:336] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.587486 28335 leader_election.cc:290] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:52.605912 27715 leader_election.cc:304] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.610589 27566 leader_election.cc:304] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.611573 27714 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.612323 28116 raft_consensus.cc:2804] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.612651 28116 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.612957 28116 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.587984 28309 raft_consensus.cc:2804] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.613950 28306 raft_consensus.cc:2804] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.615883 28336 raft_consensus.cc:2804] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.618301 27672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2259e0eb900541c7b9d47a4406bce163" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:52.621667 27714 leader_election.cc:304] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.622392 27599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:52.622764 28310 raft_consensus.cc:493] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.629722 28310 raft_consensus.cc:515] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.631721 28329 raft_consensus.cc:493] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.632057 28310 leader_election.cc:290] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.632227 28329 raft_consensus.cc:515] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.633787 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0103e954b4ec472a9b561d0a4a1cbb10" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:52.634492 27749 raft_consensus.cc:2468] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 1.
I20260709 12:19:52.635437 27640 leader_election.cc:304] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:52.636188 28310 raft_consensus.cc:2804] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.636603 28310 raft_consensus.cc:493] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.629665 27599 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.637372 28310 raft_consensus.cc:3060] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.625798 28306 raft_consensus.cc:697] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:52.644503 28306 consensus_queue.cc:237] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.620962 28309 raft_consensus.cc:493] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.647028 28309 raft_consensus.cc:3060] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.634181 28329 leader_election.cc:290] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
W20260709 12:19:52.653935 27716 leader_election.cc:336] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
W20260709 12:19:52.640194 27642 leader_election.cc:336] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.628839 28336 raft_consensus.cc:697] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:52.657490 28116 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.625793 27672 raft_consensus.cc:2468] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 1.
I20260709 12:19:52.663375 28303 tablet_bootstrap.cc:492] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:52.654856 28309 raft_consensus.cc:515] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.677487 28116 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.674299 27566 leader_election.cc:304] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.679318 27566 leader_election.cc:304] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.684084 28303 tablet_bootstrap.cc:492] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:52.684880 28303 ts_tablet_manager.cc:1403] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.261s	user 0.017s	sys 0.000s
I20260709 12:19:52.690176 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0103e954b4ec472a9b561d0a4a1cbb10" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:52.691169 28334 raft_consensus.cc:2804] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:52.691591 28334 raft_consensus.cc:493] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting leader election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:19:52.691934 28334 raft_consensus.cc:3060] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.692677 28292 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.688673 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "be117ea016214236abda478b04f7f70c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:52.691075 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:19:52.691864 28336 consensus_queue.cc:237] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.688539 28330 raft_consensus.cc:2749] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:52.694319 27716 leader_election.cc:336] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.687502 28309 leader_election.cc:290] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:52.695108 27598 raft_consensus.cc:3060] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.698805 27422 catalog_manager.cc:5697] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 1 to 2, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:52.699836 27642 leader_election.cc:336] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.706100 27599 raft_consensus.cc:2468] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be117ea016214236abda478b04f7f70c in term 3.
I20260709 12:19:52.709122 27715 leader_election.cc:304] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.709950 28330 raft_consensus.cc:2804] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:52.710400 28330 raft_consensus.cc:697] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 3 LEADER]: Becoming Leader. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:19:52.711206 28330 consensus_queue.cc:237] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.712080 28303 raft_consensus.cc:359] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.694720 27676 raft_consensus.cc:2393] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 2: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:52.709036 28339 raft_consensus.cc:2749] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:52.719623 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:52.720398 27748 raft_consensus.cc:2393] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in current term 2: Already voted for candidate be117ea016214236abda478b04f7f70c in this term.
I20260709 12:19:52.713785 27424 catalog_manager.cc:5697] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 1 to 2, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 2 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.718727 28303 raft_consensus.cc:740] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.725908 28303 consensus_queue.cc:260] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.723805 27421 catalog_manager.cc:5697] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 1 to 2, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:52.732812 27642 leader_election.cc:336] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.739632 27598 raft_consensus.cc:2468] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 2.
W20260709 12:19:52.749492 27714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:45493, user_credentials={real_user=slave}} blocked reactor thread for 73908.4us
I20260709 12:19:52.750991 27566 leader_election.cc:304] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.752080 28339 raft_consensus.cc:2749] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.754179 27714 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.755086 28280 raft_consensus.cc:2749] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.748457 28310 raft_consensus.cc:515] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.757838 27670 raft_consensus.cc:2393] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be117ea016214236abda478b04f7f70c in current term 2: Already voted for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in this term.
I20260709 12:19:52.760476 28303 ts_tablet_manager.cc:1434] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
I20260709 12:19:52.761186 28303 tablet_bootstrap.cc:492] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:52.761734 27641 leader_election.cc:304] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.759104 28292 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:52.760622 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0103e954b4ec472a9b561d0a4a1cbb10" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:52.762591 28309 raft_consensus.cc:2804] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.765743 28309 raft_consensus.cc:697] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:52.763011 27748 raft_consensus.cc:3060] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.766731 27714 leader_election.cc:304] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.766582 28309 consensus_queue.cc:237] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.762441 28334 raft_consensus.cc:515] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.763370 28310 leader_election.cc:290] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
W20260709 12:19:52.779422 27568 leader_election.cc:336] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
W20260709 12:19:52.782917 27642 leader_election.cc:336] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.783541 27642 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96; no voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.788213 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2259e0eb900541c7b9d47a4406bce163" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:19:52.788884 27670 raft_consensus.cc:3060] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.786180 28249 raft_consensus.cc:2749] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:19:52.790123 27642 leader_election.cc:336] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:19:52.793051 27748 raft_consensus.cc:2468] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 2.
I20260709 12:19:52.780140 28334 leader_election.cc:290] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: Requested vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:19:52.797315 28330 raft_consensus.cc:2749] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:52.800390 27670 raft_consensus.cc:2468] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 2.
I20260709 12:19:52.802582 27640 leader_election.cc:304] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.803287 27566 leader_election.cc:304] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:52.804059 28292 raft_consensus.cc:2804] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.804355 28339 raft_consensus.cc:2804] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.804884 28292 raft_consensus.cc:697] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:52.804836 28339 raft_consensus.cc:697] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:19:52.805779 28292 consensus_queue.cc:237] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:52.806475 28339 consensus_queue.cc:237] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:52.849514 28303 tablet_bootstrap.cc:492] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:52.850638 28303 tablet_bootstrap.cc:492] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:52.851318 28303 ts_tablet_manager.cc:1403] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.090s	user 0.025s	sys 0.001s
I20260709 12:19:52.854135 28303 raft_consensus.cc:359] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.854779 28303 raft_consensus.cc:740] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.855463 28303 consensus_queue.cc:260] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.857573 28303 ts_tablet_manager.cc:1434] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:52.858305 28303 tablet_bootstrap.cc:492] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:52.901610 27421 catalog_manager.cc:5697] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 1 to 2, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 2 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.908540 27421 catalog_manager.cc:5697] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c reported cstate change: term changed from 2 to 3, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to be117ea016214236abda478b04f7f70c (127.19.108.4). New cstate: current_term: 3 leader_uuid: "be117ea016214236abda478b04f7f70c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.903100 28303 tablet_bootstrap.cc:492] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:52.906889 27424 catalog_manager.cc:5697] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 1 to 2, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.912479 28303 tablet_bootstrap.cc:492] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:52.902146 27422 catalog_manager.cc:5697] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 1 to 2, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.913290 28303 ts_tablet_manager.cc:1403] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.006s
I20260709 12:19:52.912477 27424 catalog_manager.cc:5697] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 1 to 2, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.921909 27424 catalog_manager.cc:5697] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 1 to 2, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.923559 27424 catalog_manager.cc:5697] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 1 to 2, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.949887 28303 raft_consensus.cc:359] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:52.950745 28303 raft_consensus.cc:740] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.958134 27599 raft_consensus.cc:1275] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Refusing update from remote peer 2e2faf2971ea4c7ab7f426935b9e6d96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:52.960175 28249 consensus_queue.cc:1048] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:53.036530 27716 consensus_peers.cc:597] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.044659 28303 consensus_queue.cc:260] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:53.046813 28303 ts_tablet_manager.cc:1434] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.133s	user 0.005s	sys 0.000s
I20260709 12:19:53.047622 28303 tablet_bootstrap.cc:492] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:53.057797 27642 consensus_peers.cc:597] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.087164 27599 raft_consensus.cc:1275] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Refusing update from remote peer 2e2faf2971ea4c7ab7f426935b9e6d96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.088932 28310 consensus_queue.cc:1048] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.097289 28303 tablet_bootstrap.cc:492] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.098258 28303 tablet_bootstrap.cc:492] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.101043 28303 ts_tablet_manager.cc:1403] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.005s
I20260709 12:19:53.105077 27598 raft_consensus.cc:1275] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Refusing update from remote peer be117ea016214236abda478b04f7f70c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.105198 28303 raft_consensus.cc:359] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:53.105932 28303 raft_consensus.cc:740] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.107091 28303 consensus_queue.cc:260] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:53.110301 28330 consensus_queue.cc:1048] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.112170 28303 ts_tablet_manager.cc:1434] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
W20260709 12:19:53.115239 27642 consensus_peers.cc:597] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.116369 28303 tablet_bootstrap.cc:492] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:53.118098 27716 consensus_peers.cc:597] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.122956 27596 raft_consensus.cc:1275] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Refusing update from remote peer be117ea016214236abda478b04f7f70c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:53.127570 27749 raft_consensus.cc:1275] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer 2e2faf2971ea4c7ab7f426935b9e6d96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.128036 28330 consensus_queue.cc:1048] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.128878 28310 consensus_queue.cc:1048] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:53.197273 27642 consensus_peers.cc:597] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.211997 28303 tablet_bootstrap.cc:492] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.213207 28303 tablet_bootstrap.cc:492] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.214411 28303 ts_tablet_manager.cc:1403] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.001s
I20260709 12:19:53.217445 28303 raft_consensus.cc:359] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:53.218184 28303 raft_consensus.cc:740] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.219023 28303 consensus_queue.cc:260] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
W20260709 12:19:53.220533 27568 consensus_peers.cc:597] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.223034 28303 ts_tablet_manager.cc:1434] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:19:53.224433 28303 tablet_bootstrap.cc:492] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:53.229524 27670 raft_consensus.cc:1275] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer aee9fc0a34154b1d81b6ad3393c17b67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:19:53.247048 27716 consensus_peers.cc:597] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.250320 27749 raft_consensus.cc:1275] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer 2e2faf2971ea4c7ab7f426935b9e6d96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.254966 28249 consensus_queue.cc:1048] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.262745 28339 consensus_queue.cc:1048] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.266733 27599 raft_consensus.cc:1275] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Refusing update from remote peer be117ea016214236abda478b04f7f70c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.268342 28336 consensus_queue.cc:1048] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.277135 28303 tablet_bootstrap.cc:492] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.280326 28303 tablet_bootstrap.cc:492] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.283545 28312 raft_consensus.cc:493] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.284114 28312 raft_consensus.cc:515] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:53.288663 28303 ts_tablet_manager.cc:1403] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.007s
I20260709 12:19:53.289667 28312 leader_election.cc:290] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
W20260709 12:19:53.356942 27642 consensus_peers.cc:597] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.367033 28303 raft_consensus.cc:359] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:53.367785 28303 raft_consensus.cc:740] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.369012 27676 raft_consensus.cc:1275] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer aee9fc0a34154b1d81b6ad3393c17b67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.354426 28312 raft_consensus.cc:493] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.370034 28312 raft_consensus.cc:515] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.371776 28303 consensus_queue.cc:260] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:53.372211 28312 leader_election.cc:290] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:53.388034 27596 raft_consensus.cc:1275] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Refusing update from remote peer 2e2faf2971ea4c7ab7f426935b9e6d96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.390580 28249 consensus_queue.cc:1048] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:53.398228 27716 consensus_peers.cc:597] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.402501 28410 consensus_queue.cc:1048] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:53.408018 28303 ts_tablet_manager.cc:1434] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.003s
I20260709 12:19:53.408896 28303 tablet_bootstrap.cc:492] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:53.414628 27594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
W20260709 12:19:53.450152 27642 consensus_peers.cc:597] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.529433 27714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:45493, user_credentials={real_user=slave}} blocked reactor thread for 79277.7us
W20260709 12:19:53.552186 27568 consensus_peers.cc:597] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.590965 28303 tablet_bootstrap.cc:492] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.607882 28303 tablet_bootstrap.cc:492] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.608583 28303 ts_tablet_manager.cc:1403] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.200s	user 0.032s	sys 0.004s
I20260709 12:19:53.619941 28303 raft_consensus.cc:359] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.620894 28303 raft_consensus.cc:740] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.621912 28303 consensus_queue.cc:260] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.628656 28303 ts_tablet_manager.cc:1434] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:19:53.629453 28303 tablet_bootstrap.cc:492] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:53.710112 27642 consensus_peers.cc:597] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.710741 27642 consensus_peers.cc:597] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.711151 27642 consensus_peers.cc:597] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.718530 27568 consensus_peers.cc:597] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.728869 27716 consensus_peers.cc:597] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.729774 27716 consensus_peers.cc:597] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.730278 27716 consensus_peers.cc:597] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.732353 27568 consensus_peers.cc:597] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.736490 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af215ddc5284c54a2e361b75ce7b45e" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:53.737972 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edaed12566a4bdf9cbff46d06ef8f1e" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
W20260709 12:19:53.740600 27642 consensus_peers.cc:597] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.741101 27642 consensus_peers.cc:597] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.741472 27642 consensus_peers.cc:597] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.744063 28298 leader_election.cc:304] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:53.745811 28416 raft_consensus.cc:2749] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.747593 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edaed12566a4bdf9cbff46d06ef8f1e" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
W20260709 12:19:53.750046 27716 consensus_peers.cc:597] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.750599 27716 consensus_peers.cc:597] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.760294 28444 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:34993 every 8 connection(s)
I20260709 12:19:53.762382 28416 raft_consensus.cc:493] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.762907 28416 raft_consensus.cc:515] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.764987 28416 leader_election.cc:290] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:19:53.766657 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af49c4f1e7b4c12a9985f530fc9603b" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:53.766999 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:34993
I20260709 12:19:53.770373 28298 leader_election.cc:304] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
I20260709 12:19:53.771582 28303 tablet_bootstrap.cc:492] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.772598 28303 tablet_bootstrap.cc:492] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.771679 28416 raft_consensus.cc:2749] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.773331 28303 ts_tablet_manager.cc:1403] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.144s	user 0.019s	sys 0.010s
I20260709 12:19:53.792008 28380 raft_consensus.cc:3060] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:53.795622 27642 consensus_peers.cc:597] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.799050 28303 raft_consensus.cc:359] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:53.804986 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af49c4f1e7b4c12a9985f530fc9603b" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" is_pre_election: true
I20260709 12:19:53.805485 28303 raft_consensus.cc:740] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.807786 28303 consensus_queue.cc:260] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:53.810879 28303 ts_tablet_manager.cc:1434] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:19:53.811736 28303 tablet_bootstrap.cc:492] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:53.813100 27716 consensus_peers.cc:597] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.814764 28298 leader_election.cc:304] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c
W20260709 12:19:53.815464 27716 consensus_peers.cc:597] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.815640 28416 raft_consensus.cc:2749] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:53.823529 27568 consensus_peers.cc:597] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.835888 28380 raft_consensus.cc:3060] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.838429 28303 tablet_bootstrap.cc:492] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.839414 28303 tablet_bootstrap.cc:492] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.840092 28303 ts_tablet_manager.cc:1403] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.001s
I20260709 12:19:53.842586 28303 raft_consensus.cc:359] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:53.843304 28303 raft_consensus.cc:740] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.844130 28303 consensus_queue.cc:260] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:53.846361 28303 ts_tablet_manager.cc:1434] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:53.847188 28303 tablet_bootstrap.cc:492] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:53.865118 27642 consensus_peers.cc:597] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.867007 28303 tablet_bootstrap.cc:492] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.868026 28303 tablet_bootstrap.cc:492] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.868726 28303 ts_tablet_manager.cc:1403] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 12:19:53.870656 28446 heartbeater.cc:344] Connected to a master server at 127.19.108.62:44381
I20260709 12:19:53.871134 28446 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:53.871706 28303 raft_consensus.cc:359] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.872056 28446 heartbeater.cc:507] Master 127.19.108.62:44381 requested a full tablet report, sending...
I20260709 12:19:53.875244 28303 raft_consensus.cc:740] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.875962 28303 consensus_queue.cc:260] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.877759 28303 ts_tablet_manager.cc:1434] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 12:19:53.878545 28303 tablet_bootstrap.cc:492] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:53.879401 27716 consensus_peers.cc:597] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:53.890369 27642 consensus_peers.cc:597] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.894776 28303 tablet_bootstrap.cc:492] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.895177 27422 ts_manager.cc:194] Re-registered known tserver with Master: de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:53.895778 28303 tablet_bootstrap.cc:492] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.896440 28303 ts_tablet_manager.cc:1403] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:19:53.898867 28303 raft_consensus.cc:359] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.899507 28303 raft_consensus.cc:740] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
W20260709 12:19:53.900858 27642 consensus_peers.cc:597] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.900070 28303 consensus_queue.cc:260] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.903285 28303 ts_tablet_manager.cc:1434] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:53.904016 28303 tablet_bootstrap.cc:492] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:53.910058 28416 raft_consensus.cc:493] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.910576 28416 raft_consensus.cc:515] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:53.912721 28416 leader_election.cc:290] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:19:53.913322 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:53.914203 27598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" is_pre_election: true
I20260709 12:19:53.915866 28298 leader_election.cc:304] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de15618bc48545b6986320ca2292fc60; no voters: aee9fc0a34154b1d81b6ad3393c17b67, be117ea016214236abda478b04f7f70c
I20260709 12:19:53.917088 28416 raft_consensus.cc:2749] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.922135 28303 tablet_bootstrap.cc:492] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.923113 28303 tablet_bootstrap.cc:492] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.923748 28303 ts_tablet_manager.cc:1403] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:19:53.926086 28303 raft_consensus.cc:359] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.926928 28303 raft_consensus.cc:740] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.927754 28303 consensus_queue.cc:260] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:53.931277 28303 ts_tablet_manager.cc:1434] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:19:53.931422 27716 consensus_peers.cc:597] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.933137 28303 tablet_bootstrap.cc:492] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:53.947639 28380 raft_consensus.cc:3060] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.949071 27422 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48674
I20260709 12:19:53.954427 28446 heartbeater.cc:499] Master 127.19.108.62:44381 was elected leader, sending a full tablet report...
W20260709 12:19:53.957077 27642 consensus_peers.cc:597] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:53.963891 28303 tablet_bootstrap.cc:492] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.964856 28303 tablet_bootstrap.cc:492] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:53.965509 28303 ts_tablet_manager.cc:1403] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.010s
I20260709 12:19:53.968374 28303 raft_consensus.cc:359] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:53.970045 28303 raft_consensus.cc:740] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.970687 28303 consensus_queue.cc:260] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:53.973536 28303 ts_tablet_manager.cc:1434] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:19:53.974315 28380 raft_consensus.cc:3060] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.974318 28303 tablet_bootstrap.cc:492] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.004397 28303 tablet_bootstrap.cc:492] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.005671 28303 tablet_bootstrap.cc:492] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.006301 28303 ts_tablet_manager.cc:1403] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.000s
I20260709 12:19:54.008788 28303 raft_consensus.cc:359] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.009467 28303 raft_consensus.cc:740] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.010109 28303 consensus_queue.cc:260] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.012162 28303 ts_tablet_manager.cc:1434] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:19:54.012969 28303 tablet_bootstrap.cc:492] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.040328 28303 tablet_bootstrap.cc:492] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.041239 28303 tablet_bootstrap.cc:492] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.041854 28303 ts_tablet_manager.cc:1403] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.016s
W20260709 12:19:54.044114 27716 consensus_peers.cc:597] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.045296 28303 raft_consensus.cc:359] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.046037 28303 raft_consensus.cc:740] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.046881 28303 consensus_queue.cc:260] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.049007 28303 ts_tablet_manager.cc:1434] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:54.049815 28303 tablet_bootstrap.cc:492] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:54.050312 27642 consensus_peers.cc:597] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.070255 28303 tablet_bootstrap.cc:492] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.071266 28303 tablet_bootstrap.cc:492] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.072760 28303 ts_tablet_manager.cc:1403] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:19:54.076027 28303 raft_consensus.cc:359] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.076704 28303 raft_consensus.cc:740] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.077390 28303 consensus_queue.cc:260] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.081898 28303 ts_tablet_manager.cc:1434] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:19:54.082482 28303 tablet_bootstrap.cc:492] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.110996 28303 tablet_bootstrap.cc:492] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.111972 28303 tablet_bootstrap.cc:492] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.112699 28303 ts_tablet_manager.cc:1403] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.000s
W20260709 12:19:54.115461 27568 consensus_peers.cc:597] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.115269 28303 raft_consensus.cc:359] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.115912 28303 raft_consensus.cc:740] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.116621 28303 consensus_queue.cc:260] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.118616 28303 ts_tablet_manager.cc:1434] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:19:54.119396 28303 tablet_bootstrap.cc:492] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:54.138785 27716 consensus_peers.cc:597] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.162159 28303 tablet_bootstrap.cc:492] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.163578 28303 tablet_bootstrap.cc:492] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.164216 28303 ts_tablet_manager.cc:1403] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.045s	user 0.028s	sys 0.013s
I20260709 12:19:54.166870 28303 raft_consensus.cc:359] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.167496 28303 raft_consensus.cc:740] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.168233 28303 consensus_queue.cc:260] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.170109 28303 ts_tablet_manager.cc:1434] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:54.171205 28303 tablet_bootstrap.cc:492] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:54.182063 27568 consensus_peers.cc:597] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.194682 28379 raft_consensus.cc:3060] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:54.210877 28303 tablet_bootstrap.cc:492] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.212466 28303 tablet_bootstrap.cc:492] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.213124 28303 ts_tablet_manager.cc:1403] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.007s
I20260709 12:19:54.215500 28303 raft_consensus.cc:359] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.216157 28303 raft_consensus.cc:740] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.216758 28303 consensus_queue.cc:260] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.219494 28303 ts_tablet_manager.cc:1434] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:54.220259 28303 tablet_bootstrap.cc:492] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:54.244784 27568 consensus_peers.cc:597] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:54.247243 28303 tablet_bootstrap.cc:492] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.256772 28303 tablet_bootstrap.cc:492] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.257753 28303 ts_tablet_manager.cc:1403] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.015s
I20260709 12:19:54.260275 28303 raft_consensus.cc:359] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.260919 28303 raft_consensus.cc:740] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.261585 28303 consensus_queue.cc:260] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.263739 28303 ts_tablet_manager.cc:1434] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:54.264503 28303 tablet_bootstrap.cc:492] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.291697 28303 tablet_bootstrap.cc:492] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.292577 28303 tablet_bootstrap.cc:492] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.293071 28303 ts_tablet_manager.cc:1403] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.011s
I20260709 12:19:54.294762 28303 raft_consensus.cc:359] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.295264 28303 raft_consensus.cc:740] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.295745 28303 consensus_queue.cc:260] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.297147 28303 ts_tablet_manager.cc:1434] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:54.297837 28303 tablet_bootstrap.cc:492] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.421046 28379 raft_consensus.cc:3060] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:54.421792 28292 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.423468 28292 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.425454 28303 tablet_bootstrap.cc:492] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.426417 28303 tablet_bootstrap.cc:492] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.427042 28303 ts_tablet_manager.cc:1403] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.129s	user 0.031s	sys 0.064s
I20260709 12:19:54.431710 28292 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:54.433107 28380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60" is_pre_election: true
I20260709 12:19:54.435864 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c" is_pre_election: true
I20260709 12:19:54.440438 27749 raft_consensus.cc:2468] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 2.
I20260709 12:19:54.438803 28303 raft_consensus.cc:359] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
W20260709 12:19:54.441285 27642 leader_election.cc:343] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.441395 28303 raft_consensus.cc:740] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.442166 28303 consensus_queue.cc:260] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.442420 27640 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: de15618bc48545b6986320ca2292fc60
I20260709 12:19:54.446125 28292 raft_consensus.cc:2804] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:54.446050 28303 ts_tablet_manager.cc:1434] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:19:54.454736 28292 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.455168 28303 tablet_bootstrap.cc:492] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.455688 28292 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:54.472157 28292 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.475659 28303 tablet_bootstrap.cc:492] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.484649 28303 tablet_bootstrap.cc:492] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.485417 28303 ts_tablet_manager.cc:1403] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.006s
I20260709 12:19:54.486812 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:19:54.487421 27749 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:54.488101 28292 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 3 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:19:54.487907 28303 raft_consensus.cc:359] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.489558 28303 raft_consensus.cc:740] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.490247 28303 consensus_queue.cc:260] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.492415 28303 ts_tablet_manager.cc:1434] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:54.493268 28303 tablet_bootstrap.cc:492] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.496723 27749 raft_consensus.cc:2468] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e2faf2971ea4c7ab7f426935b9e6d96 in term 3.
I20260709 12:19:54.499502 27640 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, be117ea016214236abda478b04f7f70c; no voters: 
I20260709 12:19:54.500705 28380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:19:54.502076 28476 raft_consensus.cc:2804] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:19:54.505205 27642 leader_election.cc:343] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:54.515689 28303 tablet_bootstrap.cc:492] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.525450 28476 raft_consensus.cc:697] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 LEADER]: Becoming Leader. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:19:54.525871 28303 tablet_bootstrap.cc:492] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.528309 28303 ts_tablet_manager.cc:1403] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.003s
I20260709 12:19:54.530752 28303 raft_consensus.cc:359] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.533617 28303 raft_consensus.cc:740] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.534204 28303 consensus_queue.cc:260] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.537462 28303 ts_tablet_manager.cc:1434] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:54.528097 28476 consensus_queue.cc:237] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.545085 28303 tablet_bootstrap.cc:492] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.584014 28303 tablet_bootstrap.cc:492] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.584880 28303 tablet_bootstrap.cc:492] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.585505 28303 ts_tablet_manager.cc:1403] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 12:19:54.588689 28303 raft_consensus.cc:359] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.589313 28303 raft_consensus.cc:740] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.589944 28303 consensus_queue.cc:260] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.592173 28303 ts_tablet_manager.cc:1434] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:19:54.593142 28303 tablet_bootstrap.cc:492] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.595443 27422 catalog_manager.cc:5697] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 reported cstate change: term changed from 1 to 3, leader changed from de15618bc48545b6986320ca2292fc60 (127.19.108.1) to 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.624408 28303 tablet_bootstrap.cc:492] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.625444 28303 tablet_bootstrap.cc:492] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.626421 28303 ts_tablet_manager.cc:1403] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.007s
I20260709 12:19:54.631245 28303 raft_consensus.cc:359] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.631798 28303 raft_consensus.cc:740] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.632469 28303 consensus_queue.cc:260] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.635674 28303 ts_tablet_manager.cc:1434] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:54.640925 28303 tablet_bootstrap.cc:492] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.660748 28303 tablet_bootstrap.cc:492] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.661640 28303 tablet_bootstrap.cc:492] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.662523 28303 ts_tablet_manager.cc:1403] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 12:19:54.665000 28303 raft_consensus.cc:359] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.665668 28303 raft_consensus.cc:740] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.666358 28303 consensus_queue.cc:260] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.668419 28303 ts_tablet_manager.cc:1434] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:54.669188 28303 tablet_bootstrap.cc:492] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.691289 28303 tablet_bootstrap.cc:492] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.692413 28303 tablet_bootstrap.cc:492] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.693015 28303 ts_tablet_manager.cc:1403] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.010s
I20260709 12:19:54.695480 28303 raft_consensus.cc:359] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.696091 28303 raft_consensus.cc:740] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.696707 28303 consensus_queue.cc:260] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.698678 28303 ts_tablet_manager.cc:1434] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:19:54.699375 28303 tablet_bootstrap.cc:492] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.779250 28303 tablet_bootstrap.cc:492] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.780224 28303 tablet_bootstrap.cc:492] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.780874 28303 ts_tablet_manager.cc:1403] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.059s
I20260709 12:19:54.790222 28303 raft_consensus.cc:359] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.791199 28303 raft_consensus.cc:740] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.791841 28303 consensus_queue.cc:260] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.794005 28303 ts_tablet_manager.cc:1434] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.001s
I20260709 12:19:54.794811 28303 tablet_bootstrap.cc:492] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.809687 28303 tablet_bootstrap.cc:492] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.810318 28303 tablet_bootstrap.cc:492] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.810915 28303 ts_tablet_manager.cc:1403] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:19:54.812979 28303 raft_consensus.cc:359] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.813484 28303 raft_consensus.cc:740] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.814034 28303 consensus_queue.cc:260] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.816017 28303 ts_tablet_manager.cc:1434] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:54.816798 28303 tablet_bootstrap.cc:492] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.830868 28303 tablet_bootstrap.cc:492] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.831660 28303 tablet_bootstrap.cc:492] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.832234 28303 ts_tablet_manager.cc:1403] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.002s
I20260709 12:19:54.834322 28303 raft_consensus.cc:359] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.834939 28303 raft_consensus.cc:740] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.835489 28303 consensus_queue.cc:260] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.845789 28303 ts_tablet_manager.cc:1434] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.008s
I20260709 12:19:54.846593 28303 tablet_bootstrap.cc:492] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.859208 28303 tablet_bootstrap.cc:492] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.859946 28303 tablet_bootstrap.cc:492] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.860406 28303 ts_tablet_manager.cc:1403] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:19:54.862076 28303 raft_consensus.cc:359] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.862542 28303 raft_consensus.cc:740] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.863119 28303 consensus_queue.cc:260] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:54.864841 28303 ts_tablet_manager.cc:1434] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:54.865432 28303 tablet_bootstrap.cc:492] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.882232 28303 tablet_bootstrap.cc:492] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.883071 28303 tablet_bootstrap.cc:492] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.883576 28303 ts_tablet_manager.cc:1403] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.009s
I20260709 12:19:54.885768 28303 raft_consensus.cc:359] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.886232 28303 raft_consensus.cc:740] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.886830 28303 consensus_queue.cc:260] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:54.888226 28303 ts_tablet_manager.cc:1434] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:19:54.889398 28303 tablet_bootstrap.cc:492] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.901449 28303 tablet_bootstrap.cc:492] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.902278 28303 tablet_bootstrap.cc:492] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.902870 28303 ts_tablet_manager.cc:1403] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:19:54.905146 28303 raft_consensus.cc:359] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.905649 28303 raft_consensus.cc:740] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.906273 28303 consensus_queue.cc:260] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.908182 28303 ts_tablet_manager.cc:1434] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:54.908915 28303 tablet_bootstrap.cc:492] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.933883 28379 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:19:54.944344 28379 raft_consensus.cc:1275] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Refusing update from remote peer 2e2faf2971ea4c7ab7f426935b9e6d96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:54.946287 28473 consensus_queue.cc:1048] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:54.950639 28303 tablet_bootstrap.cc:492] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:54.951751 28303 tablet_bootstrap.cc:492] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:54.952577 28303 ts_tablet_manager.cc:1403] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.020s
I20260709 12:19:54.957778 28303 raft_consensus.cc:359] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.960079 28303 raft_consensus.cc:740] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:54.960701 28303 consensus_queue.cc:260] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:54.963136 28303 ts_tablet_manager.cc:1434] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:54.965056 28303 tablet_bootstrap.cc:492] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:54.988306 27747 raft_consensus.cc:1275] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Refusing update from remote peer 2e2faf2971ea4c7ab7f426935b9e6d96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:55.019471 28473 consensus_queue.cc:1048] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:55.028273 28379 raft_consensus.cc:3060] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.040280 28380 raft_consensus.cc:3060] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.063293 28303 tablet_bootstrap.cc:492] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:55.064234 28303 tablet_bootstrap.cc:492] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:55.064770 28303 ts_tablet_manager.cc:1403] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.100s	user 0.036s	sys 0.035s
I20260709 12:19:55.067044 28382 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:55.067211 28303 raft_consensus.cc:359] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:55.068086 28303 raft_consensus.cc:740] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.068948 28303 consensus_queue.cc:260] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:19:55.071965 28303 ts_tablet_manager.cc:1434] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:55.072722 28303 tablet_bootstrap.cc:492] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
W20260709 12:19:55.086982 27714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:45493, user_credentials={real_user=slave}} blocked reactor thread for 54499.5us
I20260709 12:19:55.146917 28303 tablet_bootstrap.cc:492] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:55.147835 28303 tablet_bootstrap.cc:492] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:55.148483 28303 ts_tablet_manager.cc:1403] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.020s
I20260709 12:19:55.151453 28303 raft_consensus.cc:359] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:55.152273 28303 raft_consensus.cc:740] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.153004 28303 consensus_queue.cc:260] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:19:55.155623 28303 ts_tablet_manager.cc:1434] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:55.162585 28303 tablet_bootstrap.cc:492] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:55.188653 28303 tablet_bootstrap.cc:492] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:55.189560 28303 tablet_bootstrap.cc:492] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:55.190104 28303 ts_tablet_manager.cc:1403] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.011s
I20260709 12:19:55.191900 28303 raft_consensus.cc:359] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:55.192358 28303 raft_consensus.cc:740] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.192880 28303 consensus_queue.cc:260] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:55.194397 28303 ts_tablet_manager.cc:1434] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.001s
I20260709 12:19:55.195628 28303 tablet_bootstrap.cc:492] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:55.208678 28303 tablet_bootstrap.cc:492] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:55.209450 28303 tablet_bootstrap.cc:492] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:55.209872 28303 ts_tablet_manager.cc:1403] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 12:19:55.211829 28303 raft_consensus.cc:359] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:55.212491 28303 raft_consensus.cc:740] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.213197 28303 consensus_queue.cc:260] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:55.215391 28303 ts_tablet_manager.cc:1434] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:19:55.216120 28303 tablet_bootstrap.cc:492] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:55.236740 28303 tablet_bootstrap.cc:492] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:55.240532 28303 tablet_bootstrap.cc:492] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:55.241181 28303 ts_tablet_manager.cc:1403] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 12:19:55.243512 28303 raft_consensus.cc:359] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:55.245134 28303 raft_consensus.cc:740] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.245854 28303 consensus_queue.cc:260] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:19:55.248095 28303 ts_tablet_manager.cc:1434] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:55.248824 28303 tablet_bootstrap.cc:492] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: Bootstrap starting.
I20260709 12:19:55.276028 28382 raft_consensus.cc:3060] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.284385 28303 tablet_bootstrap.cc:492] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:55.285328 28303 tablet_bootstrap.cc:492] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: Bootstrap complete.
I20260709 12:19:55.285956 28303 ts_tablet_manager.cc:1403] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.005s
I20260709 12:19:55.288121 28303 raft_consensus.cc:359] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:55.289986 28303 raft_consensus.cc:740] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de15618bc48545b6986320ca2292fc60, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.290584 28303 consensus_queue.cc:260] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:19:55.293216 28303 ts_tablet_manager.cc:1434] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:20:03.820083 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:03.867564 27673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342"
dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:37630
I20260709 12:20:03.868273 27673 raft_consensus.cc:606] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:03.870589 27673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2"
dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:37630
I20260709 12:20:03.871049 27673 raft_consensus.cc:606] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:03.873071 27673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a629b1a82d14248a102eec847a92754"
dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:37630
I20260709 12:20:03.873461 27673 raft_consensus.cc:606] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:03.884027 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:03.884464 27747 raft_consensus.cc:606] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 3 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:03.886770 27673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c35d6286faf45d4af1a9dfcd42a2819"
dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:37630
I20260709 12:20:03.887261 27673 raft_consensus.cc:606] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:03.889488 27673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c"
dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:37630
I20260709 12:20:03.889912 27673 raft_consensus.cc:606] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:03.890980 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:03.892127 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:03.892802 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:03.940232 28529 raft_consensus.cc:993] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:03.940876 28521 raft_consensus.cc:1081] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:03.941736 28543 raft_consensus.cc:993] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:03.942268 28529 raft_consensus.cc:1081] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:03.942480 28379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:20:03.943199 28379 raft_consensus.cc:493] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.943502 28379 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.943974 28382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c35d6286faf45d4af1a9dfcd42a2819"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:20:03.944576 28382 raft_consensus.cc:493] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.944896 28382 raft_consensus.cc:3060] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.951776 28379 raft_consensus.cc:515] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:03.954617 28382 raft_consensus.cc:515] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:03.955374 28379 leader_election.cc:290] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 4 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:03.955857 27747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:03.956214 27673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad5954225334151b3f3a9827fc27342" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:03.956610 27747 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.956743 27673 raft_consensus.cc:3055] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:03.957937 27673 raft_consensus.cc:740] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:20:03.958738 27673 consensus_queue.cc:260] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:03.960332 28529 raft_consensus.cc:993] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:03.960795 28521 raft_consensus.cc:1081] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:03.962623 28379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a629b1a82d14248a102eec847a92754"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:20:03.963232 28379 raft_consensus.cc:493] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.963209 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c35d6286faf45d4af1a9dfcd42a2819" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:03.963904 28379 raft_consensus.cc:3060] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.964069 27749 raft_consensus.cc:3060] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.963138 28382 leader_election.cc:290] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:03.968587 27747 raft_consensus.cc:2468] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 4.
I20260709 12:20:03.969376 27673 raft_consensus.cc:3060] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.970016 28298 leader_election.cc:304] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:03.971604 27749 raft_consensus.cc:2468] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:03.971529 28379 raft_consensus.cc:515] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:03.973389 28298 leader_election.cc:304] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:03.973444 28545 raft_consensus.cc:2804] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:03.973976 28379 leader_election.cc:290] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:03.981726 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c35d6286faf45d4af1a9dfcd42a2819" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:03.982319 27676 raft_consensus.cc:3055] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:03.982646 27676 raft_consensus.cc:740] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:20:03.984373 27676 consensus_queue.cc:260] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:03.985808 27676 raft_consensus.cc:3060] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.986303 28546 raft_consensus.cc:2804] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:03.986898 27673 raft_consensus.cc:2468] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 4.
I20260709 12:20:03.988926 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a629b1a82d14248a102eec847a92754" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:03.989465 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a629b1a82d14248a102eec847a92754" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:03.990069 27670 raft_consensus.cc:3055] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:03.990336 27670 raft_consensus.cc:740] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:20:03.990406 28545 raft_consensus.cc:697] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 4 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:03.989442 27749 raft_consensus.cc:3060] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.991817 28545 consensus_queue.cc:237] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:03.995766 27670 consensus_queue.cc:260] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:03.996109 28546 raft_consensus.cc:697] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:03.997205 27670 raft_consensus.cc:3060] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.997376 28546 consensus_queue.cc:237] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:04.003449 27749 raft_consensus.cc:2468] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:04.009423 28298 leader_election.cc:304] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:04.010326 28546 raft_consensus.cc:2804] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:04.010833 28546 raft_consensus.cc:697] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:04.010914 27670 raft_consensus.cc:2468] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:04.012039 28546 consensus_queue.cc:237] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:04.013830 27676 raft_consensus.cc:2468] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:04.030544 27424 catalog_manager.cc:5697] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 3 to 4, leader changed from 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 4 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:04.032234 27424 catalog_manager.cc:5697] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:04.072321 27424 catalog_manager.cc:5697] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:04.160728 28521 raft_consensus.cc:993] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:04.161164 28529 raft_consensus.cc:1081] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:04.162410 28379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:20:04.162865 28379 raft_consensus.cc:493] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:04.163127 28379 raft_consensus.cc:3060] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.168854 28379 raft_consensus.cc:515] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:04.170542 28379 leader_election.cc:290] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:04.171343 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:04.171471 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3a4caa6e144feae981f2540571cf2" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:04.172273 27749 raft_consensus.cc:3060] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.172336 27676 raft_consensus.cc:3055] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:04.172819 27676 raft_consensus.cc:740] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:20:04.174180 27676 consensus_queue.cc:260] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:04.175863 27676 raft_consensus.cc:3060] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.179847 27749 raft_consensus.cc:2468] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:04.180935 28298 leader_election.cc:304] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:04.181803 28546 raft_consensus.cc:2804] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:04.182267 28546 raft_consensus.cc:697] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:04.182945 27676 raft_consensus.cc:2468] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:04.183172 28546 consensus_queue.cc:237] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:04.185614 28537 raft_consensus.cc:993] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:04.186122 28352 raft_consensus.cc:1081] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 3 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:04.187634 28379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34152
I20260709 12:20:04.188031 28379 raft_consensus.cc:493] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:04.188264 28379 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:04.193475 27424 catalog_manager.cc:5697] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:04.194276 28379 raft_consensus.cc:515] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:04.197821 28379 leader_election.cc:290] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 4 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:20:04.197926 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:04.198550 27749 raft_consensus.cc:3055] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:04.198829 27749 raft_consensus.cc:740] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:04.199570 27749 consensus_queue.cc:260] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:04.200069 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fe214d9a2046e5ad2f9c677aef5b61" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:20:04.200682 27593 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:04.201213 27749 raft_consensus.cc:3060] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:04.207947 27593 raft_consensus.cc:2468] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 4.
I20260709 12:20:04.209431 28299 leader_election.cc:304] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:04.210134 28546 raft_consensus.cc:2804] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:04.210621 28546 raft_consensus.cc:697] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 4 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:04.211074 27749 raft_consensus.cc:2468] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 4.
I20260709 12:20:04.211495 28546 consensus_queue.cc:237] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:04.215359 28521 raft_consensus.cc:993] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:04.215889 28529 raft_consensus.cc:1081] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:04.217314 28379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:20:04.217837 28379 raft_consensus.cc:493] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:04.218180 28379 raft_consensus.cc:3060] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.222771 27424 catalog_manager.cc:5697] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 3 to 4, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 4 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:04.223423 28379 raft_consensus.cc:515] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:04.225000 28379 leader_election.cc:290] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:04.225944 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:04.225988 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced5637a8c774be3bf649a62de77ab2c" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:04.226733 27749 raft_consensus.cc:3060] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.226825 27676 raft_consensus.cc:3055] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:04.227280 27676 raft_consensus.cc:740] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:20:04.228041 27676 consensus_queue.cc:260] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:04.229665 27676 raft_consensus.cc:3060] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.233585 27749 raft_consensus.cc:2468] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:04.234647 28298 leader_election.cc:304] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:04.235510 28546 raft_consensus.cc:2804] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:04.235968 28546 raft_consensus.cc:697] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:04.236289 27676 raft_consensus.cc:2468] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:04.236769 28546 consensus_queue.cc:237] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:04.248452 27424 catalog_manager.cc:5697] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:04.405673 27749 raft_consensus.cc:1275] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.406800 28546 consensus_queue.cc:1048] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.418243 27676 raft_consensus.cc:1275] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.419744 28545 consensus_queue.cc:1048] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.474330 27749 raft_consensus.cc:1275] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.475450 28545 consensus_queue.cc:1048] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.484352 27676 raft_consensus.cc:1275] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.485692 28545 consensus_queue.cc:1048] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.508819 27749 raft_consensus.cc:1275] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 4 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:04.509934 28545 consensus_queue.cc:1048] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.519165 27676 raft_consensus.cc:1275] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 4 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:04.521538 28548 consensus_queue.cc:1048] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.772187 27670 raft_consensus.cc:1275] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.773344 27593 raft_consensus.cc:1275] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 4 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:04.773389 28545 consensus_queue.cc:1048] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:04.774477 27749 raft_consensus.cc:1275] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.774788 28546 consensus_queue.cc:1048] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.775744 28545 consensus_queue.cc:1048] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.779771 27747 raft_consensus.cc:1275] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 4 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:04.781365 28545 consensus_queue.cc:1048] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.801769 27676 raft_consensus.cc:1275] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.807713 28546 consensus_queue.cc:1048] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.823644 27748 raft_consensus.cc:1275] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.825546 28545 consensus_queue.cc:1048] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.930778 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:04.966343 27676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a"
dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:37630
I20260709 12:20:04.966956 27676 raft_consensus.cc:606] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:04.969471 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:04.970031 27747 raft_consensus.cc:606] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:04.973603 27676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab"
dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:37630
I20260709 12:20:04.974045 27676 raft_consensus.cc:606] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:04.975992 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9660477954949d78372b3e23fb42b46"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:04.976401 27747 raft_consensus.cc:606] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:04.978354 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec8141371c04e69b06fc2f3b1fffef9"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:04.978773 27747 raft_consensus.cc:606] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:04.979595 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:04.980788 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:04.981348 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:05.033443 28529 raft_consensus.cc:993] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.033915 28521 raft_consensus.cc:1081] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.035224 28382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:20:05.035660 28382 raft_consensus.cc:493] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.035951 28382 raft_consensus.cc:3060] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.041651 28382 raft_consensus.cc:515] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:05.043133 28382 leader_election.cc:290] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:05.043746 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:05.043974 27747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f041e7df1d5b483ca8adc01300cbf2ab" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:05.044368 27676 raft_consensus.cc:3055] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.044497 27747 raft_consensus.cc:3060] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.044740 27676 raft_consensus.cc:740] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:20:05.045473 27676 consensus_queue.cc:260] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:05.046406 27676 raft_consensus.cc:3060] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.050505 27747 raft_consensus.cc:2468] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:05.050793 28352 raft_consensus.cc:993] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.051663 28298 leader_election.cc:304] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be117ea016214236abda478b04f7f70c, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:05.051749 28539 raft_consensus.cc:1081] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.052488 28546 raft_consensus.cc:2804] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:05.052953 28546 raft_consensus.cc:697] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:05.053817 28380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34152
I20260709 12:20:05.053685 28546 consensus_queue.cc:237] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:05.054255 28380 raft_consensus.cc:493] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.054564 28380 raft_consensus.cc:3060] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.061620 27676 raft_consensus.cc:2468] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:05.061655 28380 raft_consensus.cc:515] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:05.064157 28380 leader_election.cc:290] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:20:05.065554 27747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:05.066023 27747 raft_consensus.cc:3055] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.066205 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d280b2356d7f4990b289d4c328eb9e7e" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:20:05.066377 27747 raft_consensus.cc:740] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:05.066880 27593 raft_consensus.cc:3060] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.071054 28352 raft_consensus.cc:993] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.071539 28537 raft_consensus.cc:1081] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.071753 27747 consensus_queue.cc:260] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:05.073050 28379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9660477954949d78372b3e23fb42b46"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34152
I20260709 12:20:05.073053 27747 raft_consensus.cc:3060] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.073660 28379 raft_consensus.cc:493] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.074012 28379 raft_consensus.cc:3060] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.073155 27593 raft_consensus.cc:2468] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:05.076238 28299 leader_election.cc:304] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:05.075935 27422 catalog_manager.cc:5697] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.077023 28546 raft_consensus.cc:2804] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:05.077538 28546 raft_consensus.cc:697] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:05.078341 28546 consensus_queue.cc:237] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:05.079816 27747 raft_consensus.cc:2468] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:05.083246 28379 raft_consensus.cc:515] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:05.087126 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:20:05.087666 27593 raft_consensus.cc:3060] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.088594 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9660477954949d78372b3e23fb42b46" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:05.089170 27748 raft_consensus.cc:3055] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.089514 27748 raft_consensus.cc:740] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:05.089039 28379 leader_election.cc:290] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:20:05.093456 27748 consensus_queue.cc:260] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:05.097266 27593 raft_consensus.cc:2468] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:05.098439 28299 leader_election.cc:304] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:05.099094 27748 raft_consensus.cc:3060] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.099414 28546 raft_consensus.cc:2804] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:05.099915 28546 raft_consensus.cc:697] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:05.100808 28546 consensus_queue.cc:237] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:05.109670 27748 raft_consensus.cc:2468] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:05.116361 27422 catalog_manager.cc:5697] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:05.119246 27422 catalog_manager.cc:5697] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:05.165164 28352 raft_consensus.cc:993] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.165652 28539 raft_consensus.cc:1081] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.167577 28382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec8141371c04e69b06fc2f3b1fffef9"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34152
I20260709 12:20:05.168103 28382 raft_consensus.cc:493] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.168434 28382 raft_consensus.cc:3060] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.175073 28382 raft_consensus.cc:515] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:05.177515 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec8141371c04e69b06fc2f3b1fffef9" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:05.178099 27676 raft_consensus.cc:3060] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.181933 28382 leader_election.cc:290] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:05.182920 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec8141371c04e69b06fc2f3b1fffef9" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:05.183514 27748 raft_consensus.cc:3055] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.183776 27748 raft_consensus.cc:740] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:05.184551 27676 raft_consensus.cc:2468] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:05.184417 27748 consensus_queue.cc:260] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:05.185711 27748 raft_consensus.cc:3060] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.191839 28298 leader_election.cc:304] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:05.191905 27748 raft_consensus.cc:2468] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:05.192516 28546 raft_consensus.cc:2804] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:05.192986 28546 raft_consensus.cc:697] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:05.193797 28546 consensus_queue.cc:237] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:05.203306 27422 catalog_manager.cc:5697] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.285662 28521 raft_consensus.cc:993] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.286049 28529 raft_consensus.cc:1081] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:05.287247 28379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34148
I20260709 12:20:05.287662 28379 raft_consensus.cc:493] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.287909 28379 raft_consensus.cc:3060] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:05.292829 28379 raft_consensus.cc:515] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:20:05.295265 27593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:20:05.295775 28379 leader_election.cc:290] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 3 election: Requested vote from peers aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235), 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493)
I20260709 12:20:05.295797 27593 raft_consensus.cc:3060] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:05.296079 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22da56e5d8d04a7a82f4d2cc8eacf27a" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:05.296677 27670 raft_consensus.cc:3055] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:05.296969 27670 raft_consensus.cc:740] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e2faf2971ea4c7ab7f426935b9e6d96, State: Running, Role: LEADER
I20260709 12:20:05.297745 27670 consensus_queue.cc:260] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:20:05.298911 27670 raft_consensus.cc:3060] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:05.302686 27593 raft_consensus.cc:2468] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 3.
I20260709 12:20:05.303843 28299 leader_election.cc:304] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:05.304476 28548 raft_consensus.cc:2804] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:05.304922 28548 raft_consensus.cc:697] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 3 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:05.305235 27670 raft_consensus.cc:2468] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 3.
I20260709 12:20:05.305758 28548 consensus_queue.cc:237] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } }
I20260709 12:20:05.315071 27422 catalog_manager.cc:5697] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 2 to 3, leader changed from 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 3 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:05.461462 27748 raft_consensus.cc:1275] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.462544 28548 consensus_queue.cc:1048] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.471791 27593 raft_consensus.cc:1275] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.473134 28548 consensus_queue.cc:1048] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.603106 27748 raft_consensus.cc:1275] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.604080 28548 consensus_queue.cc:1048] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.613514 27670 raft_consensus.cc:1275] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.617053 28545 consensus_queue.cc:1048] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.673113 27593 raft_consensus.cc:1275] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.674142 28545 consensus_queue.cc:1048] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.684460 27748 raft_consensus.cc:1275] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.685809 28548 consensus_queue.cc:1048] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.728395 27593 raft_consensus.cc:1275] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:05.729393 28548 consensus_queue.cc:1048] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.740489 27670 raft_consensus.cc:1275] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:05.741616 28546 consensus_queue.cc:1048] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.748776 27748 raft_consensus.cc:1275] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.749823 28546 consensus_queue.cc:1048] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.765645 27670 raft_consensus.cc:1275] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.770885 28548 consensus_queue.cc:1048] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.018127 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:06.053076 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24fc70997e4048979966612dc07d9a47"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:06.053609 27747 raft_consensus.cc:606] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:06.056809 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "459c85488af34f9ca4d2f9dfc4946c38"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:06.057356 27747 raft_consensus.cc:606] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Received request to transfer leadership to TS aee9fc0a34154b1d81b6ad3393c17b67
I20260709 12:20:06.059489 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:06.059969 27747 raft_consensus.cc:606] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Received request to transfer leadership to TS aee9fc0a34154b1d81b6ad3393c17b67
I20260709 12:20:06.061928 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:06.062319 27747 raft_consensus.cc:606] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Received request to transfer leadership to TS aee9fc0a34154b1d81b6ad3393c17b67
I20260709 12:20:06.064249 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd2c5c04c10e47208177d477008b8d8f"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:06.064642 27747 raft_consensus.cc:606] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:06.065752 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:06.067458 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:06.068111 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:06.299435 28352 raft_consensus.cc:993] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:06.299953 28539 raft_consensus.cc:1081] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:06.301285 28382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd2c5c04c10e47208177d477008b8d8f"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34152
I20260709 12:20:06.301702 28382 raft_consensus.cc:493] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.301949 28382 raft_consensus.cc:3060] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.307462 28382 raft_consensus.cc:515] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:06.309024 28382 leader_election.cc:290] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:06.310094 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2c5c04c10e47208177d477008b8d8f" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:06.310714 27670 raft_consensus.cc:3060] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.311407 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2c5c04c10e47208177d477008b8d8f" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:06.311982 27748 raft_consensus.cc:3055] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.312268 27748 raft_consensus.cc:740] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:06.312970 27748 consensus_queue.cc:260] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:06.314205 27748 raft_consensus.cc:3060] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.316804 27670 raft_consensus.cc:2468] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:06.318203 28298 leader_election.cc:304] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:06.318922 28548 raft_consensus.cc:2804] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.319360 28548 raft_consensus.cc:697] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:06.320012 27748 raft_consensus.cc:2468] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:06.320132 28548 consensus_queue.cc:237] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:06.325284 28352 raft_consensus.cc:993] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c: : Instructing follower aee9fc0a34154b1d81b6ad3393c17b67 to start an election
I20260709 12:20:06.325755 28539 raft_consensus.cc:1081] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Signalling peer aee9fc0a34154b1d81b6ad3393c17b67 to start an election
I20260709 12:20:06.327272 27598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "459c85488af34f9ca4d2f9dfc4946c38"
dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
 from {username='slave'} at 127.0.0.1:38624
I20260709 12:20:06.327764 27598 raft_consensus.cc:493] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.328109 27598 raft_consensus.cc:3060] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.329675 27421 catalog_manager.cc:5697] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:06.334273 27598 raft_consensus.cc:515] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:20:06.337178 27598 leader_election.cc:290] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:06.338428 27670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c85488af34f9ca4d2f9dfc4946c38" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:06.339018 27670 raft_consensus.cc:3060] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.341392 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459c85488af34f9ca4d2f9dfc4946c38" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:06.341954 27748 raft_consensus.cc:3055] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.342259 27748 raft_consensus.cc:740] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:06.343003 27748 consensus_queue.cc:260] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:20:06.344044 27748 raft_consensus.cc:3060] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.344811 27670 raft_consensus.cc:2468] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 2.
I20260709 12:20:06.345347 27676 raft_consensus.cc:1240] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Rejecting Update request from peer be117ea016214236abda478b04f7f70c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:06.345892 27566 leader_election.cc:304] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:20:06.346704 28594 raft_consensus.cc:2804] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.350472 27748 raft_consensus.cc:2468] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 2.
I20260709 12:20:06.351181 28594 raft_consensus.cc:697] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:20:06.352097 28594 consensus_queue.cc:237] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:20:06.362746 27421 catalog_manager.cc:5697] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 1 to 2, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.409237 28539 raft_consensus.cc:993] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:06.409652 28352 raft_consensus.cc:1081] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:06.411053 28379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24fc70997e4048979966612dc07d9a47"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34152
I20260709 12:20:06.411577 28379 raft_consensus.cc:493] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.411919 28379 raft_consensus.cc:3060] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.420631 28379 raft_consensus.cc:515] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:06.422096 28352 raft_consensus.cc:993] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c: : Instructing follower aee9fc0a34154b1d81b6ad3393c17b67 to start an election
I20260709 12:20:06.422734 28599 raft_consensus.cc:1081] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Signalling peer aee9fc0a34154b1d81b6ad3393c17b67 to start an election
I20260709 12:20:06.422858 28379 leader_election.cc:290] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:06.424090 27747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc70997e4048979966612dc07d9a47" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:06.424377 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc70997e4048979966612dc07d9a47" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:06.424697 27598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca"
dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
 from {username='slave'} at 127.0.0.1:38624
I20260709 12:20:06.424944 27676 raft_consensus.cc:3060] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.425269 27598 raft_consensus.cc:493] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.425668 27598 raft_consensus.cc:3060] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.427232 27747 raft_consensus.cc:3055] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.427554 27747 raft_consensus.cc:740] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:06.428256 27747 consensus_queue.cc:260] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:06.429440 27747 raft_consensus.cc:3060] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.430811 27598 raft_consensus.cc:515] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:20:06.431660 27676 raft_consensus.cc:2468] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:06.432461 27598 leader_election.cc:290] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: Requested vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), be117ea016214236abda478b04f7f70c (127.19.108.4:38323)
I20260709 12:20:06.432901 28298 leader_election.cc:304] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:06.433650 28548 raft_consensus.cc:2804] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.434100 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96"
I20260709 12:20:06.434270 28548 raft_consensus.cc:697] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:06.434634 27676 raft_consensus.cc:3060] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.433609 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e42f9eb1474d79a877272e9d1566ca" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:06.435257 27748 raft_consensus.cc:3055] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.435540 27748 raft_consensus.cc:740] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:06.436252 27748 consensus_queue.cc:260] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:20:06.437415 27748 raft_consensus.cc:3060] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.440788 27676 raft_consensus.cc:2468] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 2.
I20260709 12:20:06.443553 27747 raft_consensus.cc:2468] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 2.
I20260709 12:20:06.448284 27566 leader_election.cc:304] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e2faf2971ea4c7ab7f426935b9e6d96, aee9fc0a34154b1d81b6ad3393c17b67; no voters: 
I20260709 12:20:06.450050 28605 raft_consensus.cc:2804] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.448737 27748 raft_consensus.cc:2468] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 2.
I20260709 12:20:06.450522 28605 raft_consensus.cc:697] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:20:06.451449 28548 consensus_queue.cc:237] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:06.451541 28605 consensus_queue.cc:237] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } }
I20260709 12:20:06.472280 27423 catalog_manager.cc:5697] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 1 to 2, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.472970 27421 catalog_manager.cc:5697] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 1 to 2, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:06.597394 28352 raft_consensus.cc:993] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c: : Instructing follower aee9fc0a34154b1d81b6ad3393c17b67 to start an election
I20260709 12:20:06.597834 28599 raft_consensus.cc:1081] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Signalling peer aee9fc0a34154b1d81b6ad3393c17b67 to start an election
I20260709 12:20:06.599179 27597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0"
dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
 from {username='slave'} at 127.0.0.1:38624
I20260709 12:20:06.599704 27597 raft_consensus.cc:493] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.600031 27597 raft_consensus.cc:3060] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:06.605558 27597 raft_consensus.cc:515] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:06.607753 27597 leader_election.cc:290] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 3 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:20:06.608289 27748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:06.608863 27748 raft_consensus.cc:3055] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:06.609151 27748 raft_consensus.cc:740] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:06.609534 28379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648ac5bd1d184f85b76916c8695098f0" candidate_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "de15618bc48545b6986320ca2292fc60"
I20260709 12:20:06.609881 27748 consensus_queue.cc:260] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:06.610913 28379 raft_consensus.cc:3060] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:06.611326 27748 raft_consensus.cc:3060] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:06.615278 28379 raft_consensus.cc:2468] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 3.
I20260709 12:20:06.616112 27748 raft_consensus.cc:2468] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee9fc0a34154b1d81b6ad3393c17b67 in term 3.
I20260709 12:20:06.616451 27568 leader_election.cc:304] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:06.617285 28605 raft_consensus.cc:2804] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:06.617772 28605 raft_consensus.cc:697] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 LEADER]: Becoming Leader. State: Replica: aee9fc0a34154b1d81b6ad3393c17b67, State: Running, Role: LEADER
I20260709 12:20:06.618574 28605 consensus_queue.cc:237] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:06.627628 27421 catalog_manager.cc:5697] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 reported cstate change: term changed from 2 to 3, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2). New cstate: current_term: 3 leader_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:06.814883 27748 raft_consensus.cc:1275] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.815881 28546 consensus_queue.cc:1048] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.827119 27670 raft_consensus.cc:1275] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.829944 28548 consensus_queue.cc:1048] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.838344 27670 raft_consensus.cc:1275] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.840335 28548 consensus_queue.cc:1048] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.842705 27748 raft_consensus.cc:1275] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer aee9fc0a34154b1d81b6ad3393c17b67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.844024 28605 consensus_queue.cc:1048] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.849920 27747 raft_consensus.cc:1275] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer aee9fc0a34154b1d81b6ad3393c17b67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.851532 28605 consensus_queue.cc:1048] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.862900 27670 raft_consensus.cc:1275] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer aee9fc0a34154b1d81b6ad3393c17b67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.864331 28594 consensus_queue.cc:1048] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.878647 27747 raft_consensus.cc:1275] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.882315 27673 raft_consensus.cc:1275] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Refusing update from remote peer aee9fc0a34154b1d81b6ad3393c17b67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.885411 28545 consensus_queue.cc:1048] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.891533 28594 consensus_queue.cc:1048] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.093180 27748 raft_consensus.cc:1275] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Refusing update from remote peer aee9fc0a34154b1d81b6ad3393c17b67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:07.094317 28624 consensus_queue.cc:1048] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:07.105293 28379 raft_consensus.cc:1275] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Refusing update from remote peer aee9fc0a34154b1d81b6ad3393c17b67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:07.106554 28624 consensus_queue.cc:1048] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:07.106977 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:07.160817 27747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bba2f26eea142268f411f8f91197880"
dest_uuid: "be117ea016214236abda478b04f7f70c"
mode: GRACEFUL
new_leader_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:53368
I20260709 12:20:07.161298 27747 raft_consensus.cc:606] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Received request to transfer leadership to TS de15618bc48545b6986320ca2292fc60
I20260709 12:20:07.162331 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:20:07.163870 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:07.164482 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:07.380393 28599 raft_consensus.cc:993] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c: : Instructing follower de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:07.381748 28599 raft_consensus.cc:1081] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Signalling peer de15618bc48545b6986320ca2292fc60 to start an election
I20260709 12:20:07.384164 28379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bba2f26eea142268f411f8f91197880"
dest_uuid: "de15618bc48545b6986320ca2292fc60"
 from {username='slave'} at 127.0.0.1:34152
I20260709 12:20:07.385170 28379 raft_consensus.cc:493] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.385653 28379 raft_consensus.cc:3060] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.400295 28379 raft_consensus.cc:515] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:07.404291 27749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be117ea016214236abda478b04f7f70c"
I20260709 12:20:07.405087 27749 raft_consensus.cc:3055] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:07.405416 27749 raft_consensus.cc:740] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be117ea016214236abda478b04f7f70c, State: Running, Role: LEADER
I20260709 12:20:07.406482 27749 consensus_queue.cc:260] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:07.408209 28379 leader_election.cc:290] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 3 election: Requested vote from peers be117ea016214236abda478b04f7f70c (127.19.108.4:38323), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:20:07.408346 27749 raft_consensus.cc:3060] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.409162 27597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bba2f26eea142268f411f8f91197880" candidate_uuid: "de15618bc48545b6986320ca2292fc60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aee9fc0a34154b1d81b6ad3393c17b67"
I20260709 12:20:07.409972 27597 raft_consensus.cc:3060] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.424196 27749 raft_consensus.cc:2468] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 3.
I20260709 12:20:07.426054 27597 raft_consensus.cc:2468] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de15618bc48545b6986320ca2292fc60 in term 3.
I20260709 12:20:07.427829 28299 leader_election.cc:304] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60; no voters: 
I20260709 12:20:07.428810 28548 raft_consensus.cc:2804] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:07.433282 28548 raft_consensus.cc:697] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 3 LEADER]: Becoming Leader. State: Replica: de15618bc48545b6986320ca2292fc60, State: Running, Role: LEADER
I20260709 12:20:07.434578 28548 consensus_queue.cc:237] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:07.447104 27422 catalog_manager.cc:5697] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 reported cstate change: term changed from 2 to 3, leader changed from be117ea016214236abda478b04f7f70c (127.19.108.4) to de15618bc48545b6986320ca2292fc60 (127.19.108.1). New cstate: current_term: 3 leader_uuid: "de15618bc48545b6986320ca2292fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.855132 27597 raft_consensus.cc:1275] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:07.856107 28548 consensus_queue.cc:1048] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:07.867223 27747 raft_consensus.cc:1275] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Refusing update from remote peer de15618bc48545b6986320ca2292fc60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:07.869984 28546 consensus_queue.cc:1048] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.201011 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.240011 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:08.241364 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:08.242390 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.278788 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.323458 19888 tablet_server.cc:179] TabletServer@127.19.108.1:34993 shutting down...
W20260709 12:20:08.337122 27716 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 230 similar messages]
W20260709 12:20:08.344838 27716 consensus_peers.cc:597] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.367633 27642 consensus_peers.cc:597] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.368708 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:08.369846 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.371066 19888 raft_consensus.cc:2243] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.371622 19888 raft_consensus.cc:2272] T 314f0bf0cb9746fbac4d45766dcb3dcb P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.375221 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.376008 19888 raft_consensus.cc:2243] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.376461 19888 raft_consensus.cc:2272] T 7bcdc60f1f704ccbae94b68301d5d7c7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.379315 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.380039 19888 raft_consensus.cc:2243] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.380923 19888 raft_consensus.cc:2272] T d280b2356d7f4990b289d4c328eb9e7e P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.383960 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.384721 19888 raft_consensus.cc:2243] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.385135 19888 raft_consensus.cc:2272] T 6f4c36c14e1343f2a56f2fd93787f29b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.387369 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.387979 19888 raft_consensus.cc:2243] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.388397 19888 raft_consensus.cc:2272] T 61af26ee6a29463f8084851d49c5597c P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.390689 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.391455 19888 raft_consensus.cc:2243] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.391980 19888 raft_consensus.cc:2272] T cab21d2c166f4303beb2fa0bbc3868cc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.394780 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.395370 19888 raft_consensus.cc:2243] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.395725 19888 raft_consensus.cc:2272] T 2db3cbf0efe649f592da4a1f3a3b331a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.397682 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.398248 19888 raft_consensus.cc:2243] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.398940 19888 raft_consensus.cc:2272] T 3bba2f26eea142268f411f8f91197880 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.401654 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.402483 19888 raft_consensus.cc:2243] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.402896 19888 raft_consensus.cc:2272] T 43107870acfc4582affbc438751f8144 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.404925 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.405476 19888 raft_consensus.cc:2243] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.405966 19888 raft_consensus.cc:2272] T 38f3f60349784a56b3225530bd5d5b14 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.408869 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.409583 19888 raft_consensus.cc:2243] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.410040 19888 raft_consensus.cc:2272] T 304ee4c1b5cd4dcf992f38355c86bb62 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.410220 27568 consensus_peers.cc:597] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.412367 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.412949 19888 raft_consensus.cc:2243] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.413957 19888 raft_consensus.cc:2272] T 6c35d6286faf45d4af1a9dfcd42a2819 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.416661 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.417420 19888 raft_consensus.cc:2243] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.417783 19888 raft_consensus.cc:2272] T 41b03c9e97db4f44883288bc9389dfe6 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.420693 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.421307 19888 raft_consensus.cc:2243] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.421741 19888 raft_consensus.cc:2272] T 2259e0eb900541c7b9d47a4406bce163 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.422878 27568 consensus_peers.cc:597] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.424173 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.424772 19888 raft_consensus.cc:2243] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.425201 19888 raft_consensus.cc:2272] T 8153e71c9ead48ec81fc9271d7844e53 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.427948 19888 tablet_replica.cc:333] stopping tablet replica
W20260709 12:20:08.428543 27642 consensus_peers.cc:597] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.428659 19888 raft_consensus.cc:2243] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.429281 19888 raft_consensus.cc:2272] T 648ac5bd1d184f85b76916c8695098f0 P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.432194 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.432890 19888 raft_consensus.cc:2243] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.433421 19888 raft_consensus.cc:2272] T adb38284310a4a308dbb1da8b4325596 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.436362 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.436949 19888 raft_consensus.cc:2243] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:08.437069 27568 consensus_peers.cc:597] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.437348 19888 raft_consensus.cc:2272] T bae19825ecd9430ebb84254135a9b43d P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.439811 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.440425 19888 raft_consensus.cc:2243] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.440855 19888 raft_consensus.cc:2272] T 91a5aef7a6d84eb79c2a50447c018732 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.443028 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.443534 19888 raft_consensus.cc:2243] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.444269 19888 raft_consensus.cc:2272] T 24fc70997e4048979966612dc07d9a47 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.446164 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.446776 19888 raft_consensus.cc:2243] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.447650 19888 raft_consensus.cc:2272] T 5a629b1a82d14248a102eec847a92754 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.449867 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.450398 19888 raft_consensus.cc:2243] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.451188 19888 raft_consensus.cc:2272] T 69fe214d9a2046e5ad2f9c677aef5b61 P de15618bc48545b6986320ca2292fc60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.453261 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.453778 19888 raft_consensus.cc:2243] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.454135 19888 raft_consensus.cc:2272] T ecf3cff3a1874453ab1973cc35091fa0 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.455971 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.456694 19888 raft_consensus.cc:2243] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.457696 19888 raft_consensus.cc:2272] T ced5637a8c774be3bf649a62de77ab2c P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.460294 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.460862 19888 raft_consensus.cc:2243] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.461880 19888 raft_consensus.cc:2272] T 0ad5954225334151b3f3a9827fc27342 P de15618bc48545b6986320ca2292fc60 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.463908 27642 consensus_peers.cc:597] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.464792 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.465381 19888 raft_consensus.cc:2243] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.465795 19888 raft_consensus.cc:2272] T d53924e99bd64e01be6cf5fbd86a0abc P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.467754 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.468289 19888 raft_consensus.cc:2243] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.468732 19888 raft_consensus.cc:2272] T 6af49c4f1e7b4c12a9985f530fc9603b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.471333 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.472139 19888 raft_consensus.cc:2243] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.472658 19888 raft_consensus.cc:2272] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.474758 27642 consensus_peers.cc:597] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.475252 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.475816 19888 raft_consensus.cc:2243] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.476547 19888 raft_consensus.cc:2272] T f041e7df1d5b483ca8adc01300cbf2ab P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.479300 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.480090 19888 raft_consensus.cc:2243] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.480578 19888 raft_consensus.cc:2272] T 72f87bb1f2fd40e1b066d978660bf0fe P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.483177 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.483732 19888 raft_consensus.cc:2243] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.484608 19888 raft_consensus.cc:2272] T 1bb3a4caa6e144feae981f2540571cf2 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.486649 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.487241 19888 raft_consensus.cc:2243] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.487785 19888 raft_consensus.cc:2272] T 0103e954b4ec472a9b561d0a4a1cbb10 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.490335 19888 tablet_replica.cc:333] stopping tablet replica
W20260709 12:20:08.490588 27568 consensus_peers.cc:597] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.491109 19888 raft_consensus.cc:2243] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.491533 19888 raft_consensus.cc:2272] T 438693ab12264201bb1a9cf7690d128a P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.493810 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.494289 19888 raft_consensus.cc:2243] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.495015 19888 raft_consensus.cc:2272] T 22da56e5d8d04a7a82f4d2cc8eacf27a P de15618bc48545b6986320ca2292fc60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.497100 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.497663 19888 raft_consensus.cc:2243] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.498049 19888 raft_consensus.cc:2272] T fecbf499aff740c39b815de4701ab51b P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.500216 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.500680 19888 raft_consensus.cc:2243] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.501032 19888 raft_consensus.cc:2272] T 58ccaa3a32e64320ac39060852b877fc P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.503196 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.503682 19888 raft_consensus.cc:2243] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.504070 19888 raft_consensus.cc:2272] T b167e6443cee4e879c2294bb44197833 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.505944 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.506431 19888 raft_consensus.cc:2243] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.506798 19888 raft_consensus.cc:2272] T 8af215ddc5284c54a2e361b75ce7b45e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.508811 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.509301 19888 raft_consensus.cc:2243] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.510032 19888 raft_consensus.cc:2272] T fd2c5c04c10e47208177d477008b8d8f P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.512040 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.512516 19888 raft_consensus.cc:2243] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.512857 19888 raft_consensus.cc:2272] T e9cb727b47e94021b993343a72045259 P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.514609 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.515117 19888 raft_consensus.cc:2243] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.515898 19888 raft_consensus.cc:2272] T fec8141371c04e69b06fc2f3b1fffef9 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.517851 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.518381 19888 raft_consensus.cc:2243] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.519328 19888 raft_consensus.cc:2272] T f9660477954949d78372b3e23fb42b46 P de15618bc48545b6986320ca2292fc60 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.521571 27568 consensus_peers.cc:597] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.522274 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.522957 19888 raft_consensus.cc:2243] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:08.523316 27716 consensus_peers.cc:597] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.523434 19888 raft_consensus.cc:2272] T abcf1b0ba28942d0928c3c0e5bf3c95c P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.525487 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.525957 19888 raft_consensus.cc:2243] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.526314 19888 raft_consensus.cc:2272] T 62b31e2427a143d2be9c66d5831fb40e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.528304 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:08.528793 19888 raft_consensus.cc:2243] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.529249 19888 raft_consensus.cc:2272] T 3edaed12566a4bdf9cbff46d06ef8f1e P de15618bc48545b6986320ca2292fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.536334 27716 consensus_peers.cc:597] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.541654 27568 consensus_peers.cc:597] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.542193 27642 consensus_peers.cc:597] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.563464 27568 consensus_peers.cc:597] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.563977 27716 consensus_peers.cc:597] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.601827 27568 consensus_peers.cc:597] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.602283 27568 consensus_peers.cc:597] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.608989 27716 consensus_peers.cc:597] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.610176 19888 tablet_server.cc:196] TabletServer@127.19.108.1:34993 shutdown complete.
W20260709 12:20:08.615008 27642 consensus_peers.cc:597] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.626219 27642 consensus_peers.cc:597] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.636416 27716 consensus_peers.cc:597] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.677062 27642 consensus_peers.cc:597] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.688378 19888 tablet_server.cc:179] TabletServer@127.19.108.2:0 shutting down...
W20260709 12:20:08.694442 27642 consensus_peers.cc:597] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.694743 27641 consensus_peers.cc:597] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.712478 27716 consensus_peers.cc:597] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.734916 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:08.736025 19888 tablet_replica.cc:333] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.737017 19888 raft_consensus.cc:2243] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.737684 19888 raft_consensus.cc:2272] T 8af215ddc5284c54a2e361b75ce7b45e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.740705 19888 tablet_replica.cc:333] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.741732 19888 raft_consensus.cc:2243] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.742334 19888 raft_consensus.cc:2272] T e9cb727b47e94021b993343a72045259 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.743753 27642 consensus_peers.cc:597] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.745035 19888 tablet_replica.cc:333] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.745642 19888 raft_consensus.cc:2243] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.746031 19888 raft_consensus.cc:2272] T ecf3cff3a1874453ab1973cc35091fa0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.748117 19888 tablet_replica.cc:333] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.748672 19888 raft_consensus.cc:2243] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.749017 19888 raft_consensus.cc:2272] T fcf91225062d4c728d8ff49b308ebf18 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.751021 19888 tablet_replica.cc:333] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.751801 19888 raft_consensus.cc:2243] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.752297 19888 raft_consensus.cc:2272] T 69fe214d9a2046e5ad2f9c677aef5b61 P aee9fc0a34154b1d81b6ad3393c17b67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.754570 19888 tablet_replica.cc:333] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.755208 19888 raft_consensus.cc:2243] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.755769 19888 raft_consensus.cc:2272] T 58f8b7dcacaf41f18a7974c565deffd4 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.758208 27641 consensus_peers.cc:597] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.758726 19888 tablet_replica.cc:333] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.759618 19888 raft_consensus.cc:2243] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:08.759876 27642 consensus_peers.cc:597] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.760185 19888 raft_consensus.cc:2272] T e7a8e7d5f765421391635cebebac4add P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.762888 27715 consensus_peers.cc:597] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.763171 19888 tablet_replica.cc:333] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.764123 19888 raft_consensus.cc:2243] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.764670 19888 raft_consensus.cc:2272] T 438693ab12264201bb1a9cf7690d128a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.767484 19888 tablet_replica.cc:333] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
W20260709 12:20:08.767762 27642 consensus_peers.cc:597] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.768160 27642 consensus_peers.cc:597] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.768324 19888 raft_consensus.cc:2243] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:08.768570 27642 consensus_peers.cc:597] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.768951 19888 raft_consensus.cc:2272] T 72f87bb1f2fd40e1b066d978660bf0fe P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.769214 27716 consensus_peers.cc:597] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c -> Peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Couldn't send request to peer de15618bc48545b6986320ca2292fc60. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.771178 19888 tablet_replica.cc:333] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.771749 19888 raft_consensus.cc:2243] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.772125 19888 raft_consensus.cc:2272] T 61af26ee6a29463f8084851d49c5597c P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.773945 19888 tablet_replica.cc:333] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.774439 19888 raft_consensus.cc:2243] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.775198 19888 raft_consensus.cc:2272] T b167e6443cee4e879c2294bb44197833 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.777081 19888 tablet_replica.cc:333] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.777626 19888 raft_consensus.cc:2243] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.778290 19888 raft_consensus.cc:2272] T 67e42f9eb1474d79a877272e9d1566ca P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.780066 19888 tablet_replica.cc:333] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.780599 19888 raft_consensus.cc:2243] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.781005 19888 raft_consensus.cc:2272] T 76a307ee39574103a5e8d0dbbc4311a9 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.782783 19888 tablet_replica.cc:333] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.783331 19888 raft_consensus.cc:2243] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.783736 19888 raft_consensus.cc:2272] T f9660477954949d78372b3e23fb42b46 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.785533 19888 tablet_replica.cc:333] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.786011 19888 raft_consensus.cc:2243] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.786378 19888 raft_consensus.cc:2272] T 4d9dad5b0ab6435aaf307e6816020451 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.788910 19888 tablet_replica.cc:333] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.789710 19888 raft_consensus.cc:2243] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:20:08.790207 27641 consensus_peers.cc:597] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.790788 19888 raft_consensus.cc:2272] T adb38284310a4a308dbb1da8b4325596 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.792953 19888 tablet_replica.cc:333] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.793483 19888 raft_consensus.cc:2243] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.794237 19888 raft_consensus.cc:2272] T 3e24b3506bb747b18e327830848ab3fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.796169 19888 tablet_replica.cc:333] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.796679 19888 raft_consensus.cc:2243] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.797475 19888 raft_consensus.cc:2272] T bae19825ecd9430ebb84254135a9b43d P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.799542 19888 tablet_replica.cc:333] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.800050 19888 raft_consensus.cc:2243] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.800767 19888 raft_consensus.cc:2272] T 1fc249d99a354b2ba8dfb84856dbbb01 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.802657 19888 tablet_replica.cc:333] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.803177 19888 raft_consensus.cc:2243] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.803567 19888 raft_consensus.cc:2272] T 27eb2f13d7e642e9b623762ab04241c0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.805716 19888 tablet_replica.cc:333] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.806362 19888 raft_consensus.cc:2243] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.806872 19888 raft_consensus.cc:2272] T 62b31e2427a143d2be9c66d5831fb40e P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.807497 27715 consensus_peers.cc:597] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.808998 19888 tablet_replica.cc:333] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.809545 19888 raft_consensus.cc:2243] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.809918 19888 raft_consensus.cc:2272] T d280b2356d7f4990b289d4c328eb9e7e P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.811758 19888 tablet_replica.cc:333] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.812368 19888 raft_consensus.cc:2243] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.812844 19888 raft_consensus.cc:2272] T 8567b5a62d02414f90f1c2141914a76b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.814862 19888 tablet_replica.cc:333] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.815397 19888 raft_consensus.cc:2243] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.815785 19888 raft_consensus.cc:2272] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.817934 19888 tablet_replica.cc:333] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.818409 19888 raft_consensus.cc:2243] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.818892 19888 raft_consensus.cc:2272] T 6f4c36c14e1343f2a56f2fd93787f29b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.821163 19888 tablet_replica.cc:333] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.821779 19888 raft_consensus.cc:2243] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:08.821967 27641 consensus_peers.cc:597] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.822192 19888 raft_consensus.cc:2272] T 25217e2e64ee4c46a3c6fe52f264eb73 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.824324 19888 tablet_replica.cc:333] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.824857 19888 raft_consensus.cc:2243] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.825577 19888 raft_consensus.cc:2272] T 2b28984fc9c44e9fb4b3df581a269923 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.827382 19888 tablet_replica.cc:333] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.827876 19888 raft_consensus.cc:2243] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.828586 19888 raft_consensus.cc:2272] T 72e820d15af94d0d8c63cd76f44ee8ec P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.830343 19888 tablet_replica.cc:333] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.830837 19888 raft_consensus.cc:2243] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.831585 19888 raft_consensus.cc:2272] T 648ac5bd1d184f85b76916c8695098f0 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.833379 19888 tablet_replica.cc:333] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.833859 19888 raft_consensus.cc:2243] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.834545 19888 raft_consensus.cc:2272] T 2259e0eb900541c7b9d47a4406bce163 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.836489 19888 tablet_replica.cc:333] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.837002 19888 raft_consensus.cc:2243] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.837811 19888 raft_consensus.cc:2272] T 8153e71c9ead48ec81fc9271d7844e53 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.840340 19888 tablet_replica.cc:333] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
W20260709 12:20:08.840400 27715 consensus_peers.cc:597] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.840886 19888 raft_consensus.cc:2243] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.841451 19888 raft_consensus.cc:2272] T 22da56e5d8d04a7a82f4d2cc8eacf27a P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.843111 27715 consensus_peers.cc:597] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.843457 19888 tablet_replica.cc:333] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.844008 19888 raft_consensus.cc:2243] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.844408 19888 raft_consensus.cc:2272] T fecbf499aff740c39b815de4701ab51b P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.846315 19888 tablet_replica.cc:333] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.846835 19888 raft_consensus.cc:2243] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.847349 19888 raft_consensus.cc:2272] T 58ccaa3a32e64320ac39060852b877fc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.849853 19888 tablet_replica.cc:333] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.850569 19888 raft_consensus.cc:2243] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.851097 19888 raft_consensus.cc:2272] T 38f3f60349784a56b3225530bd5d5b14 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.853747 19888 tablet_replica.cc:333] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.854470 19888 raft_consensus.cc:2243] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.855034 19888 raft_consensus.cc:2272] T 304ee4c1b5cd4dcf992f38355c86bb62 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.857693 19888 tablet_replica.cc:333] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.858335 19888 raft_consensus.cc:2243] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.858831 19888 raft_consensus.cc:2272] T d53924e99bd64e01be6cf5fbd86a0abc P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.861198 19888 tablet_replica.cc:333] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.861656 19888 raft_consensus.cc:2243] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.862352 19888 raft_consensus.cc:2272] T 314f0bf0cb9746fbac4d45766dcb3dcb P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.864146 19888 tablet_replica.cc:333] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.864573 19888 raft_consensus.cc:2243] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.864923 19888 raft_consensus.cc:2272] T 2db3cbf0efe649f592da4a1f3a3b331a P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.866518 19888 tablet_replica.cc:333] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.866971 19888 raft_consensus.cc:2243] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.867688 19888 raft_consensus.cc:2272] T cab21d2c166f4303beb2fa0bbc3868cc P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.871524 19888 tablet_replica.cc:333] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.872210 19888 raft_consensus.cc:2243] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.873193 19888 raft_consensus.cc:2272] T 7bcdc60f1f704ccbae94b68301d5d7c7 P aee9fc0a34154b1d81b6ad3393c17b67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.876050 19888 tablet_replica.cc:333] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.876616 19888 raft_consensus.cc:2243] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:08.877477 19888 raft_consensus.cc:2272] T 459c85488af34f9ca4d2f9dfc4946c38 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.878415 27715 consensus_peers.cc:597] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.879815 19888 tablet_replica.cc:333] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.880434 19888 raft_consensus.cc:2243] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.880786 19888 raft_consensus.cc:2272] T 43107870acfc4582affbc438751f8144 P aee9fc0a34154b1d81b6ad3393c17b67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:08.882593 19888 tablet_replica.cc:333] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67: stopping tablet replica
I20260709 12:20:08.883045 19888 raft_consensus.cc:2243] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:08.883421 19888 raft_consensus.cc:2272] T 3bba2f26eea142268f411f8f91197880 P aee9fc0a34154b1d81b6ad3393c17b67 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:08.890237 27715 consensus_peers.cc:597] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.906567 27641 consensus_peers.cc:597] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.907258 27715 consensus_peers.cc:597] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.934715 27715 consensus_peers.cc:597] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:08.937490 27715 consensus_peers.cc:597] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:08.988794 19888 tablet_server.cc:196] TabletServer@127.19.108.2:0 shutdown complete.
W20260709 12:20:08.989326 27715 consensus_peers.cc:597] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:09.034356 27715 consensus_peers.cc:597] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:09.036245 27641 consensus_peers.cc:597] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:09.046039 27641 consensus_peers.cc:597] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:09.046319 27715 consensus_peers.cc:597] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:09.083024 27641 consensus_peers.cc:597] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.084131 19888 tablet_server.cc:179] TabletServer@127.19.108.3:0 shutting down...
W20260709 12:20:09.110791 27641 consensus_peers.cc:597] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:09.120784 27641 consensus_peers.cc:597] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.133952 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:09.134750 19888 tablet_replica.cc:333] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.135427 19888 raft_consensus.cc:2243] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.136260 19888 raft_consensus.cc:2272] T abcf1b0ba28942d0928c3c0e5bf3c95c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.138240 19888 tablet_replica.cc:333] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.138818 19888 raft_consensus.cc:2243] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.139672 19888 raft_consensus.cc:2272] T 2db3cbf0efe649f592da4a1f3a3b331a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.141855 19888 tablet_replica.cc:333] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.142544 19888 raft_consensus.cc:2243] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.143021 19888 raft_consensus.cc:2272] T 58f8b7dcacaf41f18a7974c565deffd4 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.145364 19888 tablet_replica.cc:333] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.145910 19888 raft_consensus.cc:2243] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.146294 19888 raft_consensus.cc:2272] T 22da56e5d8d04a7a82f4d2cc8eacf27a P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.148353 19888 tablet_replica.cc:333] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.149124 19888 raft_consensus.cc:2243] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.149674 19888 raft_consensus.cc:2272] T e7a8e7d5f765421391635cebebac4add P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.152287 19888 tablet_replica.cc:333] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.153043 19888 raft_consensus.cc:2243] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.153564 19888 raft_consensus.cc:2272] T 5a629b1a82d14248a102eec847a92754 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:09.153976 27641 consensus_peers.cc:597] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.156165 19888 tablet_replica.cc:333] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.156971 19888 raft_consensus.cc:2243] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.157457 19888 raft_consensus.cc:2272] T fec8141371c04e69b06fc2f3b1fffef9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.159327 19888 tablet_replica.cc:333] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.159909 19888 raft_consensus.cc:2243] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.160337 19888 raft_consensus.cc:2272] T 76a307ee39574103a5e8d0dbbc4311a9 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.162737 19888 tablet_replica.cc:333] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.163329 19888 raft_consensus.cc:2243] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.164108 19888 raft_consensus.cc:2272] T 61af26ee6a29463f8084851d49c5597c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.166004 19888 tablet_replica.cc:333] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.166528 19888 raft_consensus.cc:2243] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.166975 19888 raft_consensus.cc:2272] T 67e42f9eb1474d79a877272e9d1566ca P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.168892 19888 tablet_replica.cc:333] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.169550 19888 raft_consensus.cc:2243] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.169946 19888 raft_consensus.cc:2272] T b167e6443cee4e879c2294bb44197833 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.172001 19888 tablet_replica.cc:333] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.172519 19888 raft_consensus.cc:2243] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.173223 19888 raft_consensus.cc:2272] T e9cb727b47e94021b993343a72045259 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.175045 19888 tablet_replica.cc:333] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.175590 19888 raft_consensus.cc:2243] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.176237 19888 raft_consensus.cc:2272] T fd2c5c04c10e47208177d477008b8d8f P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.178417 19888 tablet_replica.cc:333] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.179201 19888 raft_consensus.cc:2243] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.179733 19888 raft_consensus.cc:2272] T 4d9dad5b0ab6435aaf307e6816020451 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:09.181885 27714 consensus_peers.cc:597] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c -> Peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Couldn't send request to peer 2e2faf2971ea4c7ab7f426935b9e6d96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.182132 19888 tablet_replica.cc:333] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.182987 19888 raft_consensus.cc:2243] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.183521 19888 raft_consensus.cc:2272] T 3e24b3506bb747b18e327830848ab3fc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.185743 19888 tablet_replica.cc:333] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.186288 19888 raft_consensus.cc:2243] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.187012 19888 raft_consensus.cc:2272] T 91a5aef7a6d84eb79c2a50447c018732 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.188759 19888 tablet_replica.cc:333] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.189239 19888 raft_consensus.cc:2243] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.189615 19888 raft_consensus.cc:2272] T 24fc70997e4048979966612dc07d9a47 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.191445 19888 tablet_replica.cc:333] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.191958 19888 raft_consensus.cc:2243] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.192675 19888 raft_consensus.cc:2272] T 6f4c36c14e1343f2a56f2fd93787f29b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.194589 19888 tablet_replica.cc:333] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.195115 19888 raft_consensus.cc:2243] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.195822 19888 raft_consensus.cc:2272] T 25217e2e64ee4c46a3c6fe52f264eb73 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.197647 19888 tablet_replica.cc:333] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.198089 19888 raft_consensus.cc:2243] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.198421 19888 raft_consensus.cc:2272] T 2b28984fc9c44e9fb4b3df581a269923 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.200196 19888 tablet_replica.cc:333] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.200670 19888 raft_consensus.cc:2243] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.201025 19888 raft_consensus.cc:2272] T 6c35d6286faf45d4af1a9dfcd42a2819 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.202746 19888 tablet_replica.cc:333] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.203235 19888 raft_consensus.cc:2243] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.203588 19888 raft_consensus.cc:2272] T 72e820d15af94d0d8c63cd76f44ee8ec P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.205329 19888 tablet_replica.cc:333] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.205775 19888 raft_consensus.cc:2243] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.206120 19888 raft_consensus.cc:2272] T 6af49c4f1e7b4c12a9985f530fc9603b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.207975 19888 tablet_replica.cc:333] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.208456 19888 raft_consensus.cc:2243] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.209192 19888 raft_consensus.cc:2272] T d53924e99bd64e01be6cf5fbd86a0abc P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.210884 19888 tablet_replica.cc:333] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.211426 19888 raft_consensus.cc:2243] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.211812 19888 raft_consensus.cc:2272] T 0ad5954225334151b3f3a9827fc27342 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.213479 19888 tablet_replica.cc:333] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.213966 19888 raft_consensus.cc:2243] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.214335 19888 raft_consensus.cc:2272] T adb38284310a4a308dbb1da8b4325596 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.216068 19888 tablet_replica.cc:333] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.216571 19888 raft_consensus.cc:2243] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.216969 19888 raft_consensus.cc:2272] T 27eb2f13d7e642e9b623762ab04241c0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.219444 19888 tablet_replica.cc:333] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.220213 19888 raft_consensus.cc:2243] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.221233 19888 raft_consensus.cc:2272] T 62b31e2427a143d2be9c66d5831fb40e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:09.221451 27715 consensus_peers.cc:597] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c -> Peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Couldn't send request to peer aee9fc0a34154b1d81b6ad3393c17b67. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.223531 19888 tablet_replica.cc:333] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.224099 19888 raft_consensus.cc:2243] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.224483 19888 raft_consensus.cc:2272] T 8567b5a62d02414f90f1c2141914a76b P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.226219 19888 tablet_replica.cc:333] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.226702 19888 raft_consensus.cc:2243] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.227106 19888 raft_consensus.cc:2272] T 1fc249d99a354b2ba8dfb84856dbbb01 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.229293 19888 tablet_replica.cc:333] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.229887 19888 raft_consensus.cc:2243] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.230322 19888 raft_consensus.cc:2272] T 41b03c9e97db4f44883288bc9389dfe6 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:09.230635 27714 consensus_peers.cc:597] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c -> Peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Couldn't send request to peer 2e2faf2971ea4c7ab7f426935b9e6d96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.232241 19888 tablet_replica.cc:333] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.232806 19888 raft_consensus.cc:2243] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.233176 19888 raft_consensus.cc:2272] T 2259e0eb900541c7b9d47a4406bce163 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.235026 19888 tablet_replica.cc:333] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.235486 19888 raft_consensus.cc:2243] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.236162 19888 raft_consensus.cc:2272] T 38f3f60349784a56b3225530bd5d5b14 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.237883 19888 tablet_replica.cc:333] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.238333 19888 raft_consensus.cc:2243] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.239184 19888 raft_consensus.cc:2272] T 304ee4c1b5cd4dcf992f38355c86bb62 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.241595 19888 tablet_replica.cc:333] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.242133 19888 raft_consensus.cc:2243] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.243137 19888 raft_consensus.cc:2272] T 3edaed12566a4bdf9cbff46d06ef8f1e P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.245162 19888 tablet_replica.cc:333] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.245746 19888 raft_consensus.cc:2243] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.246448 19888 raft_consensus.cc:2272] T ecf3cff3a1874453ab1973cc35091fa0 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.248322 19888 tablet_replica.cc:333] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.248788 19888 raft_consensus.cc:2243] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.249164 19888 raft_consensus.cc:2272] T fcf91225062d4c728d8ff49b308ebf18 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.250912 19888 tablet_replica.cc:333] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.251363 19888 raft_consensus.cc:2243] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.251744 19888 raft_consensus.cc:2272] T ced5637a8c774be3bf649a62de77ab2c P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.253476 19888 tablet_replica.cc:333] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.253932 19888 raft_consensus.cc:2243] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.254305 19888 raft_consensus.cc:2272] T f041e7df1d5b483ca8adc01300cbf2ab P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.256254 19888 tablet_replica.cc:333] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.256721 19888 raft_consensus.cc:2243] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.257443 19888 raft_consensus.cc:2272] T b3a11bd7b16c4cf7bbfcecc5fa6170e7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:09.258023 27714 consensus_peers.cc:597] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c -> Peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Couldn't send request to peer 2e2faf2971ea4c7ab7f426935b9e6d96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.259286 19888 tablet_replica.cc:333] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.259827 19888 raft_consensus.cc:2243] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.260196 19888 raft_consensus.cc:2272] T 7bcdc60f1f704ccbae94b68301d5d7c7 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.262020 19888 tablet_replica.cc:333] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.262513 19888 raft_consensus.cc:2243] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.262910 19888 raft_consensus.cc:2272] T 459c85488af34f9ca4d2f9dfc4946c38 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.264744 19888 tablet_replica.cc:333] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.265164 19888 raft_consensus.cc:2243] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.265503 19888 raft_consensus.cc:2272] T 1bb3a4caa6e144feae981f2540571cf2 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.267263 19888 tablet_replica.cc:333] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96: stopping tablet replica
I20260709 12:20:09.267709 19888 raft_consensus.cc:2243] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.268368 19888 raft_consensus.cc:2272] T 0103e954b4ec472a9b561d0a4a1cbb10 P 2e2faf2971ea4c7ab7f426935b9e6d96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:09.316869 27640 connection.cc:466] server connection from 127.0.0.1:35576 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35576 (request call id 682) could send its response
W20260709 12:20:09.320883 27714 consensus_peers.cc:597] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c -> Peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Couldn't send request to peer 2e2faf2971ea4c7ab7f426935b9e6d96. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.3:45493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.333900 19888 tablet_server.cc:196] TabletServer@127.19.108.3:0 shutdown complete.
I20260709 12:20:09.371500 28648 raft_consensus.cc:493] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:20:09.372238 28648 raft_consensus.cc:515] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:09.375012 28648 leader_election.cc:290] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
W20260709 12:20:09.385517 27714 leader_election.cc:336] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Network error: Client connection negotiation failed: client connection to 127.19.108.3:45493: connect: Connection refused (error 111)
W20260709 12:20:09.394218 27716 leader_election.cc:336] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:20:09.394778 27716 leader_election.cc:304] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:20:09.395696 28539 raft_consensus.cc:2749] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:09.418547 28645 raft_consensus.cc:493] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:20:09.419174 28645 raft_consensus.cc:515] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } } peers { permanent_uuid: "aee9fc0a34154b1d81b6ad3393c17b67" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 38235 } }
I20260709 12:20:09.422564 28648 raft_consensus.cc:493] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:20:09.423156 28648 raft_consensus.cc:515] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:09.422943 28645 leader_election.cc:290] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993), aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235)
I20260709 12:20:09.425297 28648 leader_election.cc:290] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:20:09.426919 19888 tablet_server.cc:179] TabletServer@127.19.108.4:0 shutting down...
W20260709 12:20:09.433089 27715 leader_election.cc:336] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aee9fc0a34154b1d81b6ad3393c17b67 (127.19.108.2:38235): Network error: Client connection negotiation failed: client connection to 127.19.108.2:38235: connect: Connection refused (error 111)
W20260709 12:20:09.436336 27716 leader_election.cc:336] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:20:09.440346 27716 leader_election.cc:304] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: aee9fc0a34154b1d81b6ad3393c17b67, de15618bc48545b6986320ca2292fc60
I20260709 12:20:09.441440 28648 raft_consensus.cc:2749] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:09.445391 27714 leader_election.cc:336] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Network error: Client connection negotiation failed: client connection to 127.19.108.3:45493: connect: Connection refused (error 111)
W20260709 12:20:09.447752 27716 leader_election.cc:336] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
W20260709 12:20:09.445966 27714 consensus_peers.cc:597] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c -> Peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Couldn't send request to peer 2e2faf2971ea4c7ab7f426935b9e6d96. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.3:45493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.448268 27716 leader_election.cc:304] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:20:09.449038 28648 raft_consensus.cc:2749] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:09.457739 27714 consensus_peers.cc:597] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c -> Peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Couldn't send request to peer 2e2faf2971ea4c7ab7f426935b9e6d96. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.3:45493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:09.479573 28648 raft_consensus.cc:493] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:20:09.480175 28648 raft_consensus.cc:515] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:09.482029 28648 leader_election.cc:290] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
W20260709 12:20:09.486094 27714 leader_election.cc:336] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Network error: Client connection negotiation failed: client connection to 127.19.108.3:45493: connect: Connection refused (error 111)
W20260709 12:20:09.489795 27716 leader_election.cc:336] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:20:09.490173 27716 leader_election.cc:304] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:20:09.490687 28648 raft_consensus.cc:2749] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:09.502138 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:09.502790 19888 tablet_replica.cc:333] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.503473 19888 raft_consensus.cc:2243] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.503929 19888 raft_consensus.cc:2272] T abcf1b0ba28942d0928c3c0e5bf3c95c P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.505851 19888 tablet_replica.cc:333] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.506361 19888 raft_consensus.cc:2243] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.507112 19888 raft_consensus.cc:2272] T 8af215ddc5284c54a2e361b75ce7b45e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.508911 19888 tablet_replica.cc:333] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.509438 19888 raft_consensus.cc:2243] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.510098 19888 raft_consensus.cc:2272] T 58f8b7dcacaf41f18a7974c565deffd4 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.512001 19888 tablet_replica.cc:333] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.512501 19888 raft_consensus.cc:2243] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.512895 19888 raft_consensus.cc:2272] T 5a629b1a82d14248a102eec847a92754 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.514681 19888 tablet_replica.cc:333] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.515208 19888 raft_consensus.cc:2243] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.515875 19888 raft_consensus.cc:2272] T e7a8e7d5f765421391635cebebac4add P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.517599 19888 tablet_replica.cc:333] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.518196 19888 raft_consensus.cc:2243] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.518580 19888 raft_consensus.cc:2272] T 67e42f9eb1474d79a877272e9d1566ca P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.520287 19888 tablet_replica.cc:333] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.520818 19888 raft_consensus.cc:2243] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.521219 19888 raft_consensus.cc:2272] T fd2c5c04c10e47208177d477008b8d8f P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.522938 19888 tablet_replica.cc:333] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.523536 19888 raft_consensus.cc:2243] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.524246 19888 raft_consensus.cc:2272] T 4d9dad5b0ab6435aaf307e6816020451 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.525911 19888 tablet_replica.cc:333] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.526417 19888 raft_consensus.cc:2243] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.526789 19888 raft_consensus.cc:2272] T fec8141371c04e69b06fc2f3b1fffef9 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.528496 19888 tablet_replica.cc:333] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.529074 19888 raft_consensus.cc:2243] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.529819 19888 raft_consensus.cc:2272] T 76a307ee39574103a5e8d0dbbc4311a9 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.532075 19888 tablet_replica.cc:333] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.532577 19888 raft_consensus.cc:2243] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.533068 19888 raft_consensus.cc:2272] T f9660477954949d78372b3e23fb42b46 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.535418 19888 tablet_replica.cc:333] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.536070 19888 raft_consensus.cc:2243] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.536512 19888 raft_consensus.cc:2272] T 91a5aef7a6d84eb79c2a50447c018732 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.538220 19888 tablet_replica.cc:333] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.538705 19888 raft_consensus.cc:2243] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.539113 19888 raft_consensus.cc:2272] T 3e24b3506bb747b18e327830848ab3fc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.540772 19888 tablet_replica.cc:333] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.541249 19888 raft_consensus.cc:2243] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.541597 19888 raft_consensus.cc:2272] T bae19825ecd9430ebb84254135a9b43d P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.543272 19888 tablet_replica.cc:333] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.543751 19888 raft_consensus.cc:2243] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.544154 19888 raft_consensus.cc:2272] T 24fc70997e4048979966612dc07d9a47 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.545815 19888 tablet_replica.cc:333] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.546298 19888 raft_consensus.cc:2243] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.547057 19888 raft_consensus.cc:2272] T fecbf499aff740c39b815de4701ab51b P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.548765 19888 tablet_replica.cc:333] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.549276 19888 raft_consensus.cc:2243] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.549976 19888 raft_consensus.cc:2272] T 58ccaa3a32e64320ac39060852b877fc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.551683 19888 tablet_replica.cc:333] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.552181 19888 raft_consensus.cc:2243] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.552855 19888 raft_consensus.cc:2272] T 6af49c4f1e7b4c12a9985f530fc9603b P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.554535 19888 tablet_replica.cc:333] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.555069 19888 raft_consensus.cc:2243] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.555459 19888 raft_consensus.cc:2272] T 0ad5954225334151b3f3a9827fc27342 P be117ea016214236abda478b04f7f70c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.557154 19888 tablet_replica.cc:333] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.557621 19888 raft_consensus.cc:2243] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.557971 19888 raft_consensus.cc:2272] T 1fc249d99a354b2ba8dfb84856dbbb01 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.559672 19888 tablet_replica.cc:333] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.560169 19888 raft_consensus.cc:2243] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.560537 19888 raft_consensus.cc:2272] T d280b2356d7f4990b289d4c328eb9e7e P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.562770 19888 tablet_replica.cc:333] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.563460 19888 raft_consensus.cc:2243] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.564352 19888 raft_consensus.cc:2272] T 8567b5a62d02414f90f1c2141914a76b P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.565049 28648 raft_consensus.cc:493] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de15618bc48545b6986320ca2292fc60)
I20260709 12:20:09.565408 28648 raft_consensus.cc:515] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e2faf2971ea4c7ab7f426935b9e6d96" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45493 } } peers { permanent_uuid: "be117ea016214236abda478b04f7f70c" member_type: VOTER last_known_addr { host: "127.19.108.4" port: 38323 } } peers { permanent_uuid: "de15618bc48545b6986320ca2292fc60" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 34993 } }
I20260709 12:20:09.566318 19888 tablet_replica.cc:333] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.566987 28648 leader_election.cc:290] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493), de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993)
I20260709 12:20:09.567076 19888 raft_consensus.cc:2243] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.567775 19888 raft_consensus.cc:2272] T 72e820d15af94d0d8c63cd76f44ee8ec P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.569854 19888 tablet_replica.cc:333] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.570538 19888 raft_consensus.cc:2243] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:09.570802 27716 leader_election.cc:336] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de15618bc48545b6986320ca2292fc60 (127.19.108.1:34993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:34993: connect: Connection refused (error 111)
I20260709 12:20:09.571007 19888 raft_consensus.cc:2272] T 6c35d6286faf45d4af1a9dfcd42a2819 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:09.571313 27714 leader_election.cc:336] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2e2faf2971ea4c7ab7f426935b9e6d96 (127.19.108.3:45493): Network error: Client connection negotiation failed: client connection to 127.19.108.3:45493: connect: Connection refused (error 111)
I20260709 12:20:09.571712 27714 leader_election.cc:304] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be117ea016214236abda478b04f7f70c; no voters: 2e2faf2971ea4c7ab7f426935b9e6d96, de15618bc48545b6986320ca2292fc60
I20260709 12:20:09.572350 28648 raft_consensus.cc:2749] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:09.573400 19888 tablet_replica.cc:333] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.573948 19888 raft_consensus.cc:2243] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.574338 19888 raft_consensus.cc:2272] T 25217e2e64ee4c46a3c6fe52f264eb73 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.576097 19888 tablet_replica.cc:333] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.576557 19888 raft_consensus.cc:2243] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.576989 19888 raft_consensus.cc:2272] T 2b28984fc9c44e9fb4b3df581a269923 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.578624 19888 tablet_replica.cc:333] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.579180 19888 raft_consensus.cc:2243] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.579555 19888 raft_consensus.cc:2272] T 648ac5bd1d184f85b76916c8695098f0 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.581383 19888 tablet_replica.cc:333] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.581951 19888 raft_consensus.cc:2243] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.582664 19888 raft_consensus.cc:2272] T 41b03c9e97db4f44883288bc9389dfe6 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.584504 19888 tablet_replica.cc:333] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.584991 19888 raft_consensus.cc:2243] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.585361 19888 raft_consensus.cc:2272] T 8153e71c9ead48ec81fc9271d7844e53 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.587045 19888 tablet_replica.cc:333] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.587512 19888 raft_consensus.cc:2243] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.588229 19888 raft_consensus.cc:2272] T 27eb2f13d7e642e9b623762ab04241c0 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.589977 19888 tablet_replica.cc:333] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.590477 19888 raft_consensus.cc:2243] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.590878 19888 raft_consensus.cc:2272] T cab21d2c166f4303beb2fa0bbc3868cc P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.592592 19888 tablet_replica.cc:333] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.593070 19888 raft_consensus.cc:2243] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.593441 19888 raft_consensus.cc:2272] T 314f0bf0cb9746fbac4d45766dcb3dcb P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.595223 19888 tablet_replica.cc:333] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.595700 19888 raft_consensus.cc:2243] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.596400 19888 raft_consensus.cc:2272] T 438693ab12264201bb1a9cf7690d128a P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.598143 19888 tablet_replica.cc:333] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.598599 19888 raft_consensus.cc:2243] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.599318 19888 raft_consensus.cc:2272] T 72f87bb1f2fd40e1b066d978660bf0fe P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.600994 19888 tablet_replica.cc:333] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.601460 19888 raft_consensus.cc:2243] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.601843 19888 raft_consensus.cc:2272] T 1bb3a4caa6e144feae981f2540571cf2 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.603530 19888 tablet_replica.cc:333] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.603994 19888 raft_consensus.cc:2243] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.604372 19888 raft_consensus.cc:2272] T 0103e954b4ec472a9b561d0a4a1cbb10 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.605945 19888 tablet_replica.cc:333] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.606406 19888 raft_consensus.cc:2243] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.606769 19888 raft_consensus.cc:2272] T f041e7df1d5b483ca8adc01300cbf2ab P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.608448 19888 tablet_replica.cc:333] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.608935 19888 raft_consensus.cc:2243] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.609606 19888 raft_consensus.cc:2272] T 43107870acfc4582affbc438751f8144 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.611238 19888 tablet_replica.cc:333] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.611680 19888 raft_consensus.cc:2243] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.612028 19888 raft_consensus.cc:2272] T 3bba2f26eea142268f411f8f91197880 P be117ea016214236abda478b04f7f70c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.613672 19888 tablet_replica.cc:333] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.614140 19888 raft_consensus.cc:2243] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.614512 19888 raft_consensus.cc:2272] T 459c85488af34f9ca4d2f9dfc4946c38 P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.616173 19888 tablet_replica.cc:333] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.616611 19888 raft_consensus.cc:2243] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.616983 19888 raft_consensus.cc:2272] T 3edaed12566a4bdf9cbff46d06ef8f1e P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.618693 19888 tablet_replica.cc:333] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.619154 19888 raft_consensus.cc:2243] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.619864 19888 raft_consensus.cc:2272] T fcf91225062d4c728d8ff49b308ebf18 P be117ea016214236abda478b04f7f70c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.621857 19888 tablet_replica.cc:333] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.622303 19888 raft_consensus.cc:2243] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.622686 19888 raft_consensus.cc:2272] T 69fe214d9a2046e5ad2f9c677aef5b61 P be117ea016214236abda478b04f7f70c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.624563 19888 tablet_replica.cc:333] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c: stopping tablet replica
I20260709 12:20:09.624984 19888 raft_consensus.cc:2243] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.625355 19888 raft_consensus.cc:2272] T ced5637a8c774be3bf649a62de77ab2c P be117ea016214236abda478b04f7f70c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.687469 19888 tablet_server.cc:196] TabletServer@127.19.108.4:0 shutdown complete.
I20260709 12:20:09.747217 19888 master.cc:562] Master@127.19.108.62:44381 shutting down...
I20260709 12:20:09.770236 19888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:09.770737 19888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.771070 19888 tablet_replica.cc:333] T 00000000000000000000000000000000 P 38da4d668a3a4017bdd3303e8d76fcf9: stopping tablet replica
I20260709 12:20:09.791534 19888 master.cc:584] Master@127.19.108.62:44381 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (30171 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:20:09.871203 19888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.108.62:35715
I20260709 12:20:09.872336 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:09.877568 28653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:09.878261 28654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:09.878925 19888 server_base.cc:1061] running on GCE node
W20260709 12:20:09.878950 28656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:09.880069 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:09.880244 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:09.880403 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599609880386 us; error 0 us; skew 500 ppm
I20260709 12:20:09.880916 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:09.883111 19888 webserver.cc:533] Webserver started at http://127.19.108.62:46553/ using document root <none> and password file <none>
I20260709 12:20:09.883580 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:09.883742 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:09.884011 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:09.885061 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/master-0-root/instance:
uuid: "b81e57cc76664a9092439787cf5115bd"
format_stamp: "Formatted at 2026-07-09 12:20:09 on dist-test-slave-0g1j"
I20260709 12:20:09.889582 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:20:09.892796 28661 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:09.893458 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:09.893707 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/master-0-root
uuid: "b81e57cc76664a9092439787cf5115bd"
format_stamp: "Formatted at 2026-07-09 12:20:09 on dist-test-slave-0g1j"
I20260709 12:20:09.893973 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:09.911044 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:09.912194 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:09.948232 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.62:35715
I20260709 12:20:09.948333 28712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.62:35715 every 8 connection(s)
I20260709 12:20:09.952116 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:09.962556 28713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd: Bootstrap starting.
I20260709 12:20:09.967258 28713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:09.971179 28713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd: No bootstrap required, opened a new log
I20260709 12:20:09.973182 28713 raft_consensus.cc:359] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81e57cc76664a9092439787cf5115bd" member_type: VOTER }
I20260709 12:20:09.973541 28713 raft_consensus.cc:385] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:09.973717 28713 raft_consensus.cc:740] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81e57cc76664a9092439787cf5115bd, State: Initialized, Role: FOLLOWER
I20260709 12:20:09.974218 28713 consensus_queue.cc:260] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81e57cc76664a9092439787cf5115bd" member_type: VOTER }
I20260709 12:20:09.974617 28713 raft_consensus.cc:399] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:09.974798 28713 raft_consensus.cc:493] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:09.975051 28713 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:09.979511 28713 raft_consensus.cc:515] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81e57cc76664a9092439787cf5115bd" member_type: VOTER }
I20260709 12:20:09.979941 28713 leader_election.cc:304] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b81e57cc76664a9092439787cf5115bd; no voters: 
I20260709 12:20:09.981014 28713 leader_election.cc:290] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:09.981305 28716 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:09.982590 28716 raft_consensus.cc:697] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 1 LEADER]: Becoming Leader. State: Replica: b81e57cc76664a9092439787cf5115bd, State: Running, Role: LEADER
I20260709 12:20:09.983177 28716 consensus_queue.cc:237] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81e57cc76664a9092439787cf5115bd" member_type: VOTER }
I20260709 12:20:09.983752 28713 sys_catalog.cc:565] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:09.987341 28717 sys_catalog.cc:455] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b81e57cc76664a9092439787cf5115bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81e57cc76664a9092439787cf5115bd" member_type: VOTER } }
I20260709 12:20:09.988065 28717 sys_catalog.cc:458] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:09.987895 28718 sys_catalog.cc:455] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b81e57cc76664a9092439787cf5115bd. Latest consensus state: current_term: 1 leader_uuid: "b81e57cc76664a9092439787cf5115bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81e57cc76664a9092439787cf5115bd" member_type: VOTER } }
I20260709 12:20:09.989008 28718 sys_catalog.cc:458] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:09.990715 28723 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:09.996812 28723 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:09.997795 19888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:10.005101 28723 catalog_manager.cc:1383] Generated new cluster ID: 161f2df2ddc0469ba6983cc45590214b
I20260709 12:20:10.005363 28723 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:10.033113 28723 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:10.034364 28723 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:10.051515 28723 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd: Generated new TSK 0
I20260709 12:20:10.052134 28723 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:10.064234 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:10.070015 28734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.070667 28735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.072271 28737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:10.072480 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:10.073400 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:10.073599 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:10.073748 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599610073731 us; error 0 us; skew 500 ppm
I20260709 12:20:10.074239 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:10.076395 19888 webserver.cc:533] Webserver started at http://127.19.108.1:37681/ using document root <none> and password file <none>
I20260709 12:20:10.076843 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:10.077034 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:10.077275 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:10.078346 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-0-root/instance:
uuid: "247b808a5ef746388461f2b917a6d9e5"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-0g1j"
I20260709 12:20:10.082464 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:10.085618 28742 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.086316 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:10.086575 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "247b808a5ef746388461f2b917a6d9e5"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-0g1j"
I20260709 12:20:10.086833 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:10.104776 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:10.105999 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:10.107455 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:10.109705 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:10.109898 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.110116 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:10.110280 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.150457 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:40993
I20260709 12:20:10.150621 28805 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:40993 every 8 connection(s)
I20260709 12:20:10.155385 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:10.162510 28810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.163903 28811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.165514 28813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:10.167284 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:10.168282 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:10.168473 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:10.168648 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599610168628 us; error 0 us; skew 500 ppm
I20260709 12:20:10.169323 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:10.171849 28806 heartbeater.cc:344] Connected to a master server at 127.19.108.62:35715
I20260709 12:20:10.171861 19888 webserver.cc:533] Webserver started at http://127.19.108.2:33577/ using document root <none> and password file <none>
I20260709 12:20:10.172263 28806 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:10.172511 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:10.172760 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:10.172955 28806 heartbeater.cc:507] Master 127.19.108.62:35715 requested a full tablet report, sending...
I20260709 12:20:10.172992 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:10.174482 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-1-root/instance:
uuid: "ed68bbc4749e4425b6d345f2223fafdd"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-0g1j"
I20260709 12:20:10.175038 28678 ts_manager.cc:194] Registered new tserver with Master: 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993)
I20260709 12:20:10.176731 28678 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45896
I20260709 12:20:10.179198 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:20:10.182358 28818 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.183051 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:20:10.183308 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-1-root
uuid: "ed68bbc4749e4425b6d345f2223fafdd"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-0g1j"
I20260709 12:20:10.183557 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:10.199812 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:10.200939 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:10.202346 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:10.204486 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:10.204674 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.204888 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:10.205044 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.244349 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.2:35923
I20260709 12:20:10.244452 28880 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.2:35923 every 8 connection(s)
I20260709 12:20:10.248785 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:10.255419 28884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.257686 28885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.260392 28887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:10.260962 28881 heartbeater.cc:344] Connected to a master server at 127.19.108.62:35715
I20260709 12:20:10.261013 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:10.261524 28881 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:10.262058 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:10.262296 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:10.262238 28881 heartbeater.cc:507] Master 127.19.108.62:35715 requested a full tablet report, sending...
I20260709 12:20:10.262645 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599610262622 us; error 0 us; skew 500 ppm
I20260709 12:20:10.263325 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:10.264608 28678 ts_manager.cc:194] Registered new tserver with Master: ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:10.265941 19888 webserver.cc:533] Webserver started at http://127.19.108.3:44483/ using document root <none> and password file <none>
I20260709 12:20:10.266455 28678 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45898
I20260709 12:20:10.266633 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:10.266942 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:10.267284 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:10.268762 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-2-root/instance:
uuid: "92e3eb6d98624bd29a116f4e92bec65e"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-0g1j"
I20260709 12:20:10.272985 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:10.276006 28892 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.276679 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:10.276949 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-2-root
uuid: "92e3eb6d98624bd29a116f4e92bec65e"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-0g1j"
I20260709 12:20:10.277231 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:10.297011 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:10.298166 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:10.299598 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:10.302263 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:10.302459 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.302695 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:10.302861 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.340531 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.3:45733
I20260709 12:20:10.340638 28954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.3:45733 every 8 connection(s)
I20260709 12:20:10.353503 28955 heartbeater.cc:344] Connected to a master server at 127.19.108.62:35715
I20260709 12:20:10.353899 28955 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:10.354607 28955 heartbeater.cc:507] Master 127.19.108.62:35715 requested a full tablet report, sending...
I20260709 12:20:10.356353 28678 ts_manager.cc:194] Registered new tserver with Master: 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:10.356827 19888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01319515s
I20260709 12:20:10.357673 28678 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45900
I20260709 12:20:10.380139 28678 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45916:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:10.382881 28678 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:10.448484 28768 tablet_service.cc:1511] Processing CreateTablet for tablet bd59cfed15884fd7830ecb836f0c1697 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:10.449995 28768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd59cfed15884fd7830ecb836f0c1697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.450301 28770 tablet_service.cc:1511] Processing CreateTablet for tablet 6ee776e29d574b1f90bae00b33900f28 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:10.451591 28770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ee776e29d574b1f90bae00b33900f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.451984 28767 tablet_service.cc:1511] Processing CreateTablet for tablet 97dbcabf88e84fc2ba9c1f20a7aca988 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:10.453224 28767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dbcabf88e84fc2ba9c1f20a7aca988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.448644 28769 tablet_service.cc:1511] Processing CreateTablet for tablet b81f97b597d945f48281bdae07231e07 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:10.455152 28766 tablet_service.cc:1511] Processing CreateTablet for tablet 662d50871dac45fbb88f4eb92f5e81d8 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:10.455704 28769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81f97b597d945f48281bdae07231e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.458381 28765 tablet_service.cc:1511] Processing CreateTablet for tablet f999518ffceb48ddb27d03dc95e5d0ec (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:10.459512 28766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662d50871dac45fbb88f4eb92f5e81d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.460928 28765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f999518ffceb48ddb27d03dc95e5d0ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.463485 28764 tablet_service.cc:1511] Processing CreateTablet for tablet 4e47265099aa41018d1ae8cf1d3359c9 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:10.464717 28764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e47265099aa41018d1ae8cf1d3359c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.471164 28763 tablet_service.cc:1511] Processing CreateTablet for tablet 74c655b4143b4a99a860a2eaea735e47 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:10.472386 28763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c655b4143b4a99a860a2eaea735e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.475981 28762 tablet_service.cc:1511] Processing CreateTablet for tablet d86b2f735b3e4bcbae8f3b3a74fe327b (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:10.477239 28762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86b2f735b3e4bcbae8f3b3a74fe327b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.479619 28761 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3f4d1197a54b89bee9d5d07a9c748b (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:10.480881 28761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3f4d1197a54b89bee9d5d07a9c748b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.514549 28846 tablet_service.cc:1511] Processing CreateTablet for tablet 6ee776e29d574b1f90bae00b33900f28 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:10.515962 28846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ee776e29d574b1f90bae00b33900f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.524322 28845 tablet_service.cc:1511] Processing CreateTablet for tablet b81f97b597d945f48281bdae07231e07 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:10.525919 28845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81f97b597d945f48281bdae07231e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.526211 28970 tablet_bootstrap.cc:492] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:10.529505 28917 tablet_service.cc:1511] Processing CreateTablet for tablet 97dbcabf88e84fc2ba9c1f20a7aca988 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:10.530928 28917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dbcabf88e84fc2ba9c1f20a7aca988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.529572 28918 tablet_service.cc:1511] Processing CreateTablet for tablet bd59cfed15884fd7830ecb836f0c1697 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:10.532298 28918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd59cfed15884fd7830ecb836f0c1697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.533129 28843 tablet_service.cc:1511] Processing CreateTablet for tablet 97dbcabf88e84fc2ba9c1f20a7aca988 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:10.534394 28843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dbcabf88e84fc2ba9c1f20a7aca988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.535115 28920 tablet_service.cc:1511] Processing CreateTablet for tablet 6ee776e29d574b1f90bae00b33900f28 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:10.537705 28916 tablet_service.cc:1511] Processing CreateTablet for tablet 662d50871dac45fbb88f4eb92f5e81d8 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:10.538064 28838 tablet_service.cc:1511] Processing CreateTablet for tablet d86b2f735b3e4bcbae8f3b3a74fe327b (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:10.539368 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86b2f735b3e4bcbae8f3b3a74fe327b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.539880 28915 tablet_service.cc:1511] Processing CreateTablet for tablet f999518ffceb48ddb27d03dc95e5d0ec (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:10.540750 28841 tablet_service.cc:1511] Processing CreateTablet for tablet f999518ffceb48ddb27d03dc95e5d0ec (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:10.542061 28914 tablet_service.cc:1511] Processing CreateTablet for tablet 4e47265099aa41018d1ae8cf1d3359c9 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:10.530683 28919 tablet_service.cc:1511] Processing CreateTablet for tablet b81f97b597d945f48281bdae07231e07 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:10.543262 28840 tablet_service.cc:1511] Processing CreateTablet for tablet 4e47265099aa41018d1ae8cf1d3359c9 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:10.543955 28837 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3f4d1197a54b89bee9d5d07a9c748b (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:10.545445 28839 tablet_service.cc:1511] Processing CreateTablet for tablet 74c655b4143b4a99a860a2eaea735e47 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:10.546041 28844 tablet_service.cc:1511] Processing CreateTablet for tablet bd59cfed15884fd7830ecb836f0c1697 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:10.547430 28920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ee776e29d574b1f90bae00b33900f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.547317 28912 tablet_service.cc:1511] Processing CreateTablet for tablet d86b2f735b3e4bcbae8f3b3a74fe327b (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:10.547611 28842 tablet_service.cc:1511] Processing CreateTablet for tablet 662d50871dac45fbb88f4eb92f5e81d8 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:10.545468 28913 tablet_service.cc:1511] Processing CreateTablet for tablet 74c655b4143b4a99a860a2eaea735e47 (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:10.550792 28913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c655b4143b4a99a860a2eaea735e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.551113 28911 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3f4d1197a54b89bee9d5d07a9c748b (DEFAULT_TABLE table=test-workload [id=8964579174514117a61a01d587b57543]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:10.552357 28911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3f4d1197a54b89bee9d5d07a9c748b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.542021 28841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f999518ffceb48ddb27d03dc95e5d0ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.554553 28912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86b2f735b3e4bcbae8f3b3a74fe327b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.555104 28837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3f4d1197a54b89bee9d5d07a9c748b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.556213 28844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd59cfed15884fd7830ecb836f0c1697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.557224 28970 tablet_bootstrap.cc:654] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.559154 28842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662d50871dac45fbb88f4eb92f5e81d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.562602 28916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662d50871dac45fbb88f4eb92f5e81d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.563189 28839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c655b4143b4a99a860a2eaea735e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.565819 28840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e47265099aa41018d1ae8cf1d3359c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.567185 28914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e47265099aa41018d1ae8cf1d3359c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.569113 28915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f999518ffceb48ddb27d03dc95e5d0ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.575227 28919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81f97b597d945f48281bdae07231e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.654263 28972 tablet_bootstrap.cc:492] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:10.677369 28970 tablet_bootstrap.cc:492] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:10.677942 28970 ts_tablet_manager.cc:1403] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.152s	user 0.046s	sys 0.050s
I20260709 12:20:10.681501 28972 tablet_bootstrap.cc:654] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.683331 28973 tablet_bootstrap.cc:492] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:10.683578 28970 raft_consensus.cc:359] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.684341 28970 raft_consensus.cc:385] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.684656 28970 raft_consensus.cc:740] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.685379 28970 consensus_queue.cc:260] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.698241 28970 ts_tablet_manager.cc:1434] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 12:20:10.698807 28973 tablet_bootstrap.cc:654] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.699028 28806 heartbeater.cc:499] Master 127.19.108.62:35715 was elected leader, sending a full tablet report...
I20260709 12:20:10.704140 28972 tablet_bootstrap.cc:492] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
I20260709 12:20:10.705683 28972 ts_tablet_manager.cc:1403] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.005s
I20260709 12:20:10.699304 28970 tablet_bootstrap.cc:492] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:10.708210 28972 raft_consensus.cc:359] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.708950 28972 raft_consensus.cc:385] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.709232 28972 raft_consensus.cc:740] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.709654 28973 tablet_bootstrap.cc:492] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:10.710182 28973 ts_tablet_manager.cc:1403] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 12:20:10.710107 28972 consensus_queue.cc:260] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.713393 28973 raft_consensus.cc:359] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.714197 28970 tablet_bootstrap.cc:654] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.714241 28973 raft_consensus.cc:385] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.714972 28973 raft_consensus.cc:740] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.715960 28973 consensus_queue.cc:260] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.719524 28972 ts_tablet_manager.cc:1434] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.002s
I20260709 12:20:10.720329 28881 heartbeater.cc:499] Master 127.19.108.62:35715 was elected leader, sending a full tablet report...
I20260709 12:20:10.725457 28973 ts_tablet_manager.cc:1434] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.009s
I20260709 12:20:10.726228 28955 heartbeater.cc:499] Master 127.19.108.62:35715 was elected leader, sending a full tablet report...
I20260709 12:20:10.732128 28973 tablet_bootstrap.cc:492] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:10.738333 28973 tablet_bootstrap.cc:654] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.739509 28972 tablet_bootstrap.cc:492] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:10.750211 28973 tablet_bootstrap.cc:492] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:10.750909 28973 ts_tablet_manager.cc:1403] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:20:10.752086 28972 tablet_bootstrap.cc:654] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.754042 28970 tablet_bootstrap.cc:492] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:10.754630 28970 ts_tablet_manager.cc:1403] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.032s
I20260709 12:20:10.754340 28973 raft_consensus.cc:359] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.755223 28973 raft_consensus.cc:385] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.755641 28973 raft_consensus.cc:740] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.756438 28973 consensus_queue.cc:260] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.758195 28970 raft_consensus.cc:359] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.759100 28970 raft_consensus.cc:385] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.758857 28973 ts_tablet_manager.cc:1434] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:10.759531 28970 raft_consensus.cc:740] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.760277 28973 tablet_bootstrap.cc:492] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:10.760736 28970 consensus_queue.cc:260] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.761934 28974 raft_consensus.cc:493] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.762392 28974 raft_consensus.cc:515] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.767053 28973 tablet_bootstrap.cc:654] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.770448 28974 leader_election.cc:290] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:10.772277 28972 tablet_bootstrap.cc:492] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
I20260709 12:20:10.772790 28972 ts_tablet_manager.cc:1403] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.011s
I20260709 12:20:10.775774 28972 raft_consensus.cc:359] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.776445 28972 raft_consensus.cc:385] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.776731 28972 raft_consensus.cc:740] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.777451 28972 consensus_queue.cc:260] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.779819 28972 ts_tablet_manager.cc:1434] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:10.780771 28972 tablet_bootstrap.cc:492] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:10.794972 28972 tablet_bootstrap.cc:654] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.813807 28973 tablet_bootstrap.cc:492] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:10.814343 28973 ts_tablet_manager.cc:1403] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.013s
I20260709 12:20:10.817211 28973 raft_consensus.cc:359] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.817914 28973 raft_consensus.cc:385] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.818239 28973 raft_consensus.cc:740] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.818691 28856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:10.819389 28970 ts_tablet_manager.cc:1434] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.064s	user 0.034s	sys 0.020s
I20260709 12:20:10.819092 28973 consensus_queue.cc:260] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.820425 28972 tablet_bootstrap.cc:492] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
W20260709 12:20:10.820747 28744 leader_election.cc:343] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:10.820947 28972 ts_tablet_manager.cc:1403] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.005s
I20260709 12:20:10.822432 28973 ts_tablet_manager.cc:1434] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:10.823519 28973 tablet_bootstrap.cc:492] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:10.826687 28970 tablet_bootstrap.cc:492] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:10.828362 28930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:10.829497 28973 tablet_bootstrap.cc:654] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:10.830058 28744 leader_election.cc:343] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:10.830610 28744 leader_election.cc:304] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5; no voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:10.831511 28984 raft_consensus.cc:2749] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:10.833372 28970 tablet_bootstrap.cc:654] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.835739 28972 raft_consensus.cc:359] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.836516 28972 raft_consensus.cc:385] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.836817 28972 raft_consensus.cc:740] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.837036 28973 tablet_bootstrap.cc:492] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:10.837527 28973 ts_tablet_manager.cc:1403] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:20:10.837631 28972 consensus_queue.cc:260] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.840090 28972 ts_tablet_manager.cc:1434] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:10.840032 28973 raft_consensus.cc:359] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.840802 28973 raft_consensus.cc:385] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.841091 28973 raft_consensus.cc:740] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.841267 28972 tablet_bootstrap.cc:492] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:10.841826 28973 consensus_queue.cc:260] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.844036 28973 ts_tablet_manager.cc:1434] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:20:10.844718 28970 tablet_bootstrap.cc:492] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:10.845237 28970 ts_tablet_manager.cc:1403] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 12:20:10.846830 28973 tablet_bootstrap.cc:492] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:10.848112 28972 tablet_bootstrap.cc:654] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.848176 28970 raft_consensus.cc:359] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.849042 28970 raft_consensus.cc:385] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.849325 28970 raft_consensus.cc:740] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.850131 28970 consensus_queue.cc:260] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.853477 28973 tablet_bootstrap.cc:654] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.855702 28970 ts_tablet_manager.cc:1434] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:20:10.856837 28970 tablet_bootstrap.cc:492] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:10.863209 28970 tablet_bootstrap.cc:654] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.868717 28973 tablet_bootstrap.cc:492] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:10.869184 28972 tablet_bootstrap.cc:492] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
I20260709 12:20:10.869201 28973 ts_tablet_manager.cc:1403] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.014s
I20260709 12:20:10.869874 28972 ts_tablet_manager.cc:1403] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 12:20:10.871179 28970 tablet_bootstrap.cc:492] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:10.871742 28970 ts_tablet_manager.cc:1403] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:20:10.872493 28973 raft_consensus.cc:359] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.873508 28973 raft_consensus.cc:385] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.872802 28972 raft_consensus.cc:359] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.873812 28973 raft_consensus.cc:740] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.873979 28972 raft_consensus.cc:385] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.874444 28972 raft_consensus.cc:740] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.874617 28973 consensus_queue.cc:260] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.875074 28970 raft_consensus.cc:359] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.875309 28972 consensus_queue.cc:260] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.875792 28970 raft_consensus.cc:385] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.876135 28970 raft_consensus.cc:740] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.876892 28973 ts_tablet_manager.cc:1434] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:10.877526 28972 ts_tablet_manager.cc:1434] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:10.876953 28970 consensus_queue.cc:260] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.878171 28973 tablet_bootstrap.cc:492] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:10.878500 28972 tablet_bootstrap.cc:492] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:10.879735 28970 ts_tablet_manager.cc:1434] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:10.880740 28970 tablet_bootstrap.cc:492] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:10.884882 28972 tablet_bootstrap.cc:654] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.884900 28973 tablet_bootstrap.cc:654] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.886695 28970 tablet_bootstrap.cc:654] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.895175 28970 tablet_bootstrap.cc:492] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:10.895712 28970 ts_tablet_manager.cc:1403] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:20:10.898782 28970 raft_consensus.cc:359] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.900087 28970 raft_consensus.cc:385] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.900377 28970 raft_consensus.cc:740] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.901521 28972 tablet_bootstrap.cc:492] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
I20260709 12:20:10.901232 28970 consensus_queue.cc:260] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.902069 28972 ts_tablet_manager.cc:1403] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 12:20:10.903265 28973 tablet_bootstrap.cc:492] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:10.903497 28970 ts_tablet_manager.cc:1434] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:10.903790 28973 ts_tablet_manager.cc:1403] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 12:20:10.904482 28970 tablet_bootstrap.cc:492] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:10.905303 28972 raft_consensus.cc:359] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.906015 28972 raft_consensus.cc:385] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.906284 28972 raft_consensus.cc:740] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.907052 28972 consensus_queue.cc:260] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.908990 28973 raft_consensus.cc:359] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.909510 28972 ts_tablet_manager.cc:1434] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:10.909818 28973 raft_consensus.cc:385] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.910161 28973 raft_consensus.cc:740] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.910567 28972 tablet_bootstrap.cc:492] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:10.911155 28970 tablet_bootstrap.cc:654] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.910945 28973 consensus_queue.cc:260] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.913163 28973 ts_tablet_manager.cc:1434] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:10.914142 28973 tablet_bootstrap.cc:492] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:10.917520 28972 tablet_bootstrap.cc:654] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.917713 28984 raft_consensus.cc:493] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.918234 28984 raft_consensus.cc:515] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.920092 28973 tablet_bootstrap.cc:654] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.920428 28984 leader_election.cc:290] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:10.923024 28970 tablet_bootstrap.cc:492] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:10.923202 28930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:10.923565 28970 ts_tablet_manager.cc:1403] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 12:20:10.924605 28856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:10.925326 28973 tablet_bootstrap.cc:492] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:10.925215 28856 raft_consensus.cc:2468] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 0.
I20260709 12:20:10.923733 28930 raft_consensus.cc:2468] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 0.
I20260709 12:20:10.925846 28973 ts_tablet_manager.cc:1403] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:20:10.925881 28970 raft_consensus.cc:359] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.926776 28970 raft_consensus.cc:385] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.927114 28970 raft_consensus.cc:740] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.927007 28744 leader_election.cc:304] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:10.928222 28984 raft_consensus.cc:2804] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:10.928581 28984 raft_consensus.cc:493] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.928920 28984 raft_consensus.cc:3060] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:10.929430 28973 raft_consensus.cc:359] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.930140 28973 raft_consensus.cc:385] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.930419 28973 raft_consensus.cc:740] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.931378 28972 tablet_bootstrap.cc:492] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
I20260709 12:20:10.931871 28972 ts_tablet_manager.cc:1403] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.003s
I20260709 12:20:10.931687 28973 consensus_queue.cc:260] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.934222 28973 ts_tablet_manager.cc:1434] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:20:10.936534 28973 tablet_bootstrap.cc:492] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:10.934701 28972 raft_consensus.cc:359] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.941327 28972 raft_consensus.cc:385] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.941635 28972 raft_consensus.cc:740] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.942766 28974 raft_consensus.cc:493] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.942378 28972 consensus_queue.cc:260] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.943287 28974 raft_consensus.cc:515] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.944064 28973 tablet_bootstrap.cc:654] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.945066 28972 ts_tablet_manager.cc:1434] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:20:10.945497 28974 leader_election.cc:290] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:10.946110 28972 tablet_bootstrap.cc:492] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:10.947682 28856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662d50871dac45fbb88f4eb92f5e81d8" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:10.948383 28856 raft_consensus.cc:2468] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 0.
I20260709 12:20:10.949872 28930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662d50871dac45fbb88f4eb92f5e81d8" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
W20260709 12:20:10.951543 28744 leader_election.cc:343] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:10.952296 28744 leader_election.cc:304] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 92e3eb6d98624bd29a116f4e92bec65e
I20260709 12:20:10.952373 28984 raft_consensus.cc:515] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.953563 28974 raft_consensus.cc:2804] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:10.953953 28974 raft_consensus.cc:493] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.954294 28974 raft_consensus.cc:3060] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:10.954546 28984 leader_election.cc:290] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 election: Requested vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:10.928231 28970 consensus_queue.cc:260] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.957329 28970 ts_tablet_manager.cc:1434] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:20:10.958290 28970 tablet_bootstrap.cc:492] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:10.960009 28856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:10.960681 28856 raft_consensus.cc:3060] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:10.963559 28979 raft_consensus.cc:493] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.964116 28979 raft_consensus.cc:515] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.964689 28970 tablet_bootstrap.cc:654] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.969177 28972 tablet_bootstrap.cc:654] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.973186 28979 leader_election.cc:290] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:10.973763 29003 raft_consensus.cc:493] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.974298 29003 raft_consensus.cc:515] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.976492 29003 leader_election.cc:290] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:10.978582 28972 tablet_bootstrap.cc:492] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
I20260709 12:20:10.979195 28972 ts_tablet_manager.cc:1403] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.007s
I20260709 12:20:10.982098 28972 raft_consensus.cc:359] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.982821 28972 raft_consensus.cc:385] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.983127 28972 raft_consensus.cc:740] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.983858 28972 consensus_queue.cc:260] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:10.986199 28972 ts_tablet_manager.cc:1434] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:20:10.987274 28972 tablet_bootstrap.cc:492] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:10.993495 28972 tablet_bootstrap.cc:654] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:10.997476 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:20:10.999058 28882 tablet.cc:2406] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:11.002151 28977 raft_consensus.cc:493] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.002696 28977 raft_consensus.cc:515] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.004766 28972 tablet_bootstrap.cc:492] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
I20260709 12:20:11.005300 28972 ts_tablet_manager.cc:1403] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 12:20:11.007943 28972 raft_consensus.cc:359] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.008610 28972 raft_consensus.cc:385] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.008870 28972 raft_consensus.cc:740] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.010042 28977 leader_election.cc:290] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.010984 28972 consensus_queue.cc:260] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.018612 28972 ts_tablet_manager.cc:1434] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:20:11.019572 28972 tablet_bootstrap.cc:492] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:11.029239 29003 raft_consensus.cc:493] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.029783 29003 raft_consensus.cc:515] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.030718 28781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81f97b597d945f48281bdae07231e07" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5" is_pre_election: true
I20260709 12:20:11.031728 28977 raft_consensus.cc:493] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.032222 28977 raft_consensus.cc:515] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.032549 28781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5" is_pre_election: true
I20260709 12:20:11.034132 29003 leader_election.cc:290] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:11.035018 28977 leader_election.cc:290] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.037156 28930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:11.037742 28930 raft_consensus.cc:3060] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.042815 28972 tablet_bootstrap.cc:654] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.043779 28780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5" is_pre_election: true
I20260709 12:20:11.044456 28780 raft_consensus.cc:2468] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 0.
I20260709 12:20:11.045466 28930 raft_consensus.cc:2468] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 1.
I20260709 12:20:10.987921 28856 raft_consensus.cc:2468] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 1.
I20260709 12:20:11.046798 28781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5" is_pre_election: true
I20260709 12:20:11.047451 28781 raft_consensus.cc:2468] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 0.
I20260709 12:20:11.045800 28821 leader_election.cc:304] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.048403 28974 raft_consensus.cc:515] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.049351 28821 leader_election.cc:304] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.050547 28977 raft_consensus.cc:2804] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.050992 28977 raft_consensus.cc:493] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.053671 28930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:11.058162 28977 raft_consensus.cc:3060] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.058697 28930 raft_consensus.cc:2468] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 0.
I20260709 12:20:11.057029 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662d50871dac45fbb88f4eb92f5e81d8" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:11.055534 28856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662d50871dac45fbb88f4eb92f5e81d8" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:11.053265 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:11.061241 28856 raft_consensus.cc:3060] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.061720 28929 raft_consensus.cc:2468] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 0.
W20260709 12:20:11.051647 28895 leader_election.cc:343] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:11.067615 28895 leader_election.cc:343] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:11.067782 28977 raft_consensus.cc:515] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.050796 28974 leader_election.cc:290] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 election: Requested vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.070996 28977 leader_election.cc:290] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.071657 28977 raft_consensus.cc:2804] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.072000 28977 raft_consensus.cc:493] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.072261 28977 raft_consensus.cc:3060] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.073712 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:11.074220 28970 tablet_bootstrap.cc:492] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:11.074370 28929 raft_consensus.cc:3060] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.074900 28970 ts_tablet_manager.cc:1403] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.117s	user 0.040s	sys 0.040s
I20260709 12:20:11.055152 28744 leader_election.cc:304] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:11.076066 28974 raft_consensus.cc:2804] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.076536 28974 raft_consensus.cc:697] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: Becoming Leader. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Running, Role: LEADER
I20260709 12:20:11.078454 28781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5" is_pre_election: true
I20260709 12:20:11.079125 28781 raft_consensus.cc:2468] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 0.
I20260709 12:20:11.079125 28970 raft_consensus.cc:359] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.080054 28970 raft_consensus.cc:385] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.080394 28970 raft_consensus.cc:740] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
W20260709 12:20:11.080968 28744 leader_election.cc:343] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:11.081269 28970 consensus_queue.cc:260] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.077322 28974 consensus_queue.cc:237] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.082485 28929 raft_consensus.cc:2468] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 1.
I20260709 12:20:11.083647 28895 leader_election.cc:304] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:11.084323 28970 ts_tablet_manager.cc:1434] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:20:11.085013 28820 leader_election.cc:304] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.085630 28970 tablet_bootstrap.cc:492] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:11.086095 29003 raft_consensus.cc:2764] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:20:11.087987 28781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:11.088581 28781 raft_consensus.cc:3060] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.092857 28970 tablet_bootstrap.cc:654] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.093360 28972 tablet_bootstrap.cc:492] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
I20260709 12:20:11.093851 28972 ts_tablet_manager.cc:1403] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.074s	user 0.035s	sys 0.015s
I20260709 12:20:11.096201 28973 tablet_bootstrap.cc:492] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:11.096671 28973 ts_tablet_manager.cc:1403] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.160s	user 0.031s	sys 0.021s
I20260709 12:20:11.096740 28972 raft_consensus.cc:359] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.097450 28972 raft_consensus.cc:385] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.097711 28972 raft_consensus.cc:740] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.098618 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:11.099290 28973 raft_consensus.cc:359] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.099999 28973 raft_consensus.cc:385] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.099675 28972 consensus_queue.cc:260] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.100266 28973 raft_consensus.cc:740] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.101684 28855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81f97b597d945f48281bdae07231e07" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:11.102355 28856 raft_consensus.cc:2468] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 1.
I20260709 12:20:11.103080 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:11.103835 28854 raft_consensus.cc:2468] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 0.
I20260709 12:20:11.102438 28855 raft_consensus.cc:2468] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 0.
I20260709 12:20:11.105518 28972 ts_tablet_manager.cc:1434] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 12:20:11.105556 28894 leader_election.cc:304] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 247b808a5ef746388461f2b917a6d9e5
I20260709 12:20:11.103106 28973 consensus_queue.cc:260] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.107013 29003 raft_consensus.cc:2804] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.107404 29003 raft_consensus.cc:493] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.107743 29003 raft_consensus.cc:3060] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.107930 28972 tablet_bootstrap.cc:492] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd: Bootstrap starting.
I20260709 12:20:11.108350 28973 ts_tablet_manager.cc:1434] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:20:11.109356 28973 tablet_bootstrap.cc:492] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:11.113296 28781 raft_consensus.cc:2468] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 1.
I20260709 12:20:11.114782 28744 leader_election.cc:304] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 92e3eb6d98624bd29a116f4e92bec65e
I20260709 12:20:11.115641 28984 raft_consensus.cc:2804] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.113229 28894 leader_election.cc:304] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 247b808a5ef746388461f2b917a6d9e5
I20260709 12:20:11.086308 29011 raft_consensus.cc:2804] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.117507 28979 raft_consensus.cc:2804] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.117868 28979 raft_consensus.cc:493] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.118198 28979 raft_consensus.cc:3060] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.129046 28979 raft_consensus.cc:515] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.130920 29014 raft_consensus.cc:493] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.131479 29014 raft_consensus.cc:515] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.132292 28781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81f97b597d945f48281bdae07231e07" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:11.132961 28781 raft_consensus.cc:3060] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.133689 29014 leader_election.cc:290] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.134676 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:11.135346 28929 raft_consensus.cc:2468] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 0.
I20260709 12:20:11.136355 28820 leader_election.cc:304] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.134192 29014 raft_consensus.cc:493] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.137295 29014 raft_consensus.cc:515] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.138052 29013 raft_consensus.cc:2804] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.138477 29013 raft_consensus.cc:493] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.138857 28675 catalog_manager.cc:5697] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "247b808a5ef746388461f2b917a6d9e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.122716 28977 raft_consensus.cc:515] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.140311 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:11.140959 28929 raft_consensus.cc:2468] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 0.
I20260709 12:20:11.140990 29003 raft_consensus.cc:515] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.142313 28820 leader_election.cc:304] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.142735 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:11.143364 28929 raft_consensus.cc:3060] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.144084 28780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:11.145350 28779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5" is_pre_election: true
I20260709 12:20:11.145581 28780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:11.146225 28780 raft_consensus.cc:3060] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.146696 28778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5" is_pre_election: true
W20260709 12:20:11.148586 28895 leader_election.cc:343] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:11.150817 28855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81f97b597d945f48281bdae07231e07" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:11.151476 28855 raft_consensus.cc:3060] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.152168 29013 raft_consensus.cc:3060] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.153970 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:11.154588 28854 raft_consensus.cc:3060] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.154914 29017 raft_consensus.cc:2804] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.155368 29017 raft_consensus.cc:493] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.155714 29017 raft_consensus.cc:3060] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.156526 28979 leader_election.cc:290] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:11.157037 28972 tablet_bootstrap.cc:654] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.157150 29003 leader_election.cc:290] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:11.159759 28929 raft_consensus.cc:2468] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 1.
I20260709 12:20:11.160897 28820 leader_election.cc:304] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.165302 28854 raft_consensus.cc:2468] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 1.
I20260709 12:20:11.166137 28984 raft_consensus.cc:697] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: Becoming Leader. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Running, Role: LEADER
I20260709 12:20:11.167119 29014 leader_election.cc:290] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.166553 28894 leader_election.cc:304] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 247b808a5ef746388461f2b917a6d9e5
I20260709 12:20:11.165602 28781 raft_consensus.cc:2468] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 1.
I20260709 12:20:11.168262 29003 raft_consensus.cc:2804] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.168776 29014 raft_consensus.cc:2804] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.169214 29014 raft_consensus.cc:697] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:11.168790 29003 raft_consensus.cc:697] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:11.168155 28984 consensus_queue.cc:237] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.170002 29014 consensus_queue.cc:237] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.170598 29003 consensus_queue.cc:237] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.172075 28895 leader_election.cc:304] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:11.173555 28979 raft_consensus.cc:2804] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.175204 28855 raft_consensus.cc:2468] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 1.
I20260709 12:20:11.172461 29017 raft_consensus.cc:515] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.178164 28780 raft_consensus.cc:2468] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 1.
I20260709 12:20:11.138288 28973 tablet_bootstrap.cc:654] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.180509 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:11.181100 28929 raft_consensus.cc:3060] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.168090 29013 raft_consensus.cc:515] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
W20260709 12:20:11.182782 28821 leader_election.cc:343] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:11.183837 28821 leader_election.cc:343] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:11.185192 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:11.185843 28781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:11.185811 28928 raft_consensus.cc:3060] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.188316 28929 raft_consensus.cc:2468] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 1.
I20260709 12:20:11.188700 28780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:11.189476 28820 leader_election.cc:304] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.189898 28977 leader_election.cc:290] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.190965 28977 raft_consensus.cc:2804] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.191408 28977 raft_consensus.cc:697] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:11.192572 28970 tablet_bootstrap.cc:492] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:11.193941 28970 ts_tablet_manager.cc:1403] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.109s	user 0.027s	sys 0.020s
I20260709 12:20:11.176976 29011 raft_consensus.cc:697] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:11.193743 28928 raft_consensus.cc:2468] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 1.
I20260709 12:20:11.195508 29011 consensus_queue.cc:237] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
W20260709 12:20:11.193795 28821 leader_election.cc:343] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:11.198609 29013 leader_election.cc:290] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.192224 28977 consensus_queue.cc:237] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.200035 28820 leader_election.cc:304] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 247b808a5ef746388461f2b917a6d9e5
W20260709 12:20:11.199502 28821 leader_election.cc:343] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:11.200944 29013 raft_consensus.cc:2804] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.201814 29017 leader_election.cc:290] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 1 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.202656 29013 raft_consensus.cc:697] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:11.198503 28970 raft_consensus.cc:359] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.203812 28970 raft_consensus.cc:385] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.204156 28970 raft_consensus.cc:740] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.204960 28970 consensus_queue.cc:260] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.207417 28970 ts_tablet_manager.cc:1434] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:20:11.208582 28970 tablet_bootstrap.cc:492] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:11.210523 28972 tablet_bootstrap.cc:492] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd: No bootstrap required, opened a new log
I20260709 12:20:11.211092 28972 ts_tablet_manager.cc:1403] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.007s
I20260709 12:20:11.212258 28979 raft_consensus.cc:697] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:11.213268 28979 consensus_queue.cc:237] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.213749 28972 raft_consensus.cc:359] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.214495 28972 raft_consensus.cc:385] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.214767 28972 raft_consensus.cc:740] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.215492 28972 consensus_queue.cc:260] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.217741 28972 ts_tablet_manager.cc:1434] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:11.203595 29013 consensus_queue.cc:237] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.220700 28970 tablet_bootstrap.cc:654] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.225508 28674 catalog_manager.cc:5697] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 1 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:11.229729 28973 tablet_bootstrap.cc:492] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:11.230151 28973 ts_tablet_manager.cc:1403] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.121s	user 0.010s	sys 0.001s
I20260709 12:20:11.234153 28973 raft_consensus.cc:359] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.234596 28973 raft_consensus.cc:385] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.234797 28973 raft_consensus.cc:740] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.235495 28973 consensus_queue.cc:260] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.237663 28973 ts_tablet_manager.cc:1434] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:11.238620 28973 tablet_bootstrap.cc:492] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e: Bootstrap starting.
I20260709 12:20:11.243026 28970 tablet_bootstrap.cc:492] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:11.242067 28677 catalog_manager.cc:5697] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 0 to 1, leader changed from <none> to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 1 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.243566 28970 ts_tablet_manager.cc:1403] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.001s
I20260709 12:20:11.244505 28973 tablet_bootstrap.cc:654] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.246186 28970 raft_consensus.cc:359] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.255985 28970 raft_consensus.cc:385] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.256302 28970 raft_consensus.cc:740] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.257103 28970 consensus_queue.cc:260] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.259383 28970 ts_tablet_manager.cc:1434] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:20:11.260298 28970 tablet_bootstrap.cc:492] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:11.263013 28675 catalog_manager.cc:5697] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "247b808a5ef746388461f2b917a6d9e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.265908 28970 tablet_bootstrap.cc:654] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.276610 28674 catalog_manager.cc:5697] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 0 to 1, leader changed from <none> to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 1 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:11.277801 28970 tablet_bootstrap.cc:492] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: No bootstrap required, opened a new log
I20260709 12:20:11.278388 28970 ts_tablet_manager.cc:1403] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:20:11.281263 28970 raft_consensus.cc:359] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.281874 28970 raft_consensus.cc:385] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.282119 28970 raft_consensus.cc:740] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.282728 28970 consensus_queue.cc:260] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.285065 28970 ts_tablet_manager.cc:1434] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:11.289469 28677 catalog_manager.cc:5697] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 0 to 1, leader changed from <none> to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 1 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.291450 28677 catalog_manager.cc:5697] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 0 to 1, leader changed from <none> to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 1 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.294255 28677 catalog_manager.cc:5697] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 0 to 1, leader changed from <none> to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 1 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.295293 28973 tablet_bootstrap.cc:492] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e: No bootstrap required, opened a new log
I20260709 12:20:11.295809 28973 ts_tablet_manager.cc:1403] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent bootstrapping tablet: real 0.057s	user 0.036s	sys 0.020s
I20260709 12:20:11.298288 28973 raft_consensus.cc:359] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.298717 28973 raft_consensus.cc:385] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.298962 28973 raft_consensus.cc:740] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.299490 28973 consensus_queue.cc:260] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.300971 28973 ts_tablet_manager.cc:1434] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:11.320482 28984 raft_consensus.cc:493] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.321007 28984 raft_consensus.cc:515] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.322599 28984 leader_election.cc:290] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.322902 29015 raft_consensus.cc:493] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.323560 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:11.323436 29015 raft_consensus.cc:515] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.323834 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:11.324232 28853 raft_consensus.cc:2468] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 0.
I20260709 12:20:11.324616 28929 raft_consensus.cc:2468] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 0.
I20260709 12:20:11.325526 29015 leader_election.cc:290] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.325866 28744 leader_election.cc:304] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.326298 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:11.326666 29015 raft_consensus.cc:2804] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.327097 29015 raft_consensus.cc:493] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.327407 29015 raft_consensus.cc:3060] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.327709 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:11.328462 28929 raft_consensus.cc:2393] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 247b808a5ef746388461f2b917a6d9e5 in current term 1: Already voted for candidate ed68bbc4749e4425b6d345f2223fafdd in this term.
I20260709 12:20:11.329344 28744 leader_election.cc:304] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5; no voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:11.329968 28984 raft_consensus.cc:3060] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.334375 29015 raft_consensus.cc:515] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.336630 29015 leader_election.cc:290] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 election: Requested vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.336712 28984 raft_consensus.cc:2749] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:11.337327 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:11.337563 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:11.337821 28853 raft_consensus.cc:3060] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.338073 28929 raft_consensus.cc:3060] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.342602 28853 raft_consensus.cc:2468] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 1.
I20260709 12:20:11.342639 28929 raft_consensus.cc:2468] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 1.
I20260709 12:20:11.343675 28744 leader_election.cc:304] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.344318 28984 raft_consensus.cc:2804] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.344681 28984 raft_consensus.cc:697] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: Becoming Leader. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Running, Role: LEADER
I20260709 12:20:11.345359 28984 consensus_queue.cc:237] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.353037 28675 catalog_manager.cc:5697] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "247b808a5ef746388461f2b917a6d9e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.354234 28984 raft_consensus.cc:493] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.354660 28984 raft_consensus.cc:515] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.356300 28984 leader_election.cc:290] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.356973 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:11.357200 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:11.357632 28853 raft_consensus.cc:2468] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 0.
I20260709 12:20:11.357780 28929 raft_consensus.cc:2468] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 0.
I20260709 12:20:11.358629 28744 leader_election.cc:304] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.359283 28984 raft_consensus.cc:2804] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.359637 28984 raft_consensus.cc:493] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.359920 28984 raft_consensus.cc:3060] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.364916 28984 raft_consensus.cc:515] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.366425 28984 leader_election.cc:290] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 election: Requested vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.367120 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:11.367354 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:11.367635 28853 raft_consensus.cc:3060] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.368063 28929 raft_consensus.cc:3060] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.372802 28853 raft_consensus.cc:2468] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 1.
I20260709 12:20:11.372799 28929 raft_consensus.cc:2468] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247b808a5ef746388461f2b917a6d9e5 in term 1.
I20260709 12:20:11.373895 28744 leader_election.cc:304] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:11.374490 28984 raft_consensus.cc:2804] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.374917 28984 raft_consensus.cc:697] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: Becoming Leader. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Running, Role: LEADER
I20260709 12:20:11.375653 28984 consensus_queue.cc:237] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.382160 28675 catalog_manager.cc:5697] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "247b808a5ef746388461f2b917a6d9e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.443861 28984 raft_consensus.cc:493] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.444393 28984 raft_consensus.cc:515] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.445983 28984 leader_election.cc:290] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.446870 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:11.447058 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:11.447772 28929 raft_consensus.cc:2393] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 247b808a5ef746388461f2b917a6d9e5 in current term 1: Already voted for candidate ed68bbc4749e4425b6d345f2223fafdd in this term.
I20260709 12:20:11.448683 28744 leader_election.cc:304] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5; no voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:11.449294 28984 raft_consensus.cc:3060] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.454022 28984 raft_consensus.cc:2749] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:11.468995 28984 raft_consensus.cc:493] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.469380 28984 raft_consensus.cc:515] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.471081 28984 leader_election.cc:290] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:11.471773 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:11.472077 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b" candidate_uuid: "247b808a5ef746388461f2b917a6d9e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:11.472645 28853 raft_consensus.cc:2393] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 247b808a5ef746388461f2b917a6d9e5 in current term 1: Already voted for candidate 92e3eb6d98624bd29a116f4e92bec65e in this term.
I20260709 12:20:11.473565 28744 leader_election.cc:304] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5; no voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:11.474212 28984 raft_consensus.cc:3060] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.478994 28984 raft_consensus.cc:2749] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:11.540496 28979 raft_consensus.cc:493] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.541122 28979 raft_consensus.cc:515] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:11.543195 28979 leader_election.cc:290] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:11.543895 28780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662d50871dac45fbb88f4eb92f5e81d8" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "247b808a5ef746388461f2b917a6d9e5" is_pre_election: true
I20260709 12:20:11.545817 28853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662d50871dac45fbb88f4eb92f5e81d8" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:11.546643 28853 raft_consensus.cc:2393] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92e3eb6d98624bd29a116f4e92bec65e in current term 1: Already voted for candidate 247b808a5ef746388461f2b917a6d9e5 in this term.
I20260709 12:20:11.547755 28894 leader_election.cc:304] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e; no voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:11.548537 28979 raft_consensus.cc:3060] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.548866 19888 ts_manager.cc:295] Set tserver state for 247b808a5ef746388461f2b917a6d9e5 to MAINTENANCE_MODE
I20260709 12:20:11.549393 28984 consensus_queue.cc:1048] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:11.549757 19888 tablet_server.cc:179] TabletServer@127.19.108.1:0 shutting down...
I20260709 12:20:11.557396 28979 raft_consensus.cc:2749] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:11.567481 28974 consensus_queue.cc:1048] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:11.572891 28979 consensus_queue.cc:1048] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:11.591655 28974 consensus_queue.cc:1048] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:11.597330 29013 consensus_queue.cc:1048] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:11.604292 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:11.605077 19888 tablet_replica.cc:333] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
I20260709 12:20:11.605819 19888 raft_consensus.cc:2243] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:11.606280 19888 raft_consensus.cc:2272] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:11.608346 19888 tablet_replica.cc:333] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
I20260709 12:20:11.608858 19888 raft_consensus.cc:2243] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:11.609179 19888 raft_consensus.cc:2272] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:11.611227 19888 tablet_replica.cc:333] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
I20260709 12:20:11.611963 19888 raft_consensus.cc:2243] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:11.612705 19888 pending_rounds.cc:70] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Trying to abort 1 pending ops.
I20260709 12:20:11.612941 19888 pending_rounds.cc:77] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624008201084928 op_type: NO_OP noop_request { }
I20260709 12:20:11.613343 19888 raft_consensus.cc:2889] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:11.613667 19888 raft_consensus.cc:2272] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:11.614240 28895 consensus_peers.cc:597] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.616688 19888 tablet_replica.cc:333] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
I20260709 12:20:11.617501 19888 raft_consensus.cc:2243] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:11.617923 19888 raft_consensus.cc:2272] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:11.619112 28979 consensus_queue.cc:1048] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:11.620535 19888 tablet_replica.cc:333] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
I20260709 12:20:11.621340 19888 raft_consensus.cc:2243] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:11.622022 19888 pending_rounds.cc:70] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Trying to abort 1 pending ops.
I20260709 12:20:11.622237 19888 pending_rounds.cc:77] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624008077668352 op_type: NO_OP noop_request { }
I20260709 12:20:11.622534 19888 raft_consensus.cc:2889] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:11.622860 19888 raft_consensus.cc:2272] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:11.628579 19888 tablet_replica.cc:333] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
I20260709 12:20:11.629349 19888 raft_consensus.cc:2243] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:11.629805 19888 raft_consensus.cc:2272] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:11.634240 19888 tablet_replica.cc:333] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
I20260709 12:20:11.634979 19888 raft_consensus.cc:2243] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:11.635970 19888 raft_consensus.cc:2272] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:11.645149 19888 tablet_replica.cc:333] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
W20260709 12:20:11.645716 28821 consensus_peers.cc:597] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.645866 19888 raft_consensus.cc:2243] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:11.649031 19888 raft_consensus.cc:2272] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:11.650221 28984 consensus_queue.cc:1048] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:11.653708 19888 tablet_replica.cc:333] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
I20260709 12:20:11.654492 19888 raft_consensus.cc:2243] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:11.654947 19888 raft_consensus.cc:2272] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:11.656813 28895 consensus_peers.cc:597] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.657137 19888 tablet_replica.cc:333] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: stopping tablet replica
I20260709 12:20:11.657851 19888 raft_consensus.cc:2243] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:11.658667 19888 raft_consensus.cc:2272] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:11.661885 28821 consensus_peers.cc:597] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.678916 29013 consensus_queue.cc:1048] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:11.691856 28821 consensus_peers.cc:597] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.692792 29013 consensus_queue.cc:1048] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:11.694097 19888 tablet_server.cc:196] TabletServer@127.19.108.1:0 shutdown complete.
W20260709 12:20:11.696132 28821 consensus_peers.cc:597] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.797698 29013 consensus_queue.cc:1048] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:11.998462 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:20:12.999477 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:13.065614 29052 raft_consensus.cc:493] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 247b808a5ef746388461f2b917a6d9e5)
I20260709 12:20:13.066181 29052 raft_consensus.cc:515] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.067849 29052 leader_election.cc:290] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:13.068929 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
W20260709 12:20:13.071502 28895 leader_election.cc:336] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.071954 28895 leader_election.cc:304] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e; no voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:13.072671 29052 raft_consensus.cc:2749] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:13.078251 29013 raft_consensus.cc:493] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 247b808a5ef746388461f2b917a6d9e5)
I20260709 12:20:13.078720 29013 raft_consensus.cc:515] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.080317 29013 leader_election.cc:290] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:13.081408 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:13.082012 28929 raft_consensus.cc:2468] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 1.
I20260709 12:20:13.083268 28820 leader_election.cc:304] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:13.084056 29013 raft_consensus.cc:2804] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:13.084342 29013 raft_consensus.cc:493] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 247b808a5ef746388461f2b917a6d9e5)
I20260709 12:20:13.084633 29013 raft_consensus.cc:3060] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:13.084641 28821 leader_election.cc:336] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.090147 29013 raft_consensus.cc:515] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.091646 29013 leader_election.cc:290] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:13.092657 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:13.093248 28929 raft_consensus.cc:3060] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:13.094969 28821 leader_election.cc:336] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.098395 28929 raft_consensus.cc:2468] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 2.
I20260709 12:20:13.099308 28820 leader_election.cc:304] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 247b808a5ef746388461f2b917a6d9e5
I20260709 12:20:13.099886 29013 raft_consensus.cc:2804] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:13.100646 29013 raft_consensus.cc:697] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:13.101238 29013 consensus_queue.cc:237] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.107513 28677 catalog_manager.cc:5697] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 1 to 2, leader changed from 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1) to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 2 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:13.150714 29052 raft_consensus.cc:493] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 247b808a5ef746388461f2b917a6d9e5)
I20260709 12:20:13.151298 29052 raft_consensus.cc:515] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.152925 29052 leader_election.cc:290] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:13.154047 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662d50871dac45fbb88f4eb92f5e81d8" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
W20260709 12:20:13.156363 28895 leader_election.cc:336] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.156718 28895 leader_election.cc:304] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e; no voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:13.157303 29052 raft_consensus.cc:2749] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:13.160116 29013 raft_consensus.cc:493] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 247b808a5ef746388461f2b917a6d9e5)
I20260709 12:20:13.160596 29013 raft_consensus.cc:515] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.162106 29013 leader_election.cc:290] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:13.163236 28929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662d50871dac45fbb88f4eb92f5e81d8" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:13.163878 28929 raft_consensus.cc:2468] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 1.
I20260709 12:20:13.164816 28820 leader_election.cc:304] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:13.165397 29013 raft_consensus.cc:2804] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:13.165437 28821 leader_election.cc:336] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.165751 29013 raft_consensus.cc:493] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 247b808a5ef746388461f2b917a6d9e5)
I20260709 12:20:13.166081 29013 raft_consensus.cc:3060] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:13.170738 29013 raft_consensus.cc:515] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.172197 29013 leader_election.cc:290] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:13.173687 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662d50871dac45fbb88f4eb92f5e81d8" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:13.174285 28928 raft_consensus.cc:3060] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:13.175635 28821 leader_election.cc:336] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.179214 28928 raft_consensus.cc:2468] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 2.
I20260709 12:20:13.180071 28820 leader_election.cc:304] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 247b808a5ef746388461f2b917a6d9e5
I20260709 12:20:13.180611 29013 raft_consensus.cc:2804] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:13.180974 29013 raft_consensus.cc:697] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:13.181697 29013 consensus_queue.cc:237] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.188542 28677 catalog_manager.cc:5697] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 1 to 2, leader changed from 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1) to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 2 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:13.230085 29013 raft_consensus.cc:493] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.230556 29013 raft_consensus.cc:515] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.232366 29013 leader_election.cc:290] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:13.233455 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e" is_pre_election: true
I20260709 12:20:13.234170 28928 raft_consensus.cc:2468] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 1.
I20260709 12:20:13.235113 28820 leader_election.cc:304] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:13.235702 29013 raft_consensus.cc:2804] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:13.235790 28821 leader_election.cc:336] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.235982 29013 raft_consensus.cc:493] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.236297 29013 raft_consensus.cc:3060] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:13.241035 29013 raft_consensus.cc:515] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.242486 29013 leader_election.cc:290] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:13.243465 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:13.244007 28928 raft_consensus.cc:3060] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:13.245503 28821 leader_election.cc:336] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.248692 28928 raft_consensus.cc:2468] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 2.
I20260709 12:20:13.249766 28820 leader_election.cc:304] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 247b808a5ef746388461f2b917a6d9e5
I20260709 12:20:13.250368 29013 raft_consensus.cc:2804] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:13.250810 29013 raft_consensus.cc:697] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:13.252203 29013 consensus_queue.cc:237] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.259312 28677 catalog_manager.cc:5697] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 1 to 2, leader changed from 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1) to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 2 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:13.266741 29066 raft_consensus.cc:493] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.267186 29066 raft_consensus.cc:515] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.268827 29066 leader_election.cc:290] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:13.269815 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd" is_pre_election: true
I20260709 12:20:13.270385 28854 raft_consensus.cc:2468] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 1.
I20260709 12:20:13.271345 28894 leader_election.cc:304] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:13.271979 29066 raft_consensus.cc:2804] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:13.272078 28895 leader_election.cc:336] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.272315 29066 raft_consensus.cc:493] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.272646 29066 raft_consensus.cc:3060] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:13.277807 29066 raft_consensus.cc:515] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.279676 29066 leader_election.cc:290] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:13.280592 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:13.281191 28854 raft_consensus.cc:3060] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:13.282723 28895 leader_election.cc:336] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111)
I20260709 12:20:13.286068 28854 raft_consensus.cc:2468] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 2.
I20260709 12:20:13.286953 28894 leader_election.cc:304] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 92e3eb6d98624bd29a116f4e92bec65e, ed68bbc4749e4425b6d345f2223fafdd; no voters: 247b808a5ef746388461f2b917a6d9e5
I20260709 12:20:13.287559 29066 raft_consensus.cc:2804] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:13.288007 29066 raft_consensus.cc:697] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:13.288733 29066 consensus_queue.cc:237] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:13.295639 28677 catalog_manager.cc:5697] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 1 to 2, leader changed from 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1) to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 2 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:13.394726 28821 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111) [suppressed 139 similar messages]
W20260709 12:20:13.545207 28821 consensus_peers.cc:597] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.596940 28928 raft_consensus.cc:1275] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:13.598297 29013 consensus_queue.cc:1048] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:13.633608 28821 consensus_peers.cc:597] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:13.756896 28821 consensus_peers.cc:597] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.784060 28928 raft_consensus.cc:1275] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:20:13.785388 29013 consensus_queue.cc:1048] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:13.801084 28928 raft_consensus.cc:1275] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:13.802258 29059 consensus_queue.cc:1048] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:13.866705 28895 consensus_peers.cc:597] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.884716 28854 raft_consensus.cc:1275] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:20:13.886188 29066 consensus_queue.cc:1048] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:14.000398 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:20:14.037011 28895 consensus_peers.cc:597] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:14.122709 28821 consensus_peers.cc:597] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:14.129643 28821 consensus_peers.cc:597] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:14.138464 28821 consensus_peers.cc:597] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:14.208339 28895 consensus_peers.cc:597] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:14.376250 28821 consensus_peers.cc:597] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:15.001328 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:20:15.960438 28821 consensus_peers.cc:597] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:16.002236 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:20:16.032065 28821 consensus_peers.cc:597] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:16.201903 28821 consensus_peers.cc:597] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:16.298514 28895 consensus_peers.cc:597] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:16.360249 28821 consensus_peers.cc:597] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:16.564327 28895 consensus_peers.cc:597] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:16.634127 28821 consensus_peers.cc:597] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:16.664567 28895 consensus_peers.cc:597] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:16.719327 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:16.720906 28821 consensus_peers.cc:597] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:16.725104 29081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:16.725852 29082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:16.728309 29084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:16.728469 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:16.729553 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:16.729760 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:16.729902 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599616729891 us; error 0 us; skew 500 ppm
I20260709 12:20:16.730382 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:16.732632 19888 webserver.cc:533] Webserver started at http://127.19.108.1:37681/ using document root <none> and password file <none>
I20260709 12:20:16.733048 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:16.733194 19888 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:20:16.736528 19888 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:20:16.739889 29089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:16.740612 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:16.740881 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "247b808a5ef746388461f2b917a6d9e5"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-0g1j"
I20260709 12:20:16.741153 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:16.764277 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:16.765264 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:16.766630 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:16.769853 29096 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:20:16.814836 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:20:16.815177 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.046s	user 0.002s	sys 0.000s
I20260709 12:20:16.815447 19888 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:20:16.819715 29096 tablet_bootstrap.cc:492] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:16.829540 29096 tablet_bootstrap.cc:492] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:16.830148 29096 tablet_bootstrap.cc:492] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:16.830655 29096 ts_tablet_manager.cc:1403] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:20:16.832509 29096 raft_consensus.cc:359] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.832998 29096 raft_consensus.cc:740] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:16.833593 29096 consensus_queue.cc:260] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.835815 29096 ts_tablet_manager.cc:1434] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:16.836426 29096 tablet_bootstrap.cc:492] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
W20260709 12:20:16.843518 28821 consensus_peers.cc:597] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40993: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:16.849061 29096 tablet_bootstrap.cc:492] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:16.849793 29096 tablet_bootstrap.cc:492] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:16.850311 29096 ts_tablet_manager.cc:1403] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 12:20:16.852150 19888 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:20:16.852414 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.037s	user 0.038s	sys 0.000s
I20260709 12:20:16.852258 29096 raft_consensus.cc:359] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.852901 29096 raft_consensus.cc:740] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:16.853608 29096 consensus_queue.cc:260] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.855180 29096 ts_tablet_manager.cc:1434] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:20:16.855775 29096 tablet_bootstrap.cc:492] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:16.867374 29096 tablet_bootstrap.cc:492] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:20:16.868343 29096 tablet_bootstrap.cc:492] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:16.868923 29096 ts_tablet_manager.cc:1403] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 12:20:16.870812 29096 raft_consensus.cc:359] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.871490 29096 raft_consensus.cc:740] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:16.872110 29096 consensus_queue.cc:260] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.874239 29096 ts_tablet_manager.cc:1434] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:20:16.875041 29096 tablet_bootstrap.cc:492] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:16.884718 29096 tablet_bootstrap.cc:492] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:16.885424 29096 tablet_bootstrap.cc:492] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:16.885947 29096 ts_tablet_manager.cc:1403] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:20:16.887814 29096 raft_consensus.cc:359] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.888280 29096 raft_consensus.cc:740] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:16.888859 29096 consensus_queue.cc:260] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.890367 29096 ts_tablet_manager.cc:1434] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:20:16.890971 29096 tablet_bootstrap.cc:492] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:16.900405 29096 tablet_bootstrap.cc:492] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:16.900977 29096 tablet_bootstrap.cc:492] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:16.901476 29096 ts_tablet_manager.cc:1403] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:20:16.902294 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:40993
I20260709 12:20:16.902418 29159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:40993 every 8 connection(s)
I20260709 12:20:16.903316 29096 raft_consensus.cc:359] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.903852 29096 raft_consensus.cc:740] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:16.904407 29096 consensus_queue.cc:260] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.906244 29096 ts_tablet_manager.cc:1434] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:20:16.906764 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:16.907034 29096 tablet_bootstrap.cc:492] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:16.919075 29096 tablet_bootstrap.cc:492] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:16.919901 29096 tablet_bootstrap.cc:492] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:16.920498 29096 ts_tablet_manager.cc:1403] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.009s
I20260709 12:20:16.922719 29096 raft_consensus.cc:359] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.923380 29096 raft_consensus.cc:740] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:16.924158 29096 consensus_queue.cc:260] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.926222 29096 ts_tablet_manager.cc:1434] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:20:16.927006 29096 tablet_bootstrap.cc:492] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:16.935773 29160 heartbeater.cc:344] Connected to a master server at 127.19.108.62:35715
I20260709 12:20:16.935730 28854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
mode: GRACEFUL
new_leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:45608
I20260709 12:20:16.936388 29160 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:16.936566 28854 raft_consensus.cc:606] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Received request to transfer leadership to TS 92e3eb6d98624bd29a116f4e92bec65e
I20260709 12:20:16.937361 29160 heartbeater.cc:507] Master 127.19.108.62:35715 requested a full tablet report, sending...
I20260709 12:20:16.939297 29096 tablet_bootstrap.cc:492] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:16.940088 29096 tablet_bootstrap.cc:492] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:16.940739 29096 ts_tablet_manager.cc:1403] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:20:16.940852 28854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
mode: GRACEFUL
new_leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:45608
I20260709 12:20:16.941407 28854 raft_consensus.cc:606] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Received request to transfer leadership to TS 92e3eb6d98624bd29a116f4e92bec65e
I20260709 12:20:16.943300 29096 raft_consensus.cc:359] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.943641 28854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
mode: GRACEFUL
new_leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:45608
I20260709 12:20:16.943930 28677 ts_manager.cc:194] Re-registered known tserver with Master: 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993)
I20260709 12:20:16.944010 29096 raft_consensus.cc:740] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:16.944204 28854 raft_consensus.cc:606] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Received request to transfer leadership to TS 92e3eb6d98624bd29a116f4e92bec65e
I20260709 12:20:16.944841 29096 consensus_queue.cc:260] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.945369 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:16.945916 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:16.946574 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:16.946892 29096 ts_tablet_manager.cc:1434] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:20:16.947727 29096 tablet_bootstrap.cc:492] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:16.956732 28677 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45918
I20260709 12:20:16.959954 29160 heartbeater.cc:499] Master 127.19.108.62:35715 was elected leader, sending a full tablet report...
I20260709 12:20:16.960107 29096 tablet_bootstrap.cc:492] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:16.960934 29096 tablet_bootstrap.cc:492] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:16.961548 29096 ts_tablet_manager.cc:1403] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:20:16.963754 29096 raft_consensus.cc:359] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.964272 29096 raft_consensus.cc:740] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:16.964906 29096 consensus_queue.cc:260] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.966809 29096 ts_tablet_manager.cc:1434] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:20:16.967613 29096 tablet_bootstrap.cc:492] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
I20260709 12:20:16.970259 29133 raft_consensus.cc:3060] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.987766 29096 tablet_bootstrap.cc:492] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:20:16.988705 29096 tablet_bootstrap.cc:492] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:16.989302 29096 ts_tablet_manager.cc:1403] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 12:20:16.991138 29096 raft_consensus.cc:359] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.991706 29096 raft_consensus.cc:740] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:16.992316 29096 consensus_queue.cc:260] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:16.993769 29096 ts_tablet_manager.cc:1434] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:20:16.994349 29096 tablet_bootstrap.cc:492] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap starting.
W20260709 12:20:17.003255 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:17.006153 29096 tablet_bootstrap.cc:492] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:17.006889 29096 tablet_bootstrap.cc:492] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: Bootstrap complete.
I20260709 12:20:17.007462 29096 ts_tablet_manager.cc:1403] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:20:17.009034 29096 raft_consensus.cc:359] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.009481 29096 raft_consensus.cc:740] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247b808a5ef746388461f2b917a6d9e5, State: Initialized, Role: FOLLOWER
I20260709 12:20:17.009956 29096 consensus_queue.cc:260] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.011634 29096 ts_tablet_manager.cc:1434] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:17.078529 29133 raft_consensus.cc:3060] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.083514 29133 pending_rounds.cc:85] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Aborting all ops after (but not including) 0
I20260709 12:20:17.083737 29133 pending_rounds.cc:107] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:20:17.083943 29133 raft_consensus.cc:2889] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:17.117154 29080 raft_consensus.cc:993] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd: : Instructing follower 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:17.118002 29078 raft_consensus.cc:1081] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Signalling peer 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:17.119606 28929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:20:17.120158 28929 raft_consensus.cc:493] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.120478 28929 raft_consensus.cc:3060] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.128409 28929 raft_consensus.cc:515] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.130506 28929 leader_election.cc:290] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:17.131501 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:17.131910 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:17.132146 28854 raft_consensus.cc:3055] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.132488 28854 raft_consensus.cc:740] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:17.132496 29133 raft_consensus.cc:3060] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.133366 28854 consensus_queue.cc:260] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.134619 28854 raft_consensus.cc:3060] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.139514 29133 raft_consensus.cc:2468] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 2.
I20260709 12:20:17.140626 28895 leader_election.cc:304] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:17.141095 28854 raft_consensus.cc:2468] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 2.
I20260709 12:20:17.141341 29077 raft_consensus.cc:2804] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.142661 29077 raft_consensus.cc:697] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:17.143332 29077 consensus_queue.cc:237] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.149767 28677 catalog_manager.cc:5697] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 1 to 2, leader changed from ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2) to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 2 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.172276 29133 raft_consensus.cc:3060] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.179139 29132 raft_consensus.cc:3060] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.185024 29132 pending_rounds.cc:85] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Aborting all ops after (but not including) 0
I20260709 12:20:17.185281 29132 pending_rounds.cc:107] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:20:17.185537 29132 raft_consensus.cc:2889] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:17.188706 29177 raft_consensus.cc:993] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd: : Instructing follower 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:17.189257 29078 raft_consensus.cc:1081] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Signalling peer 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:17.190877 28929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:20:17.191416 28929 raft_consensus.cc:493] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.191709 28929 raft_consensus.cc:3060] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.196772 28929 raft_consensus.cc:515] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.198246 28929 leader_election.cc:290] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:17.199049 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:17.199208 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86b2f735b3e4bcbae8f3b3a74fe327b" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:17.199694 29132 raft_consensus.cc:3060] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.199741 28854 raft_consensus.cc:3055] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.200186 28854 raft_consensus.cc:740] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:17.200968 28854 consensus_queue.cc:260] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.202171 28854 raft_consensus.cc:3060] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.206406 29132 raft_consensus.cc:2468] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 2.
I20260709 12:20:17.207511 28895 leader_election.cc:304] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:17.208154 29077 raft_consensus.cc:2804] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.208622 29077 raft_consensus.cc:697] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:17.208547 28854 raft_consensus.cc:2468] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 2.
I20260709 12:20:17.209503 29077 consensus_queue.cc:237] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.216722 28677 catalog_manager.cc:5697] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 1 to 2, leader changed from ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2) to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 2 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.228510 29177 raft_consensus.cc:993] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd: : Instructing follower 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:17.228863 29078 raft_consensus.cc:1081] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Signalling peer 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:17.230079 28929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:20:17.230484 28929 raft_consensus.cc:493] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.230727 28929 raft_consensus.cc:3060] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:17.234903 28929 raft_consensus.cc:515] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.236301 28929 leader_election.cc:290] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 3 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:17.236863 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:17.237425 29132 raft_consensus.cc:3060] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:17.237569 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c655b4143b4a99a860a2eaea735e47" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:17.238166 28854 raft_consensus.cc:3055] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:17.238480 28854 raft_consensus.cc:740] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:17.239333 28854 consensus_queue.cc:260] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.240550 28854 raft_consensus.cc:3060] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:17.244215 29132 raft_consensus.cc:2468] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 3.
I20260709 12:20:17.245251 28895 leader_election.cc:304] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:17.245859 29077 raft_consensus.cc:2804] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:17.246222 29077 raft_consensus.cc:697] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:17.246644 28854 raft_consensus.cc:2468] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 3.
I20260709 12:20:17.246971 29077 consensus_queue.cc:237] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:17.253162 28677 catalog_manager.cc:5697] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 2 to 3, leader changed from ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2) to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 3 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.524187 29132 raft_consensus.cc:1275] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.525502 29077 consensus_queue.cc:1048] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.536146 28854 raft_consensus.cc:1275] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.537827 29077 consensus_queue.cc:1048] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.605922 28854 raft_consensus.cc:1275] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.607107 29077 consensus_queue.cc:1048] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.616093 29132 raft_consensus.cc:1275] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.617477 29077 consensus_queue.cc:1048] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:17.631209 28854 raft_consensus.cc:1275] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:17.632375 29077 consensus_queue.cc:1048] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:17.642359 29132 raft_consensus.cc:1275] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:17.651319 29200 consensus_queue.cc:1048] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:17.955258 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:17.973484 28929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b81f97b597d945f48281bdae07231e07"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
mode: GRACEFUL
new_leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
 from {username='slave'} at 127.0.0.1:50416
I20260709 12:20:17.973991 28929 raft_consensus.cc:606] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Received request to transfer leadership to TS ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:17.976202 28929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
mode: GRACEFUL
new_leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
 from {username='slave'} at 127.0.0.1:50416
I20260709 12:20:17.976572 28929 raft_consensus.cc:606] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Received request to transfer leadership to TS ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:17.977468 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:17.977883 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:17.978549 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:18.004235 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:18.062536 29077 raft_consensus.cc:993] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e: : Instructing follower ed68bbc4749e4425b6d345f2223fafdd to start an election
I20260709 12:20:18.063140 29200 raft_consensus.cc:1081] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Signalling peer ed68bbc4749e4425b6d345f2223fafdd to start an election
I20260709 12:20:18.064792 28854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
 from {username='slave'} at 127.0.0.1:45606
I20260709 12:20:18.065425 28854 raft_consensus.cc:493] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.065771 28854 raft_consensus.cc:3060] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.072882 28854 raft_consensus.cc:515] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:18.074642 28854 leader_election.cc:290] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 3 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:18.075592 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:18.076336 29133 raft_consensus.cc:3060] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.076277 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f999518ffceb48ddb27d03dc95e5d0ec" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:18.077049 28928 raft_consensus.cc:3055] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:18.077324 28928 raft_consensus.cc:740] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:18.078200 28928 consensus_queue.cc:260] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:18.079281 28928 raft_consensus.cc:3060] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.082592 29133 raft_consensus.cc:2468] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 3.
I20260709 12:20:18.083659 28821 leader_election.cc:304] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:18.084476 29080 raft_consensus.cc:2804] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:18.084884 29080 raft_consensus.cc:697] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 3 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:18.085888 28928 raft_consensus.cc:2468] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 3.
I20260709 12:20:18.085821 29080 consensus_queue.cc:237] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:18.092608 28674 catalog_manager.cc:5697] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 2 to 3, leader changed from 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3) to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 3 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.169082 29077 raft_consensus.cc:993] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e: : Instructing follower ed68bbc4749e4425b6d345f2223fafdd to start an election
I20260709 12:20:18.169451 29200 raft_consensus.cc:1081] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Signalling peer ed68bbc4749e4425b6d345f2223fafdd to start an election
I20260709 12:20:18.170759 28854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b81f97b597d945f48281bdae07231e07"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
 from {username='slave'} at 127.0.0.1:45606
I20260709 12:20:18.171232 28854 raft_consensus.cc:493] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.171514 28854 raft_consensus.cc:3060] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.178118 28854 raft_consensus.cc:515] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:18.179963 28854 leader_election.cc:290] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:18.180536 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81f97b597d945f48281bdae07231e07" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:18.180959 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81f97b597d945f48281bdae07231e07" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:18.181180 29133 raft_consensus.cc:3060] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.181522 28928 raft_consensus.cc:3055] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:18.181864 28928 raft_consensus.cc:740] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:18.182611 28928 consensus_queue.cc:260] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:18.183624 28928 raft_consensus.cc:3060] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.186335 29133 raft_consensus.cc:2468] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 2.
I20260709 12:20:18.187556 28821 leader_election.cc:304] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:18.188401 29080 raft_consensus.cc:2804] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:18.188858 29080 raft_consensus.cc:697] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:18.188796 28928 raft_consensus.cc:2468] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 2.
I20260709 12:20:18.190178 29080 consensus_queue.cc:237] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:18.197149 28674 catalog_manager.cc:5697] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 1 to 2, leader changed from 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3) to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 2 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.502522 29133 raft_consensus.cc:1275] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:18.503553 29080 consensus_queue.cc:1048] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:18.513504 28928 raft_consensus.cc:1275] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:18.515023 29080 consensus_queue.cc:1048] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:18.594656 28928 raft_consensus.cc:1275] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:18.595921 29213 consensus_queue.cc:1048] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.605736 29133 raft_consensus.cc:1275] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:18.608035 29080 consensus_queue.cc:1048] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.985358 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:18.992120 28854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
mode: GRACEFUL
new_leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:45608
I20260709 12:20:18.992579 28854 raft_consensus.cc:606] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Received request to transfer leadership to TS 92e3eb6d98624bd29a116f4e92bec65e
I20260709 12:20:18.994956 28854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
mode: GRACEFUL
new_leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:45608
I20260709 12:20:18.995389 28854 raft_consensus.cc:606] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Received request to transfer leadership to TS 92e3eb6d98624bd29a116f4e92bec65e
I20260709 12:20:18.996330 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:18.996721 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:18.997200 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:19.005021 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:19.053611 29213 raft_consensus.cc:993] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd: : Instructing follower 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:19.054087 29217 raft_consensus.cc:1081] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Signalling peer 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:19.055378 28928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:20:19.055796 28928 raft_consensus.cc:493] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.056072 28928 raft_consensus.cc:3060] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.061241 28928 raft_consensus.cc:515] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:19.062770 28928 leader_election.cc:290] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 3 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:19.063531 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:19.063803 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd59cfed15884fd7830ecb836f0c1697" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:19.064208 29133 raft_consensus.cc:3060] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.064368 28854 raft_consensus.cc:3055] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:19.064779 28854 raft_consensus.cc:740] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:19.065697 28854 consensus_queue.cc:260] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:19.066929 28854 raft_consensus.cc:3060] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.071085 29133 raft_consensus.cc:2468] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 3.
I20260709 12:20:19.072233 28895 leader_election.cc:304] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:19.072973 29200 raft_consensus.cc:2804] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:19.073624 28854 raft_consensus.cc:2468] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 3.
I20260709 12:20:19.074867 29200 raft_consensus.cc:697] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:19.075930 29200 consensus_queue.cc:237] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:19.082422 28675 catalog_manager.cc:5697] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 2 to 3, leader changed from ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2) to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 3 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.254824 29213 raft_consensus.cc:993] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd: : Instructing follower 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:19.255239 29217 raft_consensus.cc:1081] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Signalling peer 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:19.256552 28928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:20:19.256999 28928 raft_consensus.cc:493] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.257277 28928 raft_consensus.cc:3060] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.262599 28928 raft_consensus.cc:515] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:19.264140 28928 leader_election.cc:290] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:19.264776 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:19.265048 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ee776e29d574b1f90bae00b33900f28" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:19.265353 29133 raft_consensus.cc:3060] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.265574 28854 raft_consensus.cc:3055] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.265857 28854 raft_consensus.cc:740] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:19.266487 28854 consensus_queue.cc:260] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:19.267390 28854 raft_consensus.cc:3060] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.270399 29133 raft_consensus.cc:2468] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 2.
I20260709 12:20:19.271451 28895 leader_election.cc:304] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:19.271811 28854 raft_consensus.cc:2468] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 2.
I20260709 12:20:19.272251 29200 raft_consensus.cc:2804] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.272716 29200 raft_consensus.cc:697] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:19.273509 29200 consensus_queue.cc:237] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:19.279865 28675 catalog_manager.cc:5697] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 1 to 2, leader changed from ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2) to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 2 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.549007 28854 raft_consensus.cc:1275] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:19.550056 29200 consensus_queue.cc:1048] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:19.560891 29133 raft_consensus.cc:1275] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:19.562083 29200 consensus_queue.cc:1048] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:19.725965 28854 raft_consensus.cc:1275] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:19.727164 29220 consensus_queue.cc:1048] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:19.735368 29133 raft_consensus.cc:1275] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:19.736860 29200 consensus_queue.cc:1048] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.002816 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:20.005800 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:20.010469 28928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
mode: GRACEFUL
new_leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
 from {username='slave'} at 127.0.0.1:50416
I20260709 12:20:20.011052 28928 raft_consensus.cc:606] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Received request to transfer leadership to TS ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:20.013144 28928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
mode: GRACEFUL
new_leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
 from {username='slave'} at 127.0.0.1:50416
I20260709 12:20:20.013557 28928 raft_consensus.cc:606] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Received request to transfer leadership to TS ed68bbc4749e4425b6d345f2223fafdd
I20260709 12:20:20.014410 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:20.014909 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:20.015571 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:20.042038 29220 raft_consensus.cc:993] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e: : Instructing follower ed68bbc4749e4425b6d345f2223fafdd to start an election
I20260709 12:20:20.042495 29200 raft_consensus.cc:1081] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Signalling peer ed68bbc4749e4425b6d345f2223fafdd to start an election
I20260709 12:20:20.043795 28854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
 from {username='slave'} at 127.0.0.1:45606
I20260709 12:20:20.044178 28854 raft_consensus.cc:493] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.044495 28854 raft_consensus.cc:3060] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.049165 28854 raft_consensus.cc:515] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:20.050693 28854 leader_election.cc:290] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:20.051326 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:20.051743 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3f4d1197a54b89bee9d5d07a9c748b" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:20.051882 29132 raft_consensus.cc:3060] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.052297 28928 raft_consensus.cc:3055] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:20.052572 28928 raft_consensus.cc:740] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:20.053292 28928 consensus_queue.cc:260] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:20.054224 28928 raft_consensus.cc:3060] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.057556 29132 raft_consensus.cc:2468] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 2.
I20260709 12:20:20.058456 28821 leader_election.cc:304] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:20.059195 29217 raft_consensus.cc:2804] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.059254 28928 raft_consensus.cc:2468] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 2.
I20260709 12:20:20.060129 29217 raft_consensus.cc:697] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:20.060860 29217 consensus_queue.cc:237] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:20.067348 28675 catalog_manager.cc:5697] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 1 to 2, leader changed from 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3) to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 2 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.348357 29200 raft_consensus.cc:993] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e: : Instructing follower ed68bbc4749e4425b6d345f2223fafdd to start an election
I20260709 12:20:20.348794 29219 raft_consensus.cc:1081] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Signalling peer ed68bbc4749e4425b6d345f2223fafdd to start an election
I20260709 12:20:20.350104 28854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
 from {username='slave'} at 127.0.0.1:45606
I20260709 12:20:20.350513 28854 raft_consensus.cc:493] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.350884 28854 raft_consensus.cc:3060] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.355482 28854 raft_consensus.cc:515] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:20.356709 28854 leader_election.cc:290] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 3 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3:45733)
I20260709 12:20:20.357339 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:20.357643 28928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e47265099aa41018d1ae8cf1d3359c9" candidate_uuid: "ed68bbc4749e4425b6d345f2223fafdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
I20260709 12:20:20.357975 29132 raft_consensus.cc:3060] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.358201 28928 raft_consensus.cc:3055] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:20.358500 28928 raft_consensus.cc:740] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:20.359278 28928 consensus_queue.cc:260] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:20.360446 28928 raft_consensus.cc:3060] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.364622 29132 raft_consensus.cc:2468] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 3.
I20260709 12:20:20.365751 28821 leader_election.cc:304] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, ed68bbc4749e4425b6d345f2223fafdd; no voters: 
I20260709 12:20:20.366338 28928 raft_consensus.cc:2468] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed68bbc4749e4425b6d345f2223fafdd in term 3.
I20260709 12:20:20.366354 29217 raft_consensus.cc:2804] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:20.366927 29217 raft_consensus.cc:697] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 3 LEADER]: Becoming Leader. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:20.367743 29217 consensus_queue.cc:237] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:20.374147 28675 catalog_manager.cc:5697] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd reported cstate change: term changed from 2 to 3, leader changed from 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3) to ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2). New cstate: current_term: 3 leader_uuid: "ed68bbc4749e4425b6d345f2223fafdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.465126 28928 raft_consensus.cc:1275] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.466068 29217 consensus_queue.cc:1048] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.476657 29132 raft_consensus.cc:1275] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.478246 29234 consensus_queue.cc:1048] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.857007 28928 raft_consensus.cc:1275] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:20.858038 29217 consensus_queue.cc:1048] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.865587 29133 raft_consensus.cc:1275] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Refusing update from remote peer ed68bbc4749e4425b6d345f2223fafdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:20.867412 29234 consensus_queue.cc:1048] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:21.006605 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:21.023420 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:21.030177 28854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
mode: GRACEFUL
new_leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:45608
I20260709 12:20:21.030670 28854 raft_consensus.cc:606] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Received request to transfer leadership to TS 92e3eb6d98624bd29a116f4e92bec65e
I20260709 12:20:21.032652 28854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b81f97b597d945f48281bdae07231e07"
dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
mode: GRACEFUL
new_leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:45608
I20260709 12:20:21.033010 28854 raft_consensus.cc:606] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Received request to transfer leadership to TS 92e3eb6d98624bd29a116f4e92bec65e
I20260709 12:20:21.033798 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:21.034192 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:21.034641 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:21.160092 29242 raft_consensus.cc:993] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd: : Instructing follower 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:21.160512 29234 raft_consensus.cc:1081] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Signalling peer 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:21.161724 28928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b81f97b597d945f48281bdae07231e07"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:20:21.162137 28928 raft_consensus.cc:493] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.162376 28928 raft_consensus.cc:3060] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:21.166576 28928 raft_consensus.cc:515] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:21.167879 28928 leader_election.cc:290] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 3 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:21.168557 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81f97b597d945f48281bdae07231e07" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:21.168684 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81f97b597d945f48281bdae07231e07" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:21.169040 29133 raft_consensus.cc:3060] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:21.169203 28854 raft_consensus.cc:3055] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:21.169595 28854 raft_consensus.cc:740] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:21.170183 28854 consensus_queue.cc:260] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:21.171010 28854 raft_consensus.cc:3060] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:21.173549 29133 raft_consensus.cc:2468] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 3.
I20260709 12:20:21.174409 28895 leader_election.cc:304] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:21.175159 29219 raft_consensus.cc:2804] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:21.175525 29219 raft_consensus.cc:697] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:21.175562 28854 raft_consensus.cc:2468] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 3.
I20260709 12:20:21.176290 29219 consensus_queue.cc:237] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:21.183576 28675 catalog_manager.cc:5697] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 2 to 3, leader changed from ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2) to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 3 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:21.438933 29217 raft_consensus.cc:993] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd: : Instructing follower 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:21.439355 29234 raft_consensus.cc:1081] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Signalling peer 92e3eb6d98624bd29a116f4e92bec65e to start an election
I20260709 12:20:21.440623 28928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988"
dest_uuid: "92e3eb6d98624bd29a116f4e92bec65e"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:20:21.441033 28928 raft_consensus.cc:493] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.441277 28928 raft_consensus.cc:3060] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.445765 28928 raft_consensus.cc:515] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:21.447062 28928 leader_election.cc:290] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Requested vote from peers 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993), ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923)
I20260709 12:20:21.447796 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "247b808a5ef746388461f2b917a6d9e5"
I20260709 12:20:21.448006 28854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dbcabf88e84fc2ba9c1f20a7aca988" candidate_uuid: "92e3eb6d98624bd29a116f4e92bec65e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed68bbc4749e4425b6d345f2223fafdd"
I20260709 12:20:21.448396 29133 raft_consensus.cc:3060] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.448525 28854 raft_consensus.cc:3055] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:21.448886 28854 raft_consensus.cc:740] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed68bbc4749e4425b6d345f2223fafdd, State: Running, Role: LEADER
I20260709 12:20:21.449658 28854 consensus_queue.cc:260] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:21.450891 28854 raft_consensus.cc:3060] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.454465 29133 raft_consensus.cc:2468] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 2.
I20260709 12:20:21.455526 28895 leader_election.cc:304] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247b808a5ef746388461f2b917a6d9e5, 92e3eb6d98624bd29a116f4e92bec65e; no voters: 
I20260709 12:20:21.456256 29219 raft_consensus.cc:2804] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:21.456609 29219 raft_consensus.cc:697] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Becoming Leader. State: Replica: 92e3eb6d98624bd29a116f4e92bec65e, State: Running, Role: LEADER
I20260709 12:20:21.456624 28854 raft_consensus.cc:2468] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92e3eb6d98624bd29a116f4e92bec65e in term 2.
I20260709 12:20:21.457574 29219 consensus_queue.cc:237] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } }
I20260709 12:20:21.463595 28675 catalog_manager.cc:5697] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e reported cstate change: term changed from 1 to 2, leader changed from ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2) to 92e3eb6d98624bd29a116f4e92bec65e (127.19.108.3). New cstate: current_term: 2 leader_uuid: "92e3eb6d98624bd29a116f4e92bec65e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92e3eb6d98624bd29a116f4e92bec65e" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:21.672271 28854 raft_consensus.cc:1275] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:21.673352 29200 consensus_queue.cc:1048] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:21.681921 29132 raft_consensus.cc:1275] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:21.683966 29219 consensus_queue.cc:1048] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:21.860106 28853 raft_consensus.cc:1275] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:21.861196 29219 consensus_queue.cc:1048] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed68bbc4749e4425b6d345f2223fafdd" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:21.871711 29133 raft_consensus.cc:1275] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Refusing update from remote peer 92e3eb6d98624bd29a116f4e92bec65e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:21.873762 29256 consensus_queue.cc:1048] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [LEADER]: Connected to new peer: Peer: permanent_uuid: "247b808a5ef746388461f2b917a6d9e5" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:22.007448 28726 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:22.040300 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:22.069412 19888 tablet_server.cc:179] TabletServer@127.19.108.1:40993 shutting down...
W20260709 12:20:22.081286 28821 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 70 similar messages]
W20260709 12:20:22.084673 28821 consensus_peers.cc:597] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:22.089424 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:22.090129 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.090788 19888 raft_consensus.cc:2243] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.091295 19888 raft_consensus.cc:2272] T b81f97b597d945f48281bdae07231e07 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.094055 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.094525 19888 raft_consensus.cc:2243] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.094903 19888 raft_consensus.cc:2272] T bd59cfed15884fd7830ecb836f0c1697 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.096906 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.097472 19888 raft_consensus.cc:2243] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.097843 19888 raft_consensus.cc:2272] T 6ee776e29d574b1f90bae00b33900f28 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.100068 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.100536 19888 raft_consensus.cc:2243] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.100894 19888 raft_consensus.cc:2272] T d86b2f735b3e4bcbae8f3b3a74fe327b P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.102732 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.103219 19888 raft_consensus.cc:2243] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.103602 19888 raft_consensus.cc:2272] T 74c655b4143b4a99a860a2eaea735e47 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.105443 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.105950 19888 raft_consensus.cc:2243] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.106334 19888 raft_consensus.cc:2272] T 4e47265099aa41018d1ae8cf1d3359c9 P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.108243 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.108707 19888 raft_consensus.cc:2243] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.109099 19888 raft_consensus.cc:2272] T 662d50871dac45fbb88f4eb92f5e81d8 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.112190 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.112931 19888 raft_consensus.cc:2243] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.113456 19888 raft_consensus.cc:2272] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:22.115180 28895 consensus_peers.cc:597] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:22.116459 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.117146 19888 raft_consensus.cc:2243] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.117522 19888 raft_consensus.cc:2272] T f999518ffceb48ddb27d03dc95e5d0ec P 247b808a5ef746388461f2b917a6d9e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.119500 19888 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:22.119913 19888 raft_consensus.cc:2243] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.120254 19888 raft_consensus.cc:2272] T 0b3f4d1197a54b89bee9d5d07a9c748b P 247b808a5ef746388461f2b917a6d9e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:22.130185 28895 consensus_peers.cc:597] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:22.133212 28895 consensus_peers.cc:597] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer 247b808a5ef746388461f2b917a6d9e5 (127.19.108.1:40993): Couldn't send request to peer 247b808a5ef746388461f2b917a6d9e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:22.152750 19888 tablet_server.cc:196] TabletServer@127.19.108.1:40993 shutdown complete.
I20260709 12:20:22.176035 19888 tablet_server.cc:179] TabletServer@127.19.108.2:0 shutting down...
I20260709 12:20:22.196412 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:22.197089 19888 tablet_replica.cc:333] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.197992 19888 raft_consensus.cc:2243] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.198927 19888 raft_consensus.cc:2272] T 4e47265099aa41018d1ae8cf1d3359c9 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.201012 19888 tablet_replica.cc:333] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.201663 19888 raft_consensus.cc:2243] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.202039 19888 raft_consensus.cc:2272] T b81f97b597d945f48281bdae07231e07 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.204308 19888 tablet_replica.cc:333] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.204808 19888 raft_consensus.cc:2243] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.205180 19888 raft_consensus.cc:2272] T 97dbcabf88e84fc2ba9c1f20a7aca988 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.208045 19888 tablet_replica.cc:333] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.208547 19888 raft_consensus.cc:2243] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:22.208868 28894 consensus_peers.cc:597] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923): Couldn't send request to peer ed68bbc4749e4425b6d345f2223fafdd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:22.208907 19888 raft_consensus.cc:2272] T bd59cfed15884fd7830ecb836f0c1697 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.210928 19888 tablet_replica.cc:333] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.211440 19888 raft_consensus.cc:2243] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.212163 19888 raft_consensus.cc:2272] T 662d50871dac45fbb88f4eb92f5e81d8 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.214046 19888 tablet_replica.cc:333] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.214527 19888 raft_consensus.cc:2243] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.214954 19888 raft_consensus.cc:2272] T 74c655b4143b4a99a860a2eaea735e47 P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.216801 19888 tablet_replica.cc:333] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.217252 19888 raft_consensus.cc:2243] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.217646 19888 raft_consensus.cc:2272] T d86b2f735b3e4bcbae8f3b3a74fe327b P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.219609 19888 tablet_replica.cc:333] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.220103 19888 raft_consensus.cc:2243] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.220458 19888 raft_consensus.cc:2272] T 6ee776e29d574b1f90bae00b33900f28 P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.222256 19888 tablet_replica.cc:333] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.222697 19888 raft_consensus.cc:2243] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.223390 19888 raft_consensus.cc:2272] T f999518ffceb48ddb27d03dc95e5d0ec P ed68bbc4749e4425b6d345f2223fafdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.225289 19888 tablet_replica.cc:333] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd: stopping tablet replica
I20260709 12:20:22.225715 19888 raft_consensus.cc:2243] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.226382 19888 raft_consensus.cc:2272] T 0b3f4d1197a54b89bee9d5d07a9c748b P ed68bbc4749e4425b6d345f2223fafdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.245697 19888 tablet_server.cc:196] TabletServer@127.19.108.2:0 shutdown complete.
I20260709 12:20:22.267974 19888 tablet_server.cc:179] TabletServer@127.19.108.3:0 shutting down...
I20260709 12:20:22.289548 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:22.290166 19888 tablet_replica.cc:333] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.290819 19888 raft_consensus.cc:2243] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.291385 19888 raft_consensus.cc:2272] T 662d50871dac45fbb88f4eb92f5e81d8 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.293560 19888 tablet_replica.cc:333] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.294095 19888 raft_consensus.cc:2243] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.294492 19888 raft_consensus.cc:2272] T 4e47265099aa41018d1ae8cf1d3359c9 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.296737 19888 tablet_replica.cc:333] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.297523 19888 raft_consensus.cc:2243] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.297971 19888 raft_consensus.cc:2272] T f999518ffceb48ddb27d03dc95e5d0ec P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:22.299047 28894 consensus_peers.cc:597] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e -> Peer ed68bbc4749e4425b6d345f2223fafdd (127.19.108.2:35923): Couldn't send request to peer ed68bbc4749e4425b6d345f2223fafdd. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:35923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:22.300159 19888 tablet_replica.cc:333] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.300736 19888 raft_consensus.cc:2243] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.301409 19888 raft_consensus.cc:2272] T bd59cfed15884fd7830ecb836f0c1697 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.303201 19888 tablet_replica.cc:333] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.303686 19888 raft_consensus.cc:2243] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.304394 19888 raft_consensus.cc:2272] T b81f97b597d945f48281bdae07231e07 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.306411 19888 tablet_replica.cc:333] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.306864 19888 raft_consensus.cc:2243] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.307551 19888 raft_consensus.cc:2272] T 6ee776e29d574b1f90bae00b33900f28 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.309351 19888 tablet_replica.cc:333] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.309803 19888 raft_consensus.cc:2243] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.310431 19888 raft_consensus.cc:2272] T d86b2f735b3e4bcbae8f3b3a74fe327b P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.312191 19888 tablet_replica.cc:333] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.312640 19888 raft_consensus.cc:2243] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.313342 19888 raft_consensus.cc:2272] T 74c655b4143b4a99a860a2eaea735e47 P 92e3eb6d98624bd29a116f4e92bec65e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.315214 19888 tablet_replica.cc:333] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.315644 19888 raft_consensus.cc:2243] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:22.315985 19888 raft_consensus.cc:2272] T 0b3f4d1197a54b89bee9d5d07a9c748b P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.317685 19888 tablet_replica.cc:333] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e: stopping tablet replica
I20260709 12:20:22.318104 19888 raft_consensus.cc:2243] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.318744 19888 raft_consensus.cc:2272] T 97dbcabf88e84fc2ba9c1f20a7aca988 P 92e3eb6d98624bd29a116f4e92bec65e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.348058 19888 tablet_server.cc:196] TabletServer@127.19.108.3:0 shutdown complete.
I20260709 12:20:22.369132 19888 master.cc:562] Master@127.19.108.62:35715 shutting down...
I20260709 12:20:22.388777 19888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.389235 19888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.389513 19888 tablet_replica.cc:333] T 00000000000000000000000000000000 P b81e57cc76664a9092439787cf5115bd: stopping tablet replica
I20260709 12:20:22.409332 19888 master.cc:584] Master@127.19.108.62:35715 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12576 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:20:22.446897 19888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.108.62:37733
I20260709 12:20:22.447929 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:22.453070 29269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.453089 29270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.453737 29272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:22.455433 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:22.456317 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:22.456490 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:22.456647 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599622456630 us; error 0 us; skew 500 ppm
I20260709 12:20:22.457165 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:22.459534 19888 webserver.cc:533] Webserver started at http://127.19.108.62:41337/ using document root <none> and password file <none>
I20260709 12:20:22.459995 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:22.460162 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:22.460408 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:22.461428 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/master-0-root/instance:
uuid: "219ac2987fd24de193bdca4ac192af86"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-0g1j"
I20260709 12:20:22.465391 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:20:22.468384 29277 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.469002 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:20:22.469259 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/master-0-root
uuid: "219ac2987fd24de193bdca4ac192af86"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-0g1j"
I20260709 12:20:22.469481 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:22.480953 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:22.482151 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:22.517386 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.62:37733
I20260709 12:20:22.517498 29329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.62:37733 every 8 connection(s)
I20260709 12:20:22.520975 29330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:22.531327 29330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86: Bootstrap starting.
I20260709 12:20:22.535795 29330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.539556 29330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86: No bootstrap required, opened a new log
I20260709 12:20:22.541497 29330 raft_consensus.cc:359] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "219ac2987fd24de193bdca4ac192af86" member_type: VOTER }
I20260709 12:20:22.541834 29330 raft_consensus.cc:385] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.542017 29330 raft_consensus.cc:740] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 219ac2987fd24de193bdca4ac192af86, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.542469 29330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "219ac2987fd24de193bdca4ac192af86" member_type: VOTER }
I20260709 12:20:22.542883 29330 raft_consensus.cc:399] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:22.543107 29330 raft_consensus.cc:493] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:22.543308 29330 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.547207 29330 raft_consensus.cc:515] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "219ac2987fd24de193bdca4ac192af86" member_type: VOTER }
I20260709 12:20:22.547627 29330 leader_election.cc:304] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 219ac2987fd24de193bdca4ac192af86; no voters: 
I20260709 12:20:22.548542 29330 leader_election.cc:290] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:22.548808 29333 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.549961 29333 raft_consensus.cc:697] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 1 LEADER]: Becoming Leader. State: Replica: 219ac2987fd24de193bdca4ac192af86, State: Running, Role: LEADER
I20260709 12:20:22.550577 29333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "219ac2987fd24de193bdca4ac192af86" member_type: VOTER }
I20260709 12:20:22.551172 29330 sys_catalog.cc:565] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:22.554323 29334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "219ac2987fd24de193bdca4ac192af86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "219ac2987fd24de193bdca4ac192af86" member_type: VOTER } }
I20260709 12:20:22.554924 29334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:22.555068 29335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 219ac2987fd24de193bdca4ac192af86. Latest consensus state: current_term: 1 leader_uuid: "219ac2987fd24de193bdca4ac192af86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "219ac2987fd24de193bdca4ac192af86" member_type: VOTER } }
I20260709 12:20:22.555735 29335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:22.560930 29340 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:22.565487 29340 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:22.568563 19888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:22.573730 29340 catalog_manager.cc:1383] Generated new cluster ID: 40bc169983744d608347b7dbf78e607e
I20260709 12:20:22.573985 29340 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:22.595482 29340 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:22.596669 29340 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:22.609174 29340 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86: Generated new TSK 0
I20260709 12:20:22.609688 29340 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:22.634831 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:22.640236 29351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.641036 29352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.642347 29354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:22.642823 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:22.643628 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:22.643808 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:22.643985 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599622643958 us; error 0 us; skew 500 ppm
I20260709 12:20:22.644476 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:22.646459 19888 webserver.cc:533] Webserver started at http://127.19.108.1:40685/ using document root <none> and password file <none>
I20260709 12:20:22.646946 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:22.647125 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:22.647372 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:22.648370 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-0-root/instance:
uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-0g1j"
I20260709 12:20:22.652509 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:22.655522 29359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.656179 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:22.656425 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-0g1j"
I20260709 12:20:22.656674 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:22.673265 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:22.674317 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:22.675666 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:22.677696 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:22.677874 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.678092 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:22.678253 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.714936 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:40097
I20260709 12:20:22.715046 29421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:40097 every 8 connection(s)
I20260709 12:20:22.719681 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:22.726011 29426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.726539 29427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:22.729470 19888 server_base.cc:1061] running on GCE node
W20260709 12:20:22.729311 29429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:22.731027 29422 heartbeater.cc:344] Connected to a master server at 127.19.108.62:37733
I20260709 12:20:22.731078 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:22.731436 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:22.731459 29422 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:22.731647 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599622731628 us; error 0 us; skew 500 ppm
I20260709 12:20:22.732280 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:22.732260 29422 heartbeater.cc:507] Master 127.19.108.62:37733 requested a full tablet report, sending...
I20260709 12:20:22.734490 29294 ts_manager.cc:194] Registered new tserver with Master: 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1:40097)
I20260709 12:20:22.734731 19888 webserver.cc:533] Webserver started at http://127.19.108.2:44849/ using document root <none> and password file <none>
I20260709 12:20:22.735450 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:22.735688 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:22.735991 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:22.736960 29294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49474
I20260709 12:20:22.737497 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-1-root/instance:
uuid: "1aec3617f199427e8005d08c4f1934d8"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-0g1j"
I20260709 12:20:22.741789 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:22.744694 29434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.745354 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:20:22.745584 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-1-root
uuid: "1aec3617f199427e8005d08c4f1934d8"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-0g1j"
I20260709 12:20:22.745801 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:22.761577 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:22.762573 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:22.763957 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:22.765925 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:22.766096 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.766280 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:22.766400 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.802886 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.2:44473
I20260709 12:20:22.803009 29497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.2:44473 every 8 connection(s)
I20260709 12:20:22.807327 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:22.813714 29501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.814520 29502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.816685 29504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:22.816958 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:22.818070 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:22.818321 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:22.818379 29498 heartbeater.cc:344] Connected to a master server at 127.19.108.62:37733
I20260709 12:20:22.818534 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599622818514 us; error 0 us; skew 500 ppm
I20260709 12:20:22.818801 29498 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:22.819202 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:22.819559 29498 heartbeater.cc:507] Master 127.19.108.62:37733 requested a full tablet report, sending...
I20260709 12:20:22.821614 19888 webserver.cc:533] Webserver started at http://127.19.108.3:46367/ using document root <none> and password file <none>
I20260709 12:20:22.821619 29294 ts_manager.cc:194] Registered new tserver with Master: 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473)
I20260709 12:20:22.822223 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:22.822443 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:22.822685 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:22.823191 29294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49476
I20260709 12:20:22.823814 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-2-root/instance:
uuid: "325a991f37ce4925a7f249e5b0ce1f41"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-0g1j"
I20260709 12:20:22.828006 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:22.830920 29509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.831595 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:22.831848 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-2-root
uuid: "325a991f37ce4925a7f249e5b0ce1f41"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-0g1j"
I20260709 12:20:22.832108 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599318085381-19888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:22.848589 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:22.849583 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:22.850876 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:22.852996 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:22.853178 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.853392 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:22.853543 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.890465 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.3:45013
I20260709 12:20:22.890563 29571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.3:45013 every 8 connection(s)
I20260709 12:20:22.903463 29572 heartbeater.cc:344] Connected to a master server at 127.19.108.62:37733
I20260709 12:20:22.903861 29572 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:22.904510 29572 heartbeater.cc:507] Master 127.19.108.62:37733 requested a full tablet report, sending...
I20260709 12:20:22.906216 29294 ts_manager.cc:194] Registered new tserver with Master: 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3:45013)
I20260709 12:20:22.906530 19888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013105771s
I20260709 12:20:22.907553 29294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49484
I20260709 12:20:22.928674 29294 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49494:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:22.930646 29294 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:22.970685 29387 tablet_service.cc:1511] Processing CreateTablet for tablet c73208af4344408eb04284332955c104 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3da7bf0efee94a51aff5b541a6522b70]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:22.972136 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c73208af4344408eb04284332955c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:22.980808 29386 tablet_service.cc:1511] Processing CreateTablet for tablet 9d74c5ca776c465ca9f4db16732d4536 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3da7bf0efee94a51aff5b541a6522b70]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:22.982210 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d74c5ca776c465ca9f4db16732d4536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.002341 29587 tablet_bootstrap.cc:492] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1: Bootstrap starting.
I20260709 12:20:23.006114 29462 tablet_service.cc:1511] Processing CreateTablet for tablet c73208af4344408eb04284332955c104 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3da7bf0efee94a51aff5b541a6522b70]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:23.006453 29461 tablet_service.cc:1511] Processing CreateTablet for tablet 9d74c5ca776c465ca9f4db16732d4536 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3da7bf0efee94a51aff5b541a6522b70]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:23.007513 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c73208af4344408eb04284332955c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.006599 29537 tablet_service.cc:1511] Processing CreateTablet for tablet c73208af4344408eb04284332955c104 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3da7bf0efee94a51aff5b541a6522b70]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:23.007789 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 9d74c5ca776c465ca9f4db16732d4536 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3da7bf0efee94a51aff5b541a6522b70]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:23.008864 29461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d74c5ca776c465ca9f4db16732d4536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.010763 29537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c73208af4344408eb04284332955c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.011377 29587 tablet_bootstrap.cc:654] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.014784 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d74c5ca776c465ca9f4db16732d4536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.026577 29587 tablet_bootstrap.cc:492] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1: No bootstrap required, opened a new log
I20260709 12:20:23.027132 29587 ts_tablet_manager.cc:1403] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 12:20:23.030025 29587 raft_consensus.cc:359] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.030696 29587 raft_consensus.cc:385] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.031004 29587 raft_consensus.cc:740] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.031711 29587 consensus_queue.cc:260] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.034551 29589 tablet_bootstrap.cc:492] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8: Bootstrap starting.
I20260709 12:20:23.034802 29590 tablet_bootstrap.cc:492] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41: Bootstrap starting.
I20260709 12:20:23.035703 29422 heartbeater.cc:499] Master 127.19.108.62:37733 was elected leader, sending a full tablet report...
I20260709 12:20:23.036139 29587 ts_tablet_manager.cc:1434] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:20:23.037088 29587 tablet_bootstrap.cc:492] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1: Bootstrap starting.
I20260709 12:20:23.041072 29590 tablet_bootstrap.cc:654] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.041431 29589 tablet_bootstrap.cc:654] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.042855 29587 tablet_bootstrap.cc:654] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.054195 29589 tablet_bootstrap.cc:492] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8: No bootstrap required, opened a new log
I20260709 12:20:23.054520 29590 tablet_bootstrap.cc:492] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41: No bootstrap required, opened a new log
I20260709 12:20:23.054591 29589 ts_tablet_manager.cc:1403] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 12:20:23.054539 29587 tablet_bootstrap.cc:492] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1: No bootstrap required, opened a new log
I20260709 12:20:23.055169 29590 ts_tablet_manager.cc:1403] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:20:23.055425 29587 ts_tablet_manager.cc:1403] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:20:23.057329 29589 raft_consensus.cc:359] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.057880 29589 raft_consensus.cc:385] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.058102 29589 raft_consensus.cc:740] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aec3617f199427e8005d08c4f1934d8, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.058358 29590 raft_consensus.cc:359] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.058631 29587 raft_consensus.cc:359] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.058749 29589 consensus_queue.cc:260] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.059121 29590 raft_consensus.cc:385] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.059427 29587 raft_consensus.cc:385] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.059572 29590 raft_consensus.cc:740] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 325a991f37ce4925a7f249e5b0ce1f41, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.059773 29587 raft_consensus.cc:740] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.060497 29587 consensus_queue.cc:260] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.060935 29590 consensus_queue.cc:260] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.062538 29587 ts_tablet_manager.cc:1434] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:23.066937 29498 heartbeater.cc:499] Master 127.19.108.62:37733 was elected leader, sending a full tablet report...
I20260709 12:20:23.067987 29589 ts_tablet_manager.cc:1434] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:20:23.069031 29589 tablet_bootstrap.cc:492] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8: Bootstrap starting.
I20260709 12:20:23.070959 29590 ts_tablet_manager.cc:1434] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.009s
I20260709 12:20:23.071864 29572 heartbeater.cc:499] Master 127.19.108.62:37733 was elected leader, sending a full tablet report...
I20260709 12:20:23.075212 29590 tablet_bootstrap.cc:492] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41: Bootstrap starting.
I20260709 12:20:23.076834 29589 tablet_bootstrap.cc:654] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.081947 29590 tablet_bootstrap.cc:654] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.088212 29589 tablet_bootstrap.cc:492] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8: No bootstrap required, opened a new log
I20260709 12:20:23.088673 29589 ts_tablet_manager.cc:1403] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:20:23.089027 29590 tablet_bootstrap.cc:492] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41: No bootstrap required, opened a new log
I20260709 12:20:23.089512 29590 ts_tablet_manager.cc:1403] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:20:23.091427 29589 raft_consensus.cc:359] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.092137 29589 raft_consensus.cc:385] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.092511 29589 raft_consensus.cc:740] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aec3617f199427e8005d08c4f1934d8, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.092190 29590 raft_consensus.cc:359] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.092935 29590 raft_consensus.cc:385] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.093247 29590 raft_consensus.cc:740] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 325a991f37ce4925a7f249e5b0ce1f41, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.093261 29589 consensus_queue.cc:260] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.094110 29590 consensus_queue.cc:260] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.095510 29589 ts_tablet_manager.cc:1434] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:23.097616 29590 ts_tablet_manager.cc:1434] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:23.136996 29591 raft_consensus.cc:493] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.137483 29591 raft_consensus.cc:515] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.139364 29591 leader_election.cc:290] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473), 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3:45013)
I20260709 12:20:23.147428 29473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74c5ca776c465ca9f4db16732d4536" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1aec3617f199427e8005d08c4f1934d8" is_pre_election: true
I20260709 12:20:23.148202 29473 raft_consensus.cc:2468] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 0.
I20260709 12:20:23.149250 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74c5ca776c465ca9f4db16732d4536" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41" is_pre_election: true
I20260709 12:20:23.149277 29363 leader_election.cc:304] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aec3617f199427e8005d08c4f1934d8, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.150046 29547 raft_consensus.cc:2468] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 0.
I20260709 12:20:23.150241 29591 raft_consensus.cc:2804] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:23.150638 29591 raft_consensus.cc:493] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.150947 29591 raft_consensus.cc:3060] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.155776 29591 raft_consensus.cc:515] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.157176 29591 leader_election.cc:290] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 1 election: Requested vote from peers 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473), 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3:45013)
I20260709 12:20:23.157823 29473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74c5ca776c465ca9f4db16732d4536" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1aec3617f199427e8005d08c4f1934d8"
I20260709 12:20:23.158164 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74c5ca776c465ca9f4db16732d4536" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
I20260709 12:20:23.158331 29473 raft_consensus.cc:3060] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.158654 29547 raft_consensus.cc:3060] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.163336 29473 raft_consensus.cc:2468] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 1.
I20260709 12:20:23.163415 29547 raft_consensus.cc:2468] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 1.
I20260709 12:20:23.164363 29363 leader_election.cc:304] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aec3617f199427e8005d08c4f1934d8, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.164955 29591 raft_consensus.cc:2804] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:23.165695 29591 raft_consensus.cc:697] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 LEADER]: Becoming Leader. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Running, Role: LEADER
I20260709 12:20:23.166520 29596 raft_consensus.cc:493] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.166347 29591 consensus_queue.cc:237] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.166994 29596 raft_consensus.cc:515] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.172070 29596 leader_election.cc:290] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1:40097), 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473)
I20260709 12:20:23.175938 29293 catalog_manager.cc:5697] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.180377 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73208af4344408eb04284332955c104" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" is_pre_election: true
I20260709 12:20:23.181071 29397 raft_consensus.cc:2468] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 0.
I20260709 12:20:23.182144 29473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73208af4344408eb04284332955c104" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1aec3617f199427e8005d08c4f1934d8" is_pre_election: true
I20260709 12:20:23.182610 29512 leader_election.cc:304] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 325a991f37ce4925a7f249e5b0ce1f41, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.182787 29473 raft_consensus.cc:2468] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 0.
I20260709 12:20:23.183465 29596 raft_consensus.cc:2804] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:23.183863 29596 raft_consensus.cc:493] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.184195 29596 raft_consensus.cc:3060] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.189117 29596 raft_consensus.cc:515] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.190488 29596 leader_election.cc:290] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 1 election: Requested vote from peers 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1:40097), 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473)
I20260709 12:20:23.191221 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73208af4344408eb04284332955c104" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
I20260709 12:20:23.191360 29473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73208af4344408eb04284332955c104" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1aec3617f199427e8005d08c4f1934d8"
I20260709 12:20:23.191700 29397 raft_consensus.cc:3060] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.191861 29473 raft_consensus.cc:3060] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.196554 29397 raft_consensus.cc:2468] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 1.
I20260709 12:20:23.196549 29473 raft_consensus.cc:2468] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 1.
I20260709 12:20:23.197603 29512 leader_election.cc:304] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 325a991f37ce4925a7f249e5b0ce1f41, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.198215 29596 raft_consensus.cc:2804] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:23.199149 29596 raft_consensus.cc:697] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Becoming Leader. State: Replica: 325a991f37ce4925a7f249e5b0ce1f41, State: Running, Role: LEADER
I20260709 12:20:23.199851 29596 consensus_queue.cc:237] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.205864 29293 catalog_manager.cc:5697] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "325a991f37ce4925a7f249e5b0ce1f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.236869 29293 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49508:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:23.238642 29293 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:23.259205 29386 tablet_service.cc:1511] Processing CreateTablet for tablet 546d98094e5a4988ad6819f222d2c896 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5c8abdc30f1b427eacb3536cb6ad40d8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:23.260399 29386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546d98094e5a4988ad6819f222d2c896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.261230 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 546d98094e5a4988ad6819f222d2c896 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5c8abdc30f1b427eacb3536cb6ad40d8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:23.262426 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546d98094e5a4988ad6819f222d2c896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.262984 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 546d98094e5a4988ad6819f222d2c896 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5c8abdc30f1b427eacb3536cb6ad40d8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:23.264155 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546d98094e5a4988ad6819f222d2c896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.264883 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 06616d5e03104f3ab002991943737eb9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5c8abdc30f1b427eacb3536cb6ad40d8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:23.266033 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06616d5e03104f3ab002991943737eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.275090 29587 tablet_bootstrap.cc:492] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1: Bootstrap starting.
I20260709 12:20:23.277220 29589 tablet_bootstrap.cc:492] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8: Bootstrap starting.
I20260709 12:20:23.278575 29461 tablet_service.cc:1511] Processing CreateTablet for tablet 06616d5e03104f3ab002991943737eb9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5c8abdc30f1b427eacb3536cb6ad40d8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:23.279172 29590 tablet_bootstrap.cc:492] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41: Bootstrap starting.
I20260709 12:20:23.279765 29461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06616d5e03104f3ab002991943737eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.281960 29587 tablet_bootstrap.cc:654] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.283797 29589 tablet_bootstrap.cc:654] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.286541 29590 tablet_bootstrap.cc:654] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.295270 29590 tablet_bootstrap.cc:492] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41: No bootstrap required, opened a new log
I20260709 12:20:23.295758 29590 ts_tablet_manager.cc:1403] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.010s
I20260709 12:20:23.297178 29589 tablet_bootstrap.cc:492] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8: No bootstrap required, opened a new log
I20260709 12:20:23.297667 29589 ts_tablet_manager.cc:1403] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:20:23.298872 29590 raft_consensus.cc:359] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.299686 29590 raft_consensus.cc:385] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.299980 29590 raft_consensus.cc:740] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 325a991f37ce4925a7f249e5b0ce1f41, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.300679 29589 raft_consensus.cc:359] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.301760 29589 raft_consensus.cc:385] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.301460 29590 consensus_queue.cc:260] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.302057 29589 raft_consensus.cc:740] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aec3617f199427e8005d08c4f1934d8, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.302400 29536 tablet_service.cc:1511] Processing CreateTablet for tablet 06616d5e03104f3ab002991943737eb9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5c8abdc30f1b427eacb3536cb6ad40d8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:23.302966 29589 consensus_queue.cc:260] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.303695 29536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06616d5e03104f3ab002991943737eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.305423 29587 tablet_bootstrap.cc:492] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1: No bootstrap required, opened a new log
I20260709 12:20:23.305895 29587 ts_tablet_manager.cc:1403] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.009s
I20260709 12:20:23.308859 29587 raft_consensus.cc:359] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.309540 29587 raft_consensus.cc:385] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.309818 29587 raft_consensus.cc:740] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.310518 29587 consensus_queue.cc:260] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.311599 29589 ts_tablet_manager.cc:1434] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:20:23.312593 29587 ts_tablet_manager.cc:1434] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:23.303682 29590 ts_tablet_manager.cc:1434] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:23.320811 29589 tablet_bootstrap.cc:492] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8: Bootstrap starting.
I20260709 12:20:23.327095 29590 tablet_bootstrap.cc:492] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41: Bootstrap starting.
I20260709 12:20:23.327447 29589 tablet_bootstrap.cc:654] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.327917 29587 tablet_bootstrap.cc:492] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1: Bootstrap starting.
I20260709 12:20:23.332831 29590 tablet_bootstrap.cc:654] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.333102 29589 tablet_bootstrap.cc:492] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8: No bootstrap required, opened a new log
I20260709 12:20:23.333595 29589 ts_tablet_manager.cc:1403] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:20:23.333974 29587 tablet_bootstrap.cc:654] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.336476 29589 raft_consensus.cc:359] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.337229 29589 raft_consensus.cc:385] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.337442 29589 raft_consensus.cc:740] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aec3617f199427e8005d08c4f1934d8, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.338514 29590 tablet_bootstrap.cc:492] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41: No bootstrap required, opened a new log
I20260709 12:20:23.338268 29589 consensus_queue.cc:260] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.339017 29590 ts_tablet_manager.cc:1403] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 12:20:23.339756 29587 tablet_bootstrap.cc:492] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1: No bootstrap required, opened a new log
I20260709 12:20:23.340307 29587 ts_tablet_manager.cc:1403] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:20:23.340405 29589 ts_tablet_manager.cc:1434] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:23.341841 29590 raft_consensus.cc:359] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.342528 29590 raft_consensus.cc:385] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.342816 29590 raft_consensus.cc:740] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 325a991f37ce4925a7f249e5b0ce1f41, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.343039 29587 raft_consensus.cc:359] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.343717 29587 raft_consensus.cc:385] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.344085 29587 raft_consensus.cc:740] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.343771 29590 consensus_queue.cc:260] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.344795 29587 consensus_queue.cc:260] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.347018 29587 ts_tablet_manager.cc:1434] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:23.348254 29590 ts_tablet_manager.cc:1434] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:23.371956 29596 raft_consensus.cc:493] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.372490 29595 raft_consensus.cc:493] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.372368 29596 raft_consensus.cc:515] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.372915 29595 raft_consensus.cc:515] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.373996 29596 leader_election.cc:290] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1:40097), 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473)
I20260709 12:20:23.374822 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546d98094e5a4988ad6819f222d2c896" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" is_pre_election: true
I20260709 12:20:23.375046 29473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546d98094e5a4988ad6819f222d2c896" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1aec3617f199427e8005d08c4f1934d8" is_pre_election: true
I20260709 12:20:23.375520 29397 raft_consensus.cc:2468] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 0.
I20260709 12:20:23.375741 29473 raft_consensus.cc:2468] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 0.
I20260709 12:20:23.375133 29595 leader_election.cc:290] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1:40097), 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3:45013)
I20260709 12:20:23.376770 29512 leader_election.cc:304] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 325a991f37ce4925a7f249e5b0ce1f41, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.377633 29596 raft_consensus.cc:2804] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:23.377992 29596 raft_consensus.cc:493] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.378334 29596 raft_consensus.cc:3060] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.384543 29596 raft_consensus.cc:515] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.386190 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06616d5e03104f3ab002991943737eb9" candidate_uuid: "1aec3617f199427e8005d08c4f1934d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" is_pre_election: true
I20260709 12:20:23.386796 29397 raft_consensus.cc:2468] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1aec3617f199427e8005d08c4f1934d8 in term 0.
I20260709 12:20:23.387961 29437 leader_election.cc:304] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aec3617f199427e8005d08c4f1934d8, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.388048 29596 leader_election.cc:290] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 1 election: Requested vote from peers 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1:40097), 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473)
I20260709 12:20:23.388499 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546d98094e5a4988ad6819f222d2c896" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
I20260709 12:20:23.388780 29595 raft_consensus.cc:2804] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:23.388057 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06616d5e03104f3ab002991943737eb9" candidate_uuid: "1aec3617f199427e8005d08c4f1934d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41" is_pre_election: true
I20260709 12:20:23.389286 29595 raft_consensus.cc:493] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.389351 29473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546d98094e5a4988ad6819f222d2c896" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1aec3617f199427e8005d08c4f1934d8"
I20260709 12:20:23.389734 29547 raft_consensus.cc:2468] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1aec3617f199427e8005d08c4f1934d8 in term 0.
I20260709 12:20:23.389987 29595 raft_consensus.cc:3060] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.390129 29473 raft_consensus.cc:3060] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.389055 29397 raft_consensus.cc:3060] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.396045 29397 raft_consensus.cc:2468] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 1.
I20260709 12:20:23.397002 29512 leader_election.cc:304] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 325a991f37ce4925a7f249e5b0ce1f41, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.397095 29473 raft_consensus.cc:2468] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 1.
I20260709 12:20:23.397226 29595 raft_consensus.cc:515] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.397928 29596 raft_consensus.cc:2804] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:23.398409 29596 raft_consensus.cc:697] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Becoming Leader. State: Replica: 325a991f37ce4925a7f249e5b0ce1f41, State: Running, Role: LEADER
I20260709 12:20:23.399121 29595 leader_election.cc:290] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [CANDIDATE]: Term 1 election: Requested vote from peers 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1:40097), 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3:45013)
I20260709 12:20:23.399760 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06616d5e03104f3ab002991943737eb9" candidate_uuid: "1aec3617f199427e8005d08c4f1934d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
I20260709 12:20:23.399523 29596 consensus_queue.cc:237] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.399992 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06616d5e03104f3ab002991943737eb9" candidate_uuid: "1aec3617f199427e8005d08c4f1934d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
I20260709 12:20:23.400321 29397 raft_consensus.cc:3060] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.400535 29547 raft_consensus.cc:3060] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.406585 29397 raft_consensus.cc:2468] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1aec3617f199427e8005d08c4f1934d8 in term 1.
I20260709 12:20:23.406983 29547 raft_consensus.cc:2468] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1aec3617f199427e8005d08c4f1934d8 in term 1.
I20260709 12:20:23.406683 29294 catalog_manager.cc:5697] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "325a991f37ce4925a7f249e5b0ce1f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.407591 29437 leader_election.cc:304] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aec3617f199427e8005d08c4f1934d8, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.408329 29595 raft_consensus.cc:2804] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:23.409466 29595 raft_consensus.cc:697] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 1 LEADER]: Becoming Leader. State: Replica: 1aec3617f199427e8005d08c4f1934d8, State: Running, Role: LEADER
I20260709 12:20:23.410194 29595 consensus_queue.cc:237] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.417315 29293 catalog_manager.cc:5697] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "1aec3617f199427e8005d08c4f1934d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.458858 29547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c73208af4344408eb04284332955c104"
dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
mode: GRACEFUL
new_leader_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
 from {username='slave'} at 127.0.0.1:60468
I20260709 12:20:23.459321 29547 raft_consensus.cc:606] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Received request to transfer leadership to TS 4cbf2d8c35494af9aa52dca7f229aed1
I20260709 12:20:23.470188 29397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d74c5ca776c465ca9f4db16732d4536"
dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
mode: GRACEFUL
new_leader_uuid: "1aec3617f199427e8005d08c4f1934d8"
 from {username='slave'} at 127.0.0.1:37562
I20260709 12:20:23.470613 29397 raft_consensus.cc:606] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 LEADER]: Received request to transfer leadership to TS 1aec3617f199427e8005d08c4f1934d8
I20260709 12:20:23.475188 29547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "546d98094e5a4988ad6819f222d2c896"
dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
mode: GRACEFUL
new_leader_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
 from {username='slave'} at 127.0.0.1:60468
I20260709 12:20:23.475600 29547 raft_consensus.cc:606] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Received request to transfer leadership to TS 4cbf2d8c35494af9aa52dca7f229aed1
I20260709 12:20:23.485898 29473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06616d5e03104f3ab002991943737eb9"
dest_uuid: "1aec3617f199427e8005d08c4f1934d8"
mode: GRACEFUL
new_leader_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
 from {username='slave'} at 127.0.0.1:51210
I20260709 12:20:23.486325 29473 raft_consensus.cc:606] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 1 LEADER]: Received request to transfer leadership to TS 4cbf2d8c35494af9aa52dca7f229aed1
I20260709 12:20:23.609648 29596 consensus_queue.cc:1048] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:23.616669 29596 raft_consensus.cc:993] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41: : Instructing follower 4cbf2d8c35494af9aa52dca7f229aed1 to start an election
I20260709 12:20:23.617202 29603 raft_consensus.cc:1081] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Signalling peer 4cbf2d8c35494af9aa52dca7f229aed1 to start an election
I20260709 12:20:23.618974 29396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c73208af4344408eb04284332955c104"
dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
 from {username='slave'} at 127.0.0.1:37550
I20260709 12:20:23.620044 29396 raft_consensus.cc:493] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.620412 29396 raft_consensus.cc:3060] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.622660 29596 consensus_queue.cc:1048] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:23.630172 29396 raft_consensus.cc:515] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.632616 29396 leader_election.cc:290] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 2 election: Requested vote from peers 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473), 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3:45013)
I20260709 12:20:23.632846 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73208af4344408eb04284332955c104" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
I20260709 12:20:23.633426 29547 raft_consensus.cc:3055] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:23.633735 29547 raft_consensus.cc:740] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 325a991f37ce4925a7f249e5b0ce1f41, State: Running, Role: LEADER
I20260709 12:20:23.634104 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73208af4344408eb04284332955c104" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1aec3617f199427e8005d08c4f1934d8"
I20260709 12:20:23.634698 29472 raft_consensus.cc:3060] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.634500 29547 consensus_queue.cc:260] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
W20260709 12:20:23.635505 29596 consensus_queue.cc:1175] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1aec3617f199427e8005d08c4f1934d8" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:20:23.635682 29547 raft_consensus.cc:3060] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.640133 29472 raft_consensus.cc:2468] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 2.
I20260709 12:20:23.641230 29363 leader_election.cc:304] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aec3617f199427e8005d08c4f1934d8, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.642032 29591 raft_consensus.cc:2804] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:23.642479 29591 raft_consensus.cc:697] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: Becoming Leader. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Running, Role: LEADER
I20260709 12:20:23.642478 29547 raft_consensus.cc:2468] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 2.
I20260709 12:20:23.643345 29591 consensus_queue.cc:237] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.650184 29293 catalog_manager.cc:5697] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 reported cstate change: term changed from 1 to 2, leader changed from 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3) to 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.686445 29591 consensus_queue.cc:1048] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:23.692025 29600 raft_consensus.cc:993] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1: : Instructing follower 1aec3617f199427e8005d08c4f1934d8 to start an election
I20260709 12:20:23.693045 29591 raft_consensus.cc:1081] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 LEADER]: Signalling peer 1aec3617f199427e8005d08c4f1934d8 to start an election
I20260709 12:20:23.696460 29472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d74c5ca776c465ca9f4db16732d4536"
dest_uuid: "1aec3617f199427e8005d08c4f1934d8"
 from {username='slave'} at 127.0.0.1:51192
I20260709 12:20:23.696990 29472 raft_consensus.cc:493] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.697361 29472 raft_consensus.cc:3060] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.697681 29630 consensus_queue.cc:1048] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:23.703745 29472 raft_consensus.cc:515] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.705757 29472 leader_election.cc:290] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [CANDIDATE]: Term 2 election: Requested vote from peers 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1:40097), 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3:45013)
I20260709 12:20:23.706561 29396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74c5ca776c465ca9f4db16732d4536" candidate_uuid: "1aec3617f199427e8005d08c4f1934d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
I20260709 12:20:23.706952 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d74c5ca776c465ca9f4db16732d4536" candidate_uuid: "1aec3617f199427e8005d08c4f1934d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
I20260709 12:20:23.707195 29396 raft_consensus.cc:3055] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:23.707551 29396 raft_consensus.cc:740] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Running, Role: LEADER
I20260709 12:20:23.707607 29547 raft_consensus.cc:3060] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.708364 29396 consensus_queue.cc:260] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.709535 29396 raft_consensus.cc:3060] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.714092 29547 raft_consensus.cc:2468] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1aec3617f199427e8005d08c4f1934d8 in term 2.
I20260709 12:20:23.715240 29436 leader_election.cc:304] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aec3617f199427e8005d08c4f1934d8, 325a991f37ce4925a7f249e5b0ce1f41; no voters: 
I20260709 12:20:23.716004 29595 raft_consensus.cc:2804] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:23.716024 29396 raft_consensus.cc:2468] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1aec3617f199427e8005d08c4f1934d8 in term 2.
I20260709 12:20:23.716569 29595 raft_consensus.cc:697] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 2 LEADER]: Becoming Leader. State: Replica: 1aec3617f199427e8005d08c4f1934d8, State: Running, Role: LEADER
I20260709 12:20:23.717406 29595 consensus_queue.cc:237] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.723186 29292 catalog_manager.cc:5697] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 reported cstate change: term changed from 1 to 2, leader changed from 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1) to 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "1aec3617f199427e8005d08c4f1934d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.791944 29596 consensus_queue.cc:1048] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:23.801566 29596 consensus_queue.cc:1048] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:23.808914 29626 raft_consensus.cc:993] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41: : Instructing follower 4cbf2d8c35494af9aa52dca7f229aed1 to start an election
I20260709 12:20:23.809492 29626 raft_consensus.cc:1081] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Signalling peer 4cbf2d8c35494af9aa52dca7f229aed1 to start an election
I20260709 12:20:23.811992 29396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "546d98094e5a4988ad6819f222d2c896"
dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
 from {username='slave'} at 127.0.0.1:37550
I20260709 12:20:23.812397 29396 raft_consensus.cc:493] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.812701 29396 raft_consensus.cc:3060] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.817298 29396 raft_consensus.cc:515] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.819152 29396 leader_election.cc:290] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 2 election: Requested vote from peers 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473), 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3:45013)
I20260709 12:20:23.819494 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546d98094e5a4988ad6819f222d2c896" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1aec3617f199427e8005d08c4f1934d8"
I20260709 12:20:23.819729 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546d98094e5a4988ad6819f222d2c896" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
I20260709 12:20:23.820155 29472 raft_consensus.cc:3060] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.820253 29547 raft_consensus.cc:3055] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:23.820659 29547 raft_consensus.cc:740] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 325a991f37ce4925a7f249e5b0ce1f41, State: Running, Role: LEADER
I20260709 12:20:23.821419 29547 consensus_queue.cc:260] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.822587 29547 raft_consensus.cc:3060] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.826598 29472 raft_consensus.cc:2468] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 2.
I20260709 12:20:23.827605 29363 leader_election.cc:304] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aec3617f199427e8005d08c4f1934d8, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.828198 29630 raft_consensus.cc:2804] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:23.828553 29630 raft_consensus.cc:697] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: Becoming Leader. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Running, Role: LEADER
I20260709 12:20:23.828637 29547 raft_consensus.cc:2468] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 2.
I20260709 12:20:23.829272 29630 consensus_queue.cc:237] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.834609 29293 catalog_manager.cc:5697] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 reported cstate change: term changed from 1 to 2, leader changed from 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3) to 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.856717 29595 consensus_queue.cc:1048] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:23.862358 29620 raft_consensus.cc:993] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8: : Instructing follower 4cbf2d8c35494af9aa52dca7f229aed1 to start an election
I20260709 12:20:23.862939 29595 raft_consensus.cc:1081] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 1 LEADER]: Signalling peer 4cbf2d8c35494af9aa52dca7f229aed1 to start an election
I20260709 12:20:23.864681 29397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06616d5e03104f3ab002991943737eb9"
dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
 from {username='slave'} at 127.0.0.1:37560
I20260709 12:20:23.866075 29397 raft_consensus.cc:493] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.866462 29397 raft_consensus.cc:3060] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.868275 29620 consensus_queue.cc:1048] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:23.872706 29397 raft_consensus.cc:515] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.877435 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06616d5e03104f3ab002991943737eb9" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1aec3617f199427e8005d08c4f1934d8"
I20260709 12:20:23.877955 29472 raft_consensus.cc:3055] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:23.878268 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06616d5e03104f3ab002991943737eb9" candidate_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
I20260709 12:20:23.878280 29472 raft_consensus.cc:740] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1aec3617f199427e8005d08c4f1934d8, State: Running, Role: LEADER
I20260709 12:20:23.879067 29547 raft_consensus.cc:3060] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.879155 29397 leader_election.cc:290] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 2 election: Requested vote from peers 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473), 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3:45013)
I20260709 12:20:23.879455 29472 consensus_queue.cc:260] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.880712 29472 raft_consensus.cc:3060] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.886312 29547 raft_consensus.cc:2468] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 2.
I20260709 12:20:23.887437 29361 leader_election.cc:304] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 325a991f37ce4925a7f249e5b0ce1f41, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:23.888247 29630 raft_consensus.cc:2804] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:23.888701 29630 raft_consensus.cc:697] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: Becoming Leader. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Running, Role: LEADER
I20260709 12:20:23.889454 29630 consensus_queue.cc:237] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:23.889750 29472 raft_consensus.cc:2468] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cbf2d8c35494af9aa52dca7f229aed1 in term 2.
I20260709 12:20:23.896533 29293 catalog_manager.cc:5697] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 reported cstate change: term changed from 1 to 2, leader changed from 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2) to 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:24.087159 29472 raft_consensus.cc:1275] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Refusing update from remote peer 4cbf2d8c35494af9aa52dca7f229aed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:24.088442 29630 consensus_queue.cc:1048] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:24.095500 29547 raft_consensus.cc:1275] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Refusing update from remote peer 4cbf2d8c35494af9aa52dca7f229aed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:24.096863 29600 consensus_queue.cc:1048] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:24.169397 19888 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:20:24.170975 19888 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:20:24.171284 19888 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:20:24.181308 29397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06616d5e03104f3ab002991943737eb9"
dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
mode: GRACEFUL
new_leader_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
 from {username='slave'} at 127.0.0.1:37572
I20260709 12:20:24.181754 29397 raft_consensus.cc:606] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: Received request to transfer leadership to TS 325a991f37ce4925a7f249e5b0ce1f41
I20260709 12:20:24.182665 19888 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:20:24.239171 29547 raft_consensus.cc:1275] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Refusing update from remote peer 1aec3617f199427e8005d08c4f1934d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:24.240391 29620 consensus_queue.cc:1048] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:24.247181 29397 raft_consensus.cc:1275] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Refusing update from remote peer 1aec3617f199427e8005d08c4f1934d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:24.248914 29595 consensus_queue.cc:1048] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:24.301328 29472 raft_consensus.cc:1275] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Refusing update from remote peer 4cbf2d8c35494af9aa52dca7f229aed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:24.302552 29600 consensus_queue.cc:1048] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:24.309963 29547 raft_consensus.cc:1275] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Refusing update from remote peer 4cbf2d8c35494af9aa52dca7f229aed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:24.311510 29591 consensus_queue.cc:1048] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:24.317067 29591 raft_consensus.cc:993] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1: : Instructing follower 325a991f37ce4925a7f249e5b0ce1f41 to start an election
I20260709 12:20:24.317477 29630 raft_consensus.cc:1081] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: Signalling peer 325a991f37ce4925a7f249e5b0ce1f41 to start an election
I20260709 12:20:24.318776 29547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06616d5e03104f3ab002991943737eb9"
dest_uuid: "325a991f37ce4925a7f249e5b0ce1f41"
 from {username='slave'} at 127.0.0.1:60456
I20260709 12:20:24.319353 29547 raft_consensus.cc:493] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:24.319700 29547 raft_consensus.cc:3060] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:24.324474 29547 raft_consensus.cc:515] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:24.325912 29547 leader_election.cc:290] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 3 election: Requested vote from peers 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1:40097), 1aec3617f199427e8005d08c4f1934d8 (127.19.108.2:44473)
I20260709 12:20:24.326754 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06616d5e03104f3ab002991943737eb9" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4cbf2d8c35494af9aa52dca7f229aed1"
I20260709 12:20:24.327015 29472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06616d5e03104f3ab002991943737eb9" candidate_uuid: "325a991f37ce4925a7f249e5b0ce1f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1aec3617f199427e8005d08c4f1934d8"
I20260709 12:20:24.327392 29397 raft_consensus.cc:3055] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:24.327620 29472 raft_consensus.cc:3060] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:24.327745 29397 raft_consensus.cc:740] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cbf2d8c35494af9aa52dca7f229aed1, State: Running, Role: LEADER
I20260709 12:20:24.328534 29397 consensus_queue.cc:260] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:24.329713 29397 raft_consensus.cc:3060] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:24.336228 29397 raft_consensus.cc:2468] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 3.
I20260709 12:20:24.336689 29472 raft_consensus.cc:2468] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 325a991f37ce4925a7f249e5b0ce1f41 in term 3.
I20260709 12:20:24.337177 29512 leader_election.cc:304] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 325a991f37ce4925a7f249e5b0ce1f41, 4cbf2d8c35494af9aa52dca7f229aed1; no voters: 
I20260709 12:20:24.337944 29596 raft_consensus.cc:2804] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:24.338713 29596 raft_consensus.cc:697] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 3 LEADER]: Becoming Leader. State: Replica: 325a991f37ce4925a7f249e5b0ce1f41, State: Running, Role: LEADER
I20260709 12:20:24.339354 29596 consensus_queue.cc:237] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } }
I20260709 12:20:24.344646 29292 catalog_manager.cc:5697] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 reported cstate change: term changed from 2 to 3, leader changed from 4cbf2d8c35494af9aa52dca7f229aed1 (127.19.108.1) to 325a991f37ce4925a7f249e5b0ce1f41 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "325a991f37ce4925a7f249e5b0ce1f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cbf2d8c35494af9aa52dca7f229aed1" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1aec3617f199427e8005d08c4f1934d8" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 44473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.377854 19888 tablet_server.cc:179] TabletServer@127.19.108.1:0 shutting down...
I20260709 12:20:24.393846 29547 raft_consensus.cc:1275] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Refusing update from remote peer 4cbf2d8c35494af9aa52dca7f229aed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:24.395256 29630 consensus_queue.cc:1048] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "325a991f37ce4925a7f249e5b0ce1f41" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:24.396715 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:24.397382 19888 tablet_replica.cc:333] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1: stopping tablet replica
I20260709 12:20:24.398109 19888 raft_consensus.cc:2243] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:24.398779 19888 pending_rounds.cc:70] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1: Trying to abort 1 pending ops.
I20260709 12:20:24.399055 19888 pending_rounds.cc:77] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624059211980800 op_type: NO_OP noop_request { }
I20260709 12:20:24.399408 19888 raft_consensus.cc:2889] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:24.399730 19888 raft_consensus.cc:2272] T 546d98094e5a4988ad6819f222d2c896 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.402498 19888 tablet_replica.cc:333] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1: stopping tablet replica
I20260709 12:20:24.403100 19888 raft_consensus.cc:2243] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:24.403808 19888 raft_consensus.cc:2272] T c73208af4344408eb04284332955c104 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.405916 19888 tablet_replica.cc:333] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1: stopping tablet replica
I20260709 12:20:24.406431 19888 raft_consensus.cc:2243] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.406812 19888 raft_consensus.cc:2272] T 06616d5e03104f3ab002991943737eb9 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.408876 19888 tablet_replica.cc:333] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1: stopping tablet replica
I20260709 12:20:24.409327 19888 raft_consensus.cc:2243] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.409698 19888 raft_consensus.cc:2272] T 9d74c5ca776c465ca9f4db16732d4536 P 4cbf2d8c35494af9aa52dca7f229aed1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.430644 19888 tablet_server.cc:196] TabletServer@127.19.108.1:0 shutdown complete.
I20260709 12:20:24.441125 19888 tablet_server.cc:179] TabletServer@127.19.108.2:0 shutting down...
I20260709 12:20:24.457525 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:24.458038 19888 tablet_replica.cc:333] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8: stopping tablet replica
I20260709 12:20:24.458534 19888 raft_consensus.cc:2243] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.458969 19888 raft_consensus.cc:2272] T 06616d5e03104f3ab002991943737eb9 P 1aec3617f199427e8005d08c4f1934d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.460819 19888 tablet_replica.cc:333] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8: stopping tablet replica
I20260709 12:20:24.461290 19888 raft_consensus.cc:2243] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:24.462031 19888 raft_consensus.cc:2272] T 9d74c5ca776c465ca9f4db16732d4536 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.464223 19888 tablet_replica.cc:333] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8: stopping tablet replica
I20260709 12:20:24.464681 19888 raft_consensus.cc:2243] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.465039 19888 raft_consensus.cc:2272] T 546d98094e5a4988ad6819f222d2c896 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.467057 19888 tablet_replica.cc:333] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8: stopping tablet replica
I20260709 12:20:24.467474 19888 raft_consensus.cc:2243] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.467840 19888 raft_consensus.cc:2272] T c73208af4344408eb04284332955c104 P 1aec3617f199427e8005d08c4f1934d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.488569 19888 tablet_server.cc:196] TabletServer@127.19.108.2:0 shutdown complete.
I20260709 12:20:24.499377 19888 tablet_server.cc:179] TabletServer@127.19.108.3:0 shutting down...
I20260709 12:20:24.515818 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:24.516323 19888 tablet_replica.cc:333] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41: stopping tablet replica
I20260709 12:20:24.516786 19888 raft_consensus.cc:2243] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:24.517318 19888 pending_rounds.cc:70] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41: Trying to abort 1 pending ops.
I20260709 12:20:24.517495 19888 pending_rounds.cc:77] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305624061300391936 op_type: NO_OP noop_request { }
I20260709 12:20:24.517748 19888 raft_consensus.cc:2889] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:24.517971 19888 raft_consensus.cc:2272] T 06616d5e03104f3ab002991943737eb9 P 325a991f37ce4925a7f249e5b0ce1f41 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.519914 19888 tablet_replica.cc:333] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41: stopping tablet replica
I20260709 12:20:24.520363 19888 raft_consensus.cc:2243] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.520714 19888 raft_consensus.cc:2272] T 9d74c5ca776c465ca9f4db16732d4536 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.522562 19888 tablet_replica.cc:333] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41: stopping tablet replica
I20260709 12:20:24.523028 19888 raft_consensus.cc:2243] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.523341 19888 pending_rounds.cc:70] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41: Trying to abort 1 pending ops.
I20260709 12:20:24.523480 19888 pending_rounds.cc:77] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624059211980800 op_type: NO_OP noop_request { }
I20260709 12:20:24.523676 19888 raft_consensus.cc:2889] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:24.523883 19888 raft_consensus.cc:2272] T 546d98094e5a4988ad6819f222d2c896 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.525605 19888 tablet_replica.cc:333] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41: stopping tablet replica
I20260709 12:20:24.526008 19888 raft_consensus.cc:2243] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.526351 19888 raft_consensus.cc:2272] T c73208af4344408eb04284332955c104 P 325a991f37ce4925a7f249e5b0ce1f41 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.537042 19888 tablet_server.cc:196] TabletServer@127.19.108.3:0 shutdown complete.
I20260709 12:20:24.547315 19888 master.cc:562] Master@127.19.108.62:37733 shutting down...
I20260709 12:20:24.561203 19888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:24.561635 19888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.561913 19888 tablet_replica.cc:333] T 00000000000000000000000000000000 P 219ac2987fd24de193bdca4ac192af86: stopping tablet replica
I20260709 12:20:24.578948 19888 master.cc:584] Master@127.19.108.62:37733 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2156 ms)
[----------] 6 tests from LeaderRebalancerTest (306362 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:20:24.604012 19888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.108.62:43449
I20260709 12:20:24.604986 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:24.609210 29640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:24.609664 29641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:24.612780 29643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:24.617830 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:24.618788 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:24.619010 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:24.619168 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599624619150 us; error 0 us; skew 500 ppm
I20260709 12:20:24.619675 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:24.621714 19888 webserver.cc:533] Webserver started at http://127.19.108.62:36885/ using document root <none> and password file <none>
I20260709 12:20:24.622148 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:24.622308 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:24.622560 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:24.623584 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/master-0-root/instance:
uuid: "98a0cd3cad3e4403ab0ee29ef82716ef"
format_stamp: "Formatted at 2026-07-09 12:20:24 on dist-test-slave-0g1j"
I20260709 12:20:24.627516 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:20:24.630434 29648 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:24.631098 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:24.631342 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/master-0-root
uuid: "98a0cd3cad3e4403ab0ee29ef82716ef"
format_stamp: "Formatted at 2026-07-09 12:20:24 on dist-test-slave-0g1j"
I20260709 12:20:24.631596 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:24.642280 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:24.643167 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:24.675666 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.62:43449
I20260709 12:20:24.675769 29699 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.62:43449 every 8 connection(s)
I20260709 12:20:24.679160 29700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:24.688930 29700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef: Bootstrap starting.
I20260709 12:20:24.692975 29700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.696409 29700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef: No bootstrap required, opened a new log
I20260709 12:20:24.698259 29700 raft_consensus.cc:359] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a0cd3cad3e4403ab0ee29ef82716ef" member_type: VOTER }
I20260709 12:20:24.698616 29700 raft_consensus.cc:385] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.698815 29700 raft_consensus.cc:740] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a0cd3cad3e4403ab0ee29ef82716ef, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.699363 29700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a0cd3cad3e4403ab0ee29ef82716ef" member_type: VOTER }
I20260709 12:20:24.699798 29700 raft_consensus.cc:399] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:24.700006 29700 raft_consensus.cc:493] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:24.700243 29700 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.704367 29700 raft_consensus.cc:515] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a0cd3cad3e4403ab0ee29ef82716ef" member_type: VOTER }
I20260709 12:20:24.704818 29700 leader_election.cc:304] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98a0cd3cad3e4403ab0ee29ef82716ef; no voters: 
I20260709 12:20:24.705785 29700 leader_election.cc:290] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:24.706043 29703 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.707211 29703 raft_consensus.cc:697] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 1 LEADER]: Becoming Leader. State: Replica: 98a0cd3cad3e4403ab0ee29ef82716ef, State: Running, Role: LEADER
I20260709 12:20:24.707796 29703 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a0cd3cad3e4403ab0ee29ef82716ef" member_type: VOTER }
I20260709 12:20:24.708326 29700 sys_catalog.cc:565] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:24.710281 29704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98a0cd3cad3e4403ab0ee29ef82716ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a0cd3cad3e4403ab0ee29ef82716ef" member_type: VOTER } }
I20260709 12:20:24.710296 29705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98a0cd3cad3e4403ab0ee29ef82716ef. Latest consensus state: current_term: 1 leader_uuid: "98a0cd3cad3e4403ab0ee29ef82716ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98a0cd3cad3e4403ab0ee29ef82716ef" member_type: VOTER } }
I20260709 12:20:24.710965 29704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:24.711022 29705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:24.714046 29708 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:24.720713 29708 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:24.721643 19888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:24.728560 29708 catalog_manager.cc:1383] Generated new cluster ID: 71a57d8a4d1b4e59ab68069dd72e9e42
I20260709 12:20:24.728755 29708 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:24.746474 29708 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:24.747615 29708 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:24.759824 29708 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef: Generated new TSK 0
I20260709 12:20:24.760272 29708 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:24.787874 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:24.793135 29721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:24.793941 29722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:24.795899 19888 server_base.cc:1061] running on GCE node
W20260709 12:20:24.795989 29724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:24.797036 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:24.797222 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:24.797384 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599624797367 us; error 0 us; skew 500 ppm
I20260709 12:20:24.797902 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:24.800016 19888 webserver.cc:533] Webserver started at http://127.19.108.1:45857/ using document root <none> and password file <none>
I20260709 12:20:24.800469 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:24.800647 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:24.800884 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:24.801880 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-0-root/instance:
uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
format_stamp: "Formatted at 2026-07-09 12:20:24 on dist-test-slave-0g1j"
I20260709 12:20:24.806035 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:24.809028 29729 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:24.809736 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:24.809995 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
format_stamp: "Formatted at 2026-07-09 12:20:24 on dist-test-slave-0g1j"
I20260709 12:20:24.810243 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:24.835265 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:24.836241 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:24.837563 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:24.839613 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:24.839795 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:24.840013 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:24.840158 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:24.875034 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:40789
I20260709 12:20:24.875121 29791 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:40789 every 8 connection(s)
I20260709 12:20:24.879611 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:24.885941 29796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:24.887776 29797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:24.888859 29799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:24.889261 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:24.891311 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:24.891554 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:24.891743 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599624891726 us; error 0 us; skew 500 ppm
I20260709 12:20:24.891801 29792 heartbeater.cc:344] Connected to a master server at 127.19.108.62:43449
I20260709 12:20:24.892215 29792 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:24.892371 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:24.892916 29792 heartbeater.cc:507] Master 127.19.108.62:43449 requested a full tablet report, sending...
I20260709 12:20:24.894721 19888 webserver.cc:533] Webserver started at http://127.19.108.2:34211/ using document root <none> and password file <none>
I20260709 12:20:24.895001 29665 ts_manager.cc:194] Registered new tserver with Master: 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789)
I20260709 12:20:24.895264 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:24.895530 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:24.895788 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:24.896785 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-1-root/instance:
uuid: "6448facc90e842f2bf981f3648a9b0d0"
format_stamp: "Formatted at 2026-07-09 12:20:24 on dist-test-slave-0g1j"
I20260709 12:20:24.897073 29665 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38660
I20260709 12:20:24.900930 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:24.904096 29804 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:24.904747 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:20:24.905000 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-1-root
uuid: "6448facc90e842f2bf981f3648a9b0d0"
format_stamp: "Formatted at 2026-07-09 12:20:24 on dist-test-slave-0g1j"
I20260709 12:20:24.905253 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:24.933615 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:24.934583 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:24.935951 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:24.938002 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:24.938195 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:24.938402 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:24.938547 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:24.973664 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.2:39927
I20260709 12:20:24.973750 29868 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.2:39927 every 8 connection(s)
I20260709 12:20:24.978256 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:24.984630 29872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:24.985004 29873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:24.987852 29869 heartbeater.cc:344] Connected to a master server at 127.19.108.62:43449
I20260709 12:20:24.988224 29869 heartbeater.cc:461] Registering TS with master...
W20260709 12:20:24.988648 29875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:24.988850 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:24.988934 29869 heartbeater.cc:507] Master 127.19.108.62:43449 requested a full tablet report, sending...
I20260709 12:20:24.989737 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:24.989938 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:24.990128 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599624990110 us; error 0 us; skew 500 ppm
I20260709 12:20:24.990789 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:24.991066 29665 ts_manager.cc:194] Registered new tserver with Master: 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:24.992606 29665 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38662
I20260709 12:20:24.993111 19888 webserver.cc:533] Webserver started at http://127.19.108.3:40937/ using document root <none> and password file <none>
I20260709 12:20:24.993726 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:24.993917 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:24.994233 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:24.995411 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-2-root/instance:
uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
format_stamp: "Formatted at 2026-07-09 12:20:24 on dist-test-slave-0g1j"
I20260709 12:20:24.999334 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:20:25.002278 29880 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:25.003012 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:20:25.003278 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-2-root
uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
format_stamp: "Formatted at 2026-07-09 12:20:24 on dist-test-slave-0g1j"
I20260709 12:20:25.003521 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599318085381-19888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:25.016462 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:25.017400 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:25.018687 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:25.020701 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:25.020890 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:25.021101 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:25.021250 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:25.056483 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.3:38529
I20260709 12:20:25.056591 29943 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.3:38529 every 8 connection(s)
I20260709 12:20:25.068648 29944 heartbeater.cc:344] Connected to a master server at 127.19.108.62:43449
I20260709 12:20:25.069031 29944 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:25.069689 29944 heartbeater.cc:507] Master 127.19.108.62:43449 requested a full tablet report, sending...
I20260709 12:20:25.071400 29665 ts_manager.cc:194] Registered new tserver with Master: c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.071655 19888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012161534s
I20260709 12:20:25.073088 29665 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38674
I20260709 12:20:25.094235 29665 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38682:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:25.096611 29665 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:25.159997 29757 tablet_service.cc:1511] Processing CreateTablet for tablet ee6d776bed5f4744924d72a4575b239f (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:25.161346 29757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6d776bed5f4744924d72a4575b239f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.162566 29908 tablet_service.cc:1511] Processing CreateTablet for tablet ee6d776bed5f4744924d72a4575b239f (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:25.163918 29908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6d776bed5f4744924d72a4575b239f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.164065 29904 tablet_service.cc:1511] Processing CreateTablet for tablet de59eec5a3fa4c16a615ab4f271aeac0 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:25.165342 29904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de59eec5a3fa4c16a615ab4f271aeac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.167845 29905 tablet_service.cc:1511] Processing CreateTablet for tablet 703154aeb5de48ee977cc29ff0564c52 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:25.169138 29905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703154aeb5de48ee977cc29ff0564c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.169164 29756 tablet_service.cc:1511] Processing CreateTablet for tablet e757509278314c5488ceaeb9d1a547ca (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:25.170544 29756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e757509278314c5488ceaeb9d1a547ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.171737 29754 tablet_service.cc:1511] Processing CreateTablet for tablet 703154aeb5de48ee977cc29ff0564c52 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:25.171860 29906 tablet_service.cc:1511] Processing CreateTablet for tablet 8885c880561f4dd59288e67dfe291a18 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:25.172993 29754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703154aeb5de48ee977cc29ff0564c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.174242 29907 tablet_service.cc:1511] Processing CreateTablet for tablet e757509278314c5488ceaeb9d1a547ca (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:25.175884 29752 tablet_service.cc:1511] Processing CreateTablet for tablet b813e56fef6947cebacbfa438d6ad4fa (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:25.177163 29752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b813e56fef6947cebacbfa438d6ad4fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.173141 29906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8885c880561f4dd59288e67dfe291a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.170461 29755 tablet_service.cc:1511] Processing CreateTablet for tablet 8885c880561f4dd59288e67dfe291a18 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:25.180053 29755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8885c880561f4dd59288e67dfe291a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.180157 29907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e757509278314c5488ceaeb9d1a547ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.174743 29753 tablet_service.cc:1511] Processing CreateTablet for tablet de59eec5a3fa4c16a615ab4f271aeac0 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:25.182075 29753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de59eec5a3fa4c16a615ab4f271aeac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.200264 29751 tablet_service.cc:1511] Processing CreateTablet for tablet cd3f4a36ccac40b0b7a763c02d0a8002 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:25.201635 29751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd3f4a36ccac40b0b7a763c02d0a8002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.203846 29750 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9baf3160f54118b5ff0e7bc9dd1688 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:25.205132 29750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9baf3160f54118b5ff0e7bc9dd1688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.207880 29749 tablet_service.cc:1511] Processing CreateTablet for tablet f7e81ee769c14958aaf73370eb16d780 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:25.209121 29749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e81ee769c14958aaf73370eb16d780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.212733 29903 tablet_service.cc:1511] Processing CreateTablet for tablet b813e56fef6947cebacbfa438d6ad4fa (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:25.215638 29903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b813e56fef6947cebacbfa438d6ad4fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.216151 29902 tablet_service.cc:1511] Processing CreateTablet for tablet cd3f4a36ccac40b0b7a763c02d0a8002 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:25.217458 29902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd3f4a36ccac40b0b7a763c02d0a8002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.223548 29901 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9baf3160f54118b5ff0e7bc9dd1688 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:25.224000 29900 tablet_service.cc:1511] Processing CreateTablet for tablet f7e81ee769c14958aaf73370eb16d780 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:25.224798 29901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9baf3160f54118b5ff0e7bc9dd1688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.225400 29900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e81ee769c14958aaf73370eb16d780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.255887 29833 tablet_service.cc:1511] Processing CreateTablet for tablet ee6d776bed5f4744924d72a4575b239f (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:25.257294 29833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6d776bed5f4744924d72a4575b239f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.259902 29831 tablet_service.cc:1511] Processing CreateTablet for tablet e757509278314c5488ceaeb9d1a547ca (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:25.261248 29831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e757509278314c5488ceaeb9d1a547ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.267920 29826 tablet_service.cc:1511] Processing CreateTablet for tablet cd3f4a36ccac40b0b7a763c02d0a8002 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:25.269284 29826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd3f4a36ccac40b0b7a763c02d0a8002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.271844 29827 tablet_service.cc:1511] Processing CreateTablet for tablet b813e56fef6947cebacbfa438d6ad4fa (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:25.273140 29827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b813e56fef6947cebacbfa438d6ad4fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.275835 29828 tablet_service.cc:1511] Processing CreateTablet for tablet de59eec5a3fa4c16a615ab4f271aeac0 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:25.277251 29828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de59eec5a3fa4c16a615ab4f271aeac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.279493 29830 tablet_service.cc:1511] Processing CreateTablet for tablet 8885c880561f4dd59288e67dfe291a18 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:25.280910 29830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8885c880561f4dd59288e67dfe291a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.283725 29825 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9baf3160f54118b5ff0e7bc9dd1688 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:25.285081 29825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9baf3160f54118b5ff0e7bc9dd1688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.287721 29829 tablet_service.cc:1511] Processing CreateTablet for tablet 703154aeb5de48ee977cc29ff0564c52 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:25.289077 29829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703154aeb5de48ee977cc29ff0564c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.292490 29824 tablet_service.cc:1511] Processing CreateTablet for tablet f7e81ee769c14958aaf73370eb16d780 (DEFAULT_TABLE table=test-workload [id=ced95707506141a793dda08e32182e69]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:25.293809 29824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e81ee769c14958aaf73370eb16d780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:25.353516 29960 tablet_bootstrap.cc:492] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:25.356227 29959 tablet_bootstrap.cc:492] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:25.362916 29961 tablet_bootstrap.cc:492] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:25.367547 29959 tablet_bootstrap.cc:654] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.368253 29961 tablet_bootstrap.cc:654] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.363866 29960 tablet_bootstrap.cc:654] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.399348 29960 tablet_bootstrap.cc:492] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:25.399983 29960 ts_tablet_manager.cc:1403] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.011s
I20260709 12:20:25.403620 29960 raft_consensus.cc:359] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.404244 29960 raft_consensus.cc:385] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.404541 29960 raft_consensus.cc:740] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.406067 29959 tablet_bootstrap.cc:492] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:25.405457 29960 consensus_queue.cc:260] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.406642 29959 ts_tablet_manager.cc:1403] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.029s
I20260709 12:20:25.406837 29961 tablet_bootstrap.cc:492] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:25.407377 29961 ts_tablet_manager.cc:1403] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.019s
I20260709 12:20:25.409789 29961 raft_consensus.cc:359] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.409760 29959 raft_consensus.cc:359] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.410878 29959 raft_consensus.cc:385] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.411276 29959 raft_consensus.cc:740] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.410772 29961 raft_consensus.cc:385] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.411970 29961 raft_consensus.cc:740] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.412235 29959 consensus_queue.cc:260] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.412715 29961 consensus_queue.cc:260] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.414207 29944 heartbeater.cc:499] Master 127.19.108.62:43449 was elected leader, sending a full tablet report...
I20260709 12:20:25.415207 29792 heartbeater.cc:499] Master 127.19.108.62:43449 was elected leader, sending a full tablet report...
I20260709 12:20:25.415257 29960 ts_tablet_manager.cc:1434] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:20:25.416610 29960 tablet_bootstrap.cc:492] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:25.420141 29959 ts_tablet_manager.cc:1434] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:20:25.421168 29960 tablet_bootstrap.cc:654] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.421334 29959 tablet_bootstrap.cc:492] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:25.415477 29965 raft_consensus.cc:493] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.423290 29965 raft_consensus.cc:515] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.428241 29959 tablet_bootstrap.cc:654] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.434764 29965 leader_election.cc:290] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:25.439304 29961 ts_tablet_manager.cc:1434] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.032s	user 0.014s	sys 0.015s
I20260709 12:20:25.439911 29869 heartbeater.cc:499] Master 127.19.108.62:43449 was elected leader, sending a full tablet report...
I20260709 12:20:25.440407 29961 tablet_bootstrap.cc:492] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:25.443318 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
W20260709 12:20:25.444973 29881 leader_election.cc:343] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.454707 29960 tablet_bootstrap.cc:492] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:25.455271 29960 ts_tablet_manager.cc:1403] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 12:20:25.455965 29961 tablet_bootstrap.cc:654] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.458003 29960 raft_consensus.cc:359] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.458745 29960 raft_consensus.cc:385] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.459043 29960 raft_consensus.cc:740] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.465720 29960 consensus_queue.cc:260] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.469246 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
W20260709 12:20:25.477480 29883 leader_election.cc:343] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.477959 29883 leader_election.cc:304] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3f55e4e85ec4aba84a34ce054fcc227; no voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:25.479038 29965 raft_consensus.cc:2749] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:25.481248 29960 ts_tablet_manager.cc:1434] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:20:25.482249 29960 tablet_bootstrap.cc:492] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:25.483407 29959 tablet_bootstrap.cc:492] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:25.484997 29959 ts_tablet_manager.cc:1403] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.030s
I20260709 12:20:25.486125 29961 tablet_bootstrap.cc:492] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:25.486696 29961 ts_tablet_manager.cc:1403] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.019s
I20260709 12:20:25.488103 29959 raft_consensus.cc:359] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.488893 29960 tablet_bootstrap.cc:654] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.488884 29959 raft_consensus.cc:385] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.489461 29959 raft_consensus.cc:740] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.489401 29961 raft_consensus.cc:359] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.490232 29961 raft_consensus.cc:385] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.490528 29961 raft_consensus.cc:740] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.490625 29959 consensus_queue.cc:260] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.491412 29961 consensus_queue.cc:260] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.494570 29959 ts_tablet_manager.cc:1434] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:25.495572 29959 tablet_bootstrap.cc:492] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:25.497965 29961 ts_tablet_manager.cc:1434] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:20:25.498982 29961 tablet_bootstrap.cc:492] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:25.501458 29959 tablet_bootstrap.cc:654] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.510900 29961 tablet_bootstrap.cc:654] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.513298 29960 tablet_bootstrap.cc:492] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:25.513758 29960 ts_tablet_manager.cc:1403] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.015s
I20260709 12:20:25.514467 29959 tablet_bootstrap.cc:492] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:25.514997 29959 ts_tablet_manager.cc:1403] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 12:20:25.515851 29961 tablet_bootstrap.cc:492] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:25.516330 29961 ts_tablet_manager.cc:1403] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:20:25.516096 29960 raft_consensus.cc:359] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.516784 29960 raft_consensus.cc:385] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.517036 29960 raft_consensus.cc:740] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.517669 29960 consensus_queue.cc:260] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.517737 29959 raft_consensus.cc:359] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.518477 29959 raft_consensus.cc:385] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.518775 29959 raft_consensus.cc:740] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.519142 29961 raft_consensus.cc:359] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.519584 29960 ts_tablet_manager.cc:1434] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:25.519841 29961 raft_consensus.cc:385] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.520320 29961 raft_consensus.cc:740] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.519599 29959 consensus_queue.cc:260] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.520633 29960 tablet_bootstrap.cc:492] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:25.522289 29959 ts_tablet_manager.cc:1434] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:25.523334 29959 tablet_bootstrap.cc:492] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:25.523128 29961 consensus_queue.cc:260] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.525290 29961 ts_tablet_manager.cc:1434] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:20:25.526182 29961 tablet_bootstrap.cc:492] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:25.529783 29959 tablet_bootstrap.cc:654] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.530552 29960 tablet_bootstrap.cc:654] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.531773 29961 tablet_bootstrap.cc:654] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.541908 29960 tablet_bootstrap.cc:492] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:25.542181 29959 tablet_bootstrap.cc:492] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:25.542426 29960 ts_tablet_manager.cc:1403] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 12:20:25.542919 29959 ts_tablet_manager.cc:1403] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:20:25.545342 29960 raft_consensus.cc:359] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.546020 29961 tablet_bootstrap.cc:492] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:25.546083 29960 raft_consensus.cc:385] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.546525 29960 raft_consensus.cc:740] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.546638 29961 ts_tablet_manager.cc:1403] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.016s
I20260709 12:20:25.547446 29960 consensus_queue.cc:260] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.548808 29959 raft_consensus.cc:359] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.549567 29959 raft_consensus.cc:385] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.549479 29961 raft_consensus.cc:359] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.550086 29959 raft_consensus.cc:740] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.550329 29961 raft_consensus.cc:385] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.550688 29961 raft_consensus.cc:740] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.551115 29959 consensus_queue.cc:260] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.551416 29961 consensus_queue.cc:260] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.552301 29960 ts_tablet_manager.cc:1434] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:20:25.553072 29965 raft_consensus.cc:493] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.553570 29961 ts_tablet_manager.cc:1434] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:25.553773 29959 ts_tablet_manager.cc:1434] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:20:25.553550 29965 raft_consensus.cc:515] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.554725 29961 tablet_bootstrap.cc:492] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:25.556035 29965 leader_election.cc:290] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:25.556631 29959 tablet_bootstrap.cc:492] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:25.557624 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:25.559597 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:25.560213 29843 raft_consensus.cc:2468] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 0.
I20260709 12:20:25.562562 29961 tablet_bootstrap.cc:654] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.563005 29959 tablet_bootstrap.cc:654] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:25.563115 29881 leader_election.cc:343] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.563926 29883 leader_election.cc:304] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:25.564697 29965 raft_consensus.cc:2804] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.565104 29965 raft_consensus.cc:493] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.565485 29965 raft_consensus.cc:3060] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.572547 29960 tablet_bootstrap.cc:492] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:25.573212 29965 raft_consensus.cc:515] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.574579 29959 tablet_bootstrap.cc:492] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:25.575090 29959 ts_tablet_manager.cc:1403] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.011s
I20260709 12:20:25.576133 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
W20260709 12:20:25.577673 29881 leader_election.cc:343] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.578249 29959 raft_consensus.cc:359] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.579033 29959 raft_consensus.cc:385] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.579319 29959 raft_consensus.cc:740] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.579818 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:25.579252 29960 tablet_bootstrap.cc:654] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.580077 29959 consensus_queue.cc:260] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.580400 29843 raft_consensus.cc:3060] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.581840 29961 tablet_bootstrap.cc:492] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:25.582324 29961 ts_tablet_manager.cc:1403] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.007s
I20260709 12:20:25.585160 29961 raft_consensus.cc:359] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.585812 29961 raft_consensus.cc:385] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.586086 29961 raft_consensus.cc:740] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.586751 29961 consensus_queue.cc:260] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.589154 29959 ts_tablet_manager.cc:1434] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:20:25.589670 29965 leader_election.cc:290] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:25.589224 29843 raft_consensus.cc:2468] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 1.
I20260709 12:20:25.590304 29959 tablet_bootstrap.cc:492] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:25.594651 29961 ts_tablet_manager.cc:1434] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:20:25.595674 29961 tablet_bootstrap.cc:492] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:25.597148 29959 tablet_bootstrap.cc:654] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.599895 29883 leader_election.cc:304] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:25.601687 29960 tablet_bootstrap.cc:492] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:25.601989 29965 raft_consensus.cc:2804] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.602222 29960 ts_tablet_manager.cc:1403] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.008s
I20260709 12:20:25.601662 29961 tablet_bootstrap.cc:654] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.605031 29959 tablet_bootstrap.cc:492] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:25.605489 29959 ts_tablet_manager.cc:1403] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 12:20:25.605657 29960 raft_consensus.cc:359] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.606287 29960 raft_consensus.cc:385] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.606596 29960 raft_consensus.cc:740] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.607760 29961 tablet_bootstrap.cc:492] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:25.608297 29961 ts_tablet_manager.cc:1403] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:20:25.608150 29959 raft_consensus.cc:359] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.608223 29960 consensus_queue.cc:260] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.609063 29959 raft_consensus.cc:385] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.609438 29959 raft_consensus.cc:740] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.610234 29959 consensus_queue.cc:260] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.610893 29960 ts_tablet_manager.cc:1434] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:20:25.608394 29965 raft_consensus.cc:697] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:25.611532 29961 raft_consensus.cc:359] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.612246 29959 ts_tablet_manager.cc:1434] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:20:25.612386 29961 raft_consensus.cc:385] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.612771 29961 raft_consensus.cc:740] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.613294 29959 tablet_bootstrap.cc:492] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:25.612519 29965 consensus_queue.cc:237] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.613612 29961 consensus_queue.cc:260] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.618826 29961 ts_tablet_manager.cc:1434] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:20:25.612991 29960 tablet_bootstrap.cc:492] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:25.620128 29959 tablet_bootstrap.cc:654] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.623090 29961 tablet_bootstrap.cc:492] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:25.623441 29967 raft_consensus.cc:493] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.623894 29967 raft_consensus.cc:515] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.627477 29967 leader_election.cc:290] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.636868 29961 tablet_bootstrap.cc:654] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.641490 29663 catalog_manager.cc:5697] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.644483 29967 raft_consensus.cc:493] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.644969 29967 raft_consensus.cc:515] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.648659 29967 leader_election.cc:290] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.651866 29960 tablet_bootstrap.cc:654] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.652598 29959 tablet_bootstrap.cc:492] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:25.653118 29959 ts_tablet_manager.cc:1403] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.015s
I20260709 12:20:25.656180 29959 raft_consensus.cc:359] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.656884 29959 raft_consensus.cc:385] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.657200 29959 raft_consensus.cc:740] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.661134 29959 consensus_queue.cc:260] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.661515 29967 raft_consensus.cc:493] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.661998 29967 raft_consensus.cc:515] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.663398 29959 ts_tablet_manager.cc:1434] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.007s
I20260709 12:20:25.664422 29959 tablet_bootstrap.cc:492] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:25.664633 29967 leader_election.cc:290] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.670318 29959 tablet_bootstrap.cc:654] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.677274 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de59eec5a3fa4c16a615ab4f271aeac0" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:25.677367 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e757509278314c5488ceaeb9d1a547ca" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:25.678073 29765 raft_consensus.cc:2468] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:25.678186 29767 raft_consensus.cc:2468] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:25.679503 29766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9baf3160f54118b5ff0e7bc9dd1688" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:25.679679 29805 leader_election.cc:304] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:25.680248 29766 raft_consensus.cc:2468] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:25.680646 29805 leader_election.cc:304] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:25.681789 29967 raft_consensus.cc:2804] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.682127 29967 raft_consensus.cc:493] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.682444 29967 raft_consensus.cc:3060] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.684201 29918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e757509278314c5488ceaeb9d1a547ca" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:25.684940 29918 raft_consensus.cc:2468] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:25.686111 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9baf3160f54118b5ff0e7bc9dd1688" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:25.687405 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de59eec5a3fa4c16a615ab4f271aeac0" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:25.688126 29916 raft_consensus.cc:2468] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
W20260709 12:20:25.690012 29808 leader_election.cc:343] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.689931 29967 raft_consensus.cc:515] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.692778 29960 tablet_bootstrap.cc:492] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:25.693152 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de59eec5a3fa4c16a615ab4f271aeac0" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:25.693336 29960 ts_tablet_manager.cc:1403] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.005s
I20260709 12:20:25.693769 29916 raft_consensus.cc:3060] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.699791 29965 raft_consensus.cc:493] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.700321 29965 raft_consensus.cc:515] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.700497 29766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de59eec5a3fa4c16a615ab4f271aeac0" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:25.701182 29766 raft_consensus.cc:3060] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.702490 29965 leader_election.cc:290] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:25.704460 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703154aeb5de48ee977cc29ff0564c52" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:25.706655 29843 raft_consensus.cc:2468] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 0.
I20260709 12:20:25.708027 29883 leader_election.cc:304] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:25.705766 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703154aeb5de48ee977cc29ff0564c52" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:25.709036 29767 raft_consensus.cc:2468] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 0.
I20260709 12:20:25.710759 29965 raft_consensus.cc:2804] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.711203 29965 raft_consensus.cc:493] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.711531 29965 raft_consensus.cc:3060] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.713045 29766 raft_consensus.cc:2468] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:25.698565 29967 leader_election.cc:290] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.714296 29967 raft_consensus.cc:2804] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.714640 29967 raft_consensus.cc:493] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.714993 29967 raft_consensus.cc:3060] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.698225 29960 raft_consensus.cc:359] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.719089 29960 raft_consensus.cc:385] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.706918 29805 leader_election.cc:304] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:25.719609 29960 raft_consensus.cc:740] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.721076 29916 raft_consensus.cc:2468] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
W20260709 12:20:25.725848 29713 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:25.726864 29994 raft_consensus.cc:2804] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.727315 29994 raft_consensus.cc:493] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.727656 29994 raft_consensus.cc:3060] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.720676 29965 raft_consensus.cc:515] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.733559 29961 tablet_bootstrap.cc:492] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:25.720614 29805 leader_election.cc:304] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:25.734225 29961 ts_tablet_manager.cc:1403] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.115s	user 0.040s	sys 0.037s
I20260709 12:20:25.735487 29965 leader_election.cc:290] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:25.737037 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703154aeb5de48ee977cc29ff0564c52" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:25.733747 29960 consensus_queue.cc:260] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.737649 29843 raft_consensus.cc:3060] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.737433 29961 raft_consensus.cc:359] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.738266 29959 tablet_bootstrap.cc:492] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:25.738430 29961 raft_consensus.cc:385] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.738801 29959 ts_tablet_manager.cc:1403] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.075s	user 0.043s	sys 0.028s
I20260709 12:20:25.738930 29961 raft_consensus.cc:740] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.739867 29961 consensus_queue.cc:260] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.741605 29959 raft_consensus.cc:359] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.742273 29959 raft_consensus.cc:385] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.742535 29959 raft_consensus.cc:740] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.743212 29959 consensus_queue.cc:260] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.744954 29843 raft_consensus.cc:2468] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 1.
I20260709 12:20:25.745724 29960 ts_tablet_manager.cc:1434] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:20:25.746169 29883 leader_election.cc:304] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:25.747108 29965 raft_consensus.cc:2804] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.747581 29965 raft_consensus.cc:697] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:25.748353 29965 consensus_queue.cc:237] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.750944 29959 ts_tablet_manager.cc:1434] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:20:25.751035 29766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703154aeb5de48ee977cc29ff0564c52" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:25.751710 29766 raft_consensus.cc:3060] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.751966 29959 tablet_bootstrap.cc:492] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:25.753079 29961 ts_tablet_manager.cc:1434] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 12:20:25.757305 29959 tablet_bootstrap.cc:654] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.758105 29961 tablet_bootstrap.cc:492] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:25.761153 29967 raft_consensus.cc:515] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.763123 29960 tablet_bootstrap.cc:492] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
W20260709 12:20:25.769167 29805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:40789, user_credentials={real_user=slave}} blocked reactor thread for 48656.2us
I20260709 12:20:25.769353 29995 raft_consensus.cc:2804] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.769932 29995 raft_consensus.cc:697] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:25.770309 29664 catalog_manager.cc:5697] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.771471 29995 consensus_queue.cc:237] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.774999 29766 raft_consensus.cc:2468] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 1.
I20260709 12:20:25.777168 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e757509278314c5488ceaeb9d1a547ca" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:25.777789 29916 raft_consensus.cc:3060] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.778071 29961 tablet_bootstrap.cc:654] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.770753 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e757509278314c5488ceaeb9d1a547ca" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:25.781229 29767 raft_consensus.cc:3060] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.783434 29967 leader_election.cc:290] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.784574 29959 tablet_bootstrap.cc:492] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:25.785032 29959 ts_tablet_manager.cc:1403] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.019s
I20260709 12:20:25.785915 29916 raft_consensus.cc:2468] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:25.787129 29808 leader_election.cc:304] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:25.787654 29959 raft_consensus.cc:359] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.788115 29967 raft_consensus.cc:2804] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.788348 29959 raft_consensus.cc:385] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.788717 29959 raft_consensus.cc:740] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.788877 29967 raft_consensus.cc:697] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:25.789453 29959 consensus_queue.cc:260] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.789808 29967 consensus_queue.cc:237] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.788725 29767 raft_consensus.cc:2468] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:25.796430 29994 raft_consensus.cc:515] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.797971 29959 ts_tablet_manager.cc:1434] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:20:25.799190 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9baf3160f54118b5ff0e7bc9dd1688" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:25.799749 29767 raft_consensus.cc:3060] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.805714 29961 tablet_bootstrap.cc:492] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:25.806176 29961 ts_tablet_manager.cc:1403] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.007s
I20260709 12:20:25.807834 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9baf3160f54118b5ff0e7bc9dd1688" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:25.808450 29916 raft_consensus.cc:3060] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.808719 29961 raft_consensus.cc:359] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.808053 29960 tablet_bootstrap.cc:654] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.809357 29961 raft_consensus.cc:385] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.809919 29961 raft_consensus.cc:740] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.810076 29663 catalog_manager.cc:5697] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.810704 29961 consensus_queue.cc:260] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.809360 29767 raft_consensus.cc:2468] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:25.813014 29961 ts_tablet_manager.cc:1434] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:20:25.813364 29805 leader_election.cc:304] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:25.813881 29961 tablet_bootstrap.cc:492] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:25.814230 29967 raft_consensus.cc:2804] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.814724 29967 raft_consensus.cc:697] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:25.815261 29916 raft_consensus.cc:2468] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:25.815743 29994 leader_election.cc:290] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.815543 29967 consensus_queue.cc:237] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.819350 29966 raft_consensus.cc:493] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.819844 29966 raft_consensus.cc:515] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.822247 29960 tablet_bootstrap.cc:492] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:25.822780 29960 ts_tablet_manager.cc:1403] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.001s
I20260709 12:20:25.828648 29960 raft_consensus.cc:359] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.829140 29960 raft_consensus.cc:385] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.829480 29960 raft_consensus.cc:740] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.829070 29966 leader_election.cc:290] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.830281 29961 tablet_bootstrap.cc:654] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.830374 29960 consensus_queue.cc:260] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.832625 29960 ts_tablet_manager.cc:1434] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:25.833693 29960 tablet_bootstrap.cc:492] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:25.833158 29663 catalog_manager.cc:5697] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.834972 29663 catalog_manager.cc:5697] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.840395 29960 tablet_bootstrap.cc:654] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.846930 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:25.848011 29961 tablet_bootstrap.cc:492] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:25.848488 29961 ts_tablet_manager.cc:1403] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.004s
W20260709 12:20:25.848425 29733 leader_election.cc:343] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.851018 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:25.851208 29961 raft_consensus.cc:359] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.851668 29843 raft_consensus.cc:2468] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 0.
I20260709 12:20:25.851876 29961 raft_consensus.cc:385] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.852213 29961 raft_consensus.cc:740] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.852856 29960 tablet_bootstrap.cc:492] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:25.853430 29960 ts_tablet_manager.cc:1403] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.009s
I20260709 12:20:25.853039 29732 leader_election.cc:304] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:25.852877 29961 consensus_queue.cc:260] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.854128 29966 raft_consensus.cc:2804] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.854456 29966 raft_consensus.cc:493] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.854676 29966 raft_consensus.cc:3060] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.856026 29960 raft_consensus.cc:359] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.856127 29961 ts_tablet_manager.cc:1434] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:20:25.856666 29960 raft_consensus.cc:385] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.857240 29960 raft_consensus.cc:740] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.857915 29960 consensus_queue.cc:260] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.859877 29960 ts_tablet_manager.cc:1434] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:25.860759 29960 tablet_bootstrap.cc:492] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:25.862401 29966 raft_consensus.cc:515] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.865064 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:25.865585 29843 raft_consensus.cc:3060] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.866135 29960 tablet_bootstrap.cc:654] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.871074 29960 tablet_bootstrap.cc:492] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:25.871270 29966 leader_election.cc:290] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.871475 29960 ts_tablet_manager.cc:1403] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:20:25.871897 29843 raft_consensus.cc:2468] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:25.872279 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:25.872841 29916 raft_consensus.cc:3060] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.872897 29732 leader_election.cc:304] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:25.873679 29966 raft_consensus.cc:2804] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.874135 29960 raft_consensus.cc:359] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.874799 29960 raft_consensus.cc:385] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.875089 29960 raft_consensus.cc:740] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.874986 29966 raft_consensus.cc:697] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:25.875975 29960 consensus_queue.cc:260] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.876261 29966 consensus_queue.cc:237] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.877998 29960 ts_tablet_manager.cc:1434] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:25.878973 29916 raft_consensus.cc:2468] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:25.885185 29664 catalog_manager.cc:5697] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 0 to 1, leader changed from <none> to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 1 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.913163 29967 raft_consensus.cc:493] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.913595 29967 raft_consensus.cc:515] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.915095 29967 leader_election.cc:290] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.915716 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:25.916028 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:25.916270 29767 raft_consensus.cc:2468] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:25.916646 29916 raft_consensus.cc:2468] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:25.916751 29966 raft_consensus.cc:493] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.917313 29805 leader_election.cc:304] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:25.917373 29966 raft_consensus.cc:515] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:25.918246 29967 raft_consensus.cc:2804] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.918543 29967 raft_consensus.cc:493] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.918802 29967 raft_consensus.cc:3060] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.919363 29966 leader_election.cc:290] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:25.920109 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:25.920781 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:25.921515 29843 raft_consensus.cc:2393] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21fec92eb1844e8a91a0aed4ca9a21db in current term 1: Already voted for candidate c3f55e4e85ec4aba84a34ce054fcc227 in this term.
I20260709 12:20:25.922385 29732 leader_election.cc:304] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db; no voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:25.922983 29966 raft_consensus.cc:3060] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.925187 29967 raft_consensus.cc:515] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.927472 29967 leader_election.cc:290] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.927603 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:25.928052 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:25.928289 29767 raft_consensus.cc:3060] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.928622 29916 raft_consensus.cc:3060] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.929142 29966 raft_consensus.cc:2749] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:25.934828 29767 raft_consensus.cc:2468] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:25.934976 29916 raft_consensus.cc:2468] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:25.935899 29805 leader_election.cc:304] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:25.936474 29967 raft_consensus.cc:2804] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.936849 29967 raft_consensus.cc:697] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:25.937500 29967 consensus_queue.cc:237] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.944252 29664 catalog_manager.cc:5697] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.993614 29967 raft_consensus.cc:493] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.994091 29967 raft_consensus.cc:515] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:25.995908 29967 leader_election.cc:290] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:25.996449 29766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e81ee769c14958aaf73370eb16d780" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:25.996994 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e81ee769c14958aaf73370eb16d780" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:25.997100 29766 raft_consensus.cc:2468] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:25.997355 29965 consensus_queue.cc:1048] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.997725 29916 raft_consensus.cc:2468] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:25.998276 29805 leader_election.cc:304] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:25.999092 29967 raft_consensus.cc:2804] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.999430 29967 raft_consensus.cc:493] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.999759 29967 raft_consensus.cc:3060] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.006184 29967 raft_consensus.cc:515] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.008924 29967 leader_election.cc:290] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:26.008985 29766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e81ee769c14958aaf73370eb16d780" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:26.009109 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e81ee769c14958aaf73370eb16d780" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:26.009858 29766 raft_consensus.cc:3060] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.009867 29916 raft_consensus.cc:3060] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.016927 29766 raft_consensus.cc:2468] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:26.016927 29916 raft_consensus.cc:2468] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:26.018220 29808 leader_election.cc:304] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:26.018812 29967 raft_consensus.cc:2804] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:26.019331 29967 raft_consensus.cc:697] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:26.019996 29967 consensus_queue.cc:237] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.026909 29983 consensus_queue.cc:1048] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.032315 29966 raft_consensus.cc:493] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.031960 29664 catalog_manager.cc:5697] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.032817 29966 raft_consensus.cc:515] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.034951 29966 leader_election.cc:290] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:26.035583 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3f4a36ccac40b0b7a763c02d0a8002" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:26.035969 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3f4a36ccac40b0b7a763c02d0a8002" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:26.036247 29843 raft_consensus.cc:2468] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 0.
I20260709 12:20:26.036772 29916 raft_consensus.cc:2468] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 0.
I20260709 12:20:26.037271 29732 leader_election.cc:304] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:26.038048 29966 raft_consensus.cc:2804] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:26.038393 29966 raft_consensus.cc:493] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.038657 29966 raft_consensus.cc:3060] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.044305 29966 raft_consensus.cc:515] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.046277 29966 leader_election.cc:290] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:26.046864 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3f4a36ccac40b0b7a763c02d0a8002" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:26.047247 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3f4a36ccac40b0b7a763c02d0a8002" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:26.047475 29843 raft_consensus.cc:3060] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.047820 29916 raft_consensus.cc:3060] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.054262 29916 raft_consensus.cc:2468] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:26.054265 29843 raft_consensus.cc:2468] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:26.055373 29732 leader_election.cc:304] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:26.055963 29966 raft_consensus.cc:2804] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:26.056325 29966 raft_consensus.cc:697] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:26.057044 29966 consensus_queue.cc:237] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.063956 29664 catalog_manager.cc:5697] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 0 to 1, leader changed from <none> to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 1 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.236444 29967 consensus_queue.cc:1048] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.245586 29967 consensus_queue.cc:1048] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.251372 29967 consensus_queue.cc:1048] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.261993 29967 consensus_queue.cc:1048] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.287189 29916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
mode: GRACEFUL
new_leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:47208
I20260709 12:20:26.287700 29916 raft_consensus.cc:606] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Received request to transfer leadership to TS 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:26.290066 29967 consensus_queue.cc:1048] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.301097 29996 consensus_queue.cc:1048] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.303545 29843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e757509278314c5488ceaeb9d1a547ca"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
mode: GRACEFUL
new_leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:34946
I20260709 12:20:26.304098 29843 raft_consensus.cc:606] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Received request to transfer leadership to TS 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:26.310133 29843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
mode: GRACEFUL
new_leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:34946
I20260709 12:20:26.310568 29843 raft_consensus.cc:606] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Received request to transfer leadership to TS 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:26.316035 29916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "703154aeb5de48ee977cc29ff0564c52"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
mode: GRACEFUL
new_leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:47208
I20260709 12:20:26.316207 29996 raft_consensus.cc:993] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0: : Instructing follower 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:26.316728 29995 raft_consensus.cc:1081] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Signalling peer 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:26.318244 29916 raft_consensus.cc:606] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Received request to transfer leadership to TS 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:26.318375 29766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e757509278314c5488ceaeb9d1a547ca"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:49370
I20260709 12:20:26.318975 29766 raft_consensus.cc:493] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.319329 29766 raft_consensus.cc:3060] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.319283 29966 consensus_queue.cc:1048] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.326241 29766 raft_consensus.cc:515] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.331583 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e757509278314c5488ceaeb9d1a547ca" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:26.332194 29843 raft_consensus.cc:3055] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:26.332508 29843 raft_consensus.cc:740] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:26.333314 29843 consensus_queue.cc:260] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.334443 29843 raft_consensus.cc:3060] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.338227 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e757509278314c5488ceaeb9d1a547ca" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:26.338891 29917 raft_consensus.cc:3060] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.341504 29843 raft_consensus.cc:2468] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:26.333668 29766 leader_election.cc:290] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:26.339020 30010 consensus_queue.cc:1048] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:20:26.343281 29732 leader_election.cc:304] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:26.344019 30010 raft_consensus.cc:2804] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:26.344475 30010 raft_consensus.cc:697] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:26.345283 30010 consensus_queue.cc:237] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.345784 29983 consensus_queue.cc:1048] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.351926 29917 raft_consensus.cc:2468] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:26.352684 29965 raft_consensus.cc:993] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227: : Instructing follower 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:26.353420 29983 raft_consensus.cc:1081] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Signalling peer 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:26.355537 29765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "703154aeb5de48ee977cc29ff0564c52"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:49354
I20260709 12:20:26.356074 29765 raft_consensus.cc:493] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.356431 29765 raft_consensus.cc:3060] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.355707 29663 catalog_manager.cc:5697] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 1 to 2, leader changed from 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2) to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 2 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.352741 29767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
mode: GRACEFUL
new_leader_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:49378
I20260709 12:20:26.359427 29767 raft_consensus.cc:606] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Received request to transfer leadership to TS 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:26.363673 29983 consensus_queue.cc:1048] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.365406 29765 raft_consensus.cc:515] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.368551 29765 leader_election.cc:290] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:26.370303 29767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd3f4a36ccac40b0b7a763c02d0a8002"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
mode: GRACEFUL
new_leader_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:49378
I20260709 12:20:26.371378 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703154aeb5de48ee977cc29ff0564c52" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:26.371987 29916 raft_consensus.cc:3055] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:26.372375 29916 raft_consensus.cc:740] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:26.373267 30010 raft_consensus.cc:993] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db: : Instructing follower 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:26.373163 29916 consensus_queue.cc:260] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.373720 30010 raft_consensus.cc:1081] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Signalling peer 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:26.374264 29916 raft_consensus.cc:3060] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.371909 29841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703154aeb5de48ee977cc29ff0564c52" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:26.375555 29843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:34944
I20260709 12:20:26.376283 29843 raft_consensus.cc:493] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.376710 29843 raft_consensus.cc:3060] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.376956 29767 raft_consensus.cc:606] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Received request to transfer leadership to TS 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:26.383101 29916 raft_consensus.cc:2468] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:26.385030 29843 raft_consensus.cc:515] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.388005 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:26.388075 29733 leader_election.cc:304] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:26.388716 29767 raft_consensus.cc:3055] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:26.389075 29767 raft_consensus.cc:740] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:26.389343 29966 raft_consensus.cc:2804] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:26.389889 29767 consensus_queue.cc:260] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.389844 29966 raft_consensus.cc:697] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:26.391155 29767 raft_consensus.cc:3060] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.391366 29966 consensus_queue.cc:237] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.391850 29841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7e81ee769c14958aaf73370eb16d780"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
mode: GRACEFUL
new_leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:34946
I20260709 12:20:26.392516 29841 raft_consensus.cc:606] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Received request to transfer leadership to TS c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:26.399394 29843 leader_election.cc:290] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:26.403817 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:26.403479 29661 catalog_manager.cc:5697] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 1 to 2, leader changed from c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3) to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 2 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.404410 29916 raft_consensus.cc:3060] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.405467 29965 raft_consensus.cc:993] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227: : Instructing follower 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:26.405962 29983 raft_consensus.cc:1081] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Signalling peer 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:26.407886 29765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:49354
I20260709 12:20:26.408398 29765 raft_consensus.cc:493] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.408725 29765 raft_consensus.cc:3060] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.409109 29767 raft_consensus.cc:2468] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:26.410326 29805 leader_election.cc:304] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:26.411183 29995 raft_consensus.cc:2804] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:26.411660 29995 raft_consensus.cc:697] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:26.412398 29995 consensus_queue.cc:237] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.415657 29916 raft_consensus.cc:2468] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:26.416292 29765 raft_consensus.cc:515] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:26.418779 29765 leader_election.cc:290] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Requested vote from peers c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:26.418985 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:26.419903 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:26.420424 29842 raft_consensus.cc:3060] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.420424 29916 raft_consensus.cc:3055] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:26.420928 29916 raft_consensus.cc:740] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:26.421694 29916 consensus_queue.cc:260] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:26.422943 29916 raft_consensus.cc:3060] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.426832 29842 raft_consensus.cc:2468] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:26.427788 29732 leader_election.cc:304] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:26.428404 29966 raft_consensus.cc:2804] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:26.428473 29916 raft_consensus.cc:2468] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:26.428848 29966 raft_consensus.cc:697] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:26.429677 29966 consensus_queue.cc:237] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:26.429447 29661 catalog_manager.cc:5697] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 1 to 2, leader changed from 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1) to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.437619 29664 catalog_manager.cc:5697] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 1 to 2, leader changed from c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3) to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 2 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.440558 29995 consensus_queue.cc:1048] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.446717 29996 raft_consensus.cc:993] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0: : Instructing follower 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:26.447168 29994 raft_consensus.cc:1081] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Signalling peer 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:26.448730 29767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:49370
I20260709 12:20:26.449250 29767 raft_consensus.cc:493] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.449621 29767 raft_consensus.cc:3060] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.452093 29995 consensus_queue.cc:1048] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.456602 29767 raft_consensus.cc:515] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.460672 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:26.461205 29842 raft_consensus.cc:3055] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:26.461506 29842 raft_consensus.cc:740] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:26.461946 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885c880561f4dd59288e67dfe291a18" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:26.462492 29916 raft_consensus.cc:3060] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.462518 29842 consensus_queue.cc:260] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.461472 29767 leader_election.cc:290] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:26.463822 29842 raft_consensus.cc:3060] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.467762 29916 raft_consensus.cc:2468] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:26.468591 29842 raft_consensus.cc:2468] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:26.468736 29733 leader_election.cc:304] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:26.469602 29966 raft_consensus.cc:2804] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:26.470041 29966 raft_consensus.cc:697] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:26.470736 29966 consensus_queue.cc:237] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.476173 29661 catalog_manager.cc:5697] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 1 to 2, leader changed from 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2) to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 2 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.545876 29966 consensus_queue.cc:1048] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.551451 30010 raft_consensus.cc:993] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db: : Instructing follower 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:26.552052 29966 raft_consensus.cc:1081] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Signalling peer 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:26.554111 29843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd3f4a36ccac40b0b7a763c02d0a8002"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:34944
I20260709 12:20:26.556366 29995 consensus_queue.cc:1048] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.556783 29843 raft_consensus.cc:493] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.557293 29843 raft_consensus.cc:3060] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.558327 30036 consensus_queue.cc:1048] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.564828 29843 raft_consensus.cc:515] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.567924 29843 leader_election.cc:290] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:26.570334 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3f4a36ccac40b0b7a763c02d0a8002" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:26.570695 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3f4a36ccac40b0b7a763c02d0a8002" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:26.570880 29917 raft_consensus.cc:3060] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.571295 29765 raft_consensus.cc:3055] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:26.571651 29765 raft_consensus.cc:740] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:26.572399 29765 consensus_queue.cc:260] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.573459 29765 raft_consensus.cc:3060] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.573324 29995 consensus_queue.cc:1048] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:26.581694 29765 raft_consensus.cc:2468] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:26.581718 29917 raft_consensus.cc:2468] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:26.583603 29805 leader_election.cc:304] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:26.584535 29995 raft_consensus.cc:2804] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:26.584985 29995 raft_consensus.cc:697] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:26.585759 29995 consensus_queue.cc:237] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.587414 29996 raft_consensus.cc:993] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0: : Instructing follower c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:26.588160 29996 raft_consensus.cc:1081] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Signalling peer c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:26.590760 29916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7e81ee769c14958aaf73370eb16d780"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:47196
I20260709 12:20:26.593468 29916 raft_consensus.cc:493] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.593895 29916 raft_consensus.cc:3060] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.598057 29661 catalog_manager.cc:5697] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 1 to 2, leader changed from 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1) to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.600807 29916 raft_consensus.cc:515] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.603055 29916 leader_election.cc:290] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 2 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:26.603757 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e81ee769c14958aaf73370eb16d780" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:26.604239 29767 raft_consensus.cc:3060] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.604126 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e81ee769c14958aaf73370eb16d780" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:26.605226 29842 raft_consensus.cc:3055] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:26.605561 29842 raft_consensus.cc:740] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:26.606612 29842 consensus_queue.cc:260] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.607863 29842 raft_consensus.cc:3060] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.611346 29767 raft_consensus.cc:2468] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 2.
I20260709 12:20:26.612440 29881 leader_election.cc:304] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:26.613207 29965 raft_consensus.cc:2804] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:26.613574 29842 raft_consensus.cc:2468] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 2.
I20260709 12:20:26.613577 29965 raft_consensus.cc:697] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:26.614586 29965 consensus_queue.cc:237] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:26.620241 29663 catalog_manager.cc:5697] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 1 to 2, leader changed from 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2) to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:26.762053 29916 raft_consensus.cc:1275] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.763139 30036 consensus_queue.cc:1048] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.769889 29842 raft_consensus.cc:1275] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.772142 30010 consensus_queue.cc:1048] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.805835 29916 raft_consensus.cc:1275] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.806887 30010 consensus_queue.cc:1048] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.813311 29842 raft_consensus.cc:3060] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:26.819972 29842 raft_consensus.cc:1275] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.821051 30036 consensus_queue.cc:1048] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.850667 29767 raft_consensus.cc:1275] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.851879 29995 consensus_queue.cc:1048] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.858911 29916 raft_consensus.cc:1275] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.862903 29967 consensus_queue.cc:1048] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.897475 29842 raft_consensus.cc:1275] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.898579 30036 consensus_queue.cc:1048] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.905866 29916 raft_consensus.cc:1275] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.907364 29966 consensus_queue.cc:1048] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.938766 29842 raft_consensus.cc:1275] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.939816 29966 consensus_queue.cc:1048] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.946583 29916 raft_consensus.cc:1275] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.947947 29966 consensus_queue.cc:1048] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.036893 29916 raft_consensus.cc:1275] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.037952 29967 consensus_queue.cc:1048] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.044642 29767 raft_consensus.cc:1275] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.046599 29967 consensus_queue.cc:1048] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.127424 29767 raft_consensus.cc:1275] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.128571 30030 consensus_queue.cc:1048] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.135437 29842 raft_consensus.cc:1275] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.137360 30030 consensus_queue.cc:1048] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:29.426885 29661 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40764:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:29.429636 29661 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:29.486187 29749 tablet_service.cc:1511] Processing CreateTablet for tablet 75c6c218d7534c3d9f2c649e99931848 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:29.488292 29749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c6c218d7534c3d9f2c649e99931848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.488058 29827 tablet_service.cc:1511] Processing CreateTablet for tablet 75c6c218d7534c3d9f2c649e99931848 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:29.489820 29827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c6c218d7534c3d9f2c649e99931848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.489989 29906 tablet_service.cc:1511] Processing CreateTablet for tablet 75c6c218d7534c3d9f2c649e99931848 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:29.490891 29753 tablet_service.cc:1511] Processing CreateTablet for tablet 8061b3a4f7ff477eb5045ad4bf4bae91 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:29.491729 29906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c6c218d7534c3d9f2c649e99931848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.492413 29753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8061b3a4f7ff477eb5045ad4bf4bae91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.501420 29826 tablet_service.cc:1511] Processing CreateTablet for tablet 8061b3a4f7ff477eb5045ad4bf4bae91 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:29.502925 29826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8061b3a4f7ff477eb5045ad4bf4bae91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.507444 29903 tablet_service.cc:1511] Processing CreateTablet for tablet b97b6c8e666b434092e7a8e29af80527 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:29.508208 29902 tablet_service.cc:1511] Processing CreateTablet for tablet 8061b3a4f7ff477eb5045ad4bf4bae91 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:29.508929 29903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97b6c8e666b434092e7a8e29af80527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.512145 29750 tablet_service.cc:1511] Processing CreateTablet for tablet e9eaaae834404e2f95c843b8a0cf2fb8 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:29.513656 29750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9eaaae834404e2f95c843b8a0cf2fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.516156 29755 tablet_service.cc:1511] Processing CreateTablet for tablet b97b6c8e666b434092e7a8e29af80527 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:29.517611 29755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97b6c8e666b434092e7a8e29af80527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.518321 30058 tablet_bootstrap.cc:492] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:29.521023 29833 tablet_service.cc:1511] Processing CreateTablet for tablet b97b6c8e666b434092e7a8e29af80527 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:29.522369 29833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97b6c8e666b434092e7a8e29af80527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.527458 29902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8061b3a4f7ff477eb5045ad4bf4bae91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.530215 30058 tablet_bootstrap.cc:654] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.534236 29827 tablet_service.cc:1511] Processing CreateTablet for tablet e9eaaae834404e2f95c843b8a0cf2fb8 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:29.535593 29827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9eaaae834404e2f95c843b8a0cf2fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.542542 29900 tablet_service.cc:1511] Processing CreateTablet for tablet e9eaaae834404e2f95c843b8a0cf2fb8 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:29.543991 29900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9eaaae834404e2f95c843b8a0cf2fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.553947 29752 tablet_service.cc:1511] Processing CreateTablet for tablet be832a2b997a447488405c9339a62b45 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:29.554872 29824 tablet_service.cc:1511] Processing CreateTablet for tablet be832a2b997a447488405c9339a62b45 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:29.556315 29752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be832a2b997a447488405c9339a62b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.559820 29757 tablet_service.cc:1511] Processing CreateTablet for tablet f4973015cb0d4f629236264dcb97045a (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:29.560611 29825 tablet_service.cc:1511] Processing CreateTablet for tablet f4973015cb0d4f629236264dcb97045a (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:29.561353 29757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4973015cb0d4f629236264dcb97045a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.556317 29824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be832a2b997a447488405c9339a62b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.568919 29901 tablet_service.cc:1511] Processing CreateTablet for tablet f4973015cb0d4f629236264dcb97045a (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:29.569137 29756 tablet_service.cc:1511] Processing CreateTablet for tablet c8d236d1acfb4c1d84ed502b20b5f69a (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:29.570427 29901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4973015cb0d4f629236264dcb97045a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.572283 29825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4973015cb0d4f629236264dcb97045a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.570463 29756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d236d1acfb4c1d84ed502b20b5f69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.577736 29904 tablet_service.cc:1511] Processing CreateTablet for tablet c8d236d1acfb4c1d84ed502b20b5f69a (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:29.578497 29830 tablet_service.cc:1511] Processing CreateTablet for tablet c8d236d1acfb4c1d84ed502b20b5f69a (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:29.579278 29904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d236d1acfb4c1d84ed502b20b5f69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.579864 29830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d236d1acfb4c1d84ed502b20b5f69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.584738 29907 tablet_service.cc:1511] Processing CreateTablet for tablet 8f26d3a480944a1dadf32f91486658f9 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:29.586171 29907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f26d3a480944a1dadf32f91486658f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.588513 29751 tablet_service.cc:1511] Processing CreateTablet for tablet 8f26d3a480944a1dadf32f91486658f9 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:29.589895 29751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f26d3a480944a1dadf32f91486658f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.613408 29828 tablet_service.cc:1511] Processing CreateTablet for tablet 8f26d3a480944a1dadf32f91486658f9 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:29.615038 29828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f26d3a480944a1dadf32f91486658f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.643790 29906 tablet_service.cc:1511] Processing CreateTablet for tablet be832a2b997a447488405c9339a62b45 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:29.652400 30059 tablet_bootstrap.cc:492] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:29.656221 30061 tablet_bootstrap.cc:492] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:29.659826 29755 tablet_service.cc:1511] Processing CreateTablet for tablet 28b7a4917483436e8b818496202427e3 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:29.661157 29755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b7a4917483436e8b818496202427e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.661682 29824 tablet_service.cc:1511] Processing CreateTablet for tablet 28b7a4917483436e8b818496202427e3 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:29.663328 29906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be832a2b997a447488405c9339a62b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.665611 29824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b7a4917483436e8b818496202427e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.679886 30059 tablet_bootstrap.cc:654] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.682191 30058 tablet_bootstrap.cc:492] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:29.690011 30061 tablet_bootstrap.cc:654] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.704568 30058 ts_tablet_manager.cc:1403] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.187s	user 0.023s	sys 0.020s
I20260709 12:20:29.727378 29902 tablet_service.cc:1511] Processing CreateTablet for tablet 28b7a4917483436e8b818496202427e3 (DEFAULT_TABLE table=soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:29.728718 29902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b7a4917483436e8b818496202427e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:29.726642 30058 raft_consensus.cc:359] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.731993 30058 raft_consensus.cc:385] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.732306 30058 raft_consensus.cc:740] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.732689 30059 tablet_bootstrap.cc:492] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:29.733271 30059 ts_tablet_manager.cc:1403] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.009s
I20260709 12:20:29.733464 30058 consensus_queue.cc:260] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.736750 30058 ts_tablet_manager.cc:1434] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:20:29.736439 30059 raft_consensus.cc:359] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.737231 30059 raft_consensus.cc:385] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.737525 30059 raft_consensus.cc:740] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.737970 30058 tablet_bootstrap.cc:492] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:29.738416 30059 consensus_queue.cc:260] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.745690 30058 tablet_bootstrap.cc:654] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.746102 30059 ts_tablet_manager.cc:1434] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:20:29.747202 30059 tablet_bootstrap.cc:492] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:29.749905 30040 raft_consensus.cc:493] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.750514 30040 raft_consensus.cc:515] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.753566 30061 tablet_bootstrap.cc:492] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:29.754110 30061 ts_tablet_manager.cc:1403] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.098s	user 0.005s	sys 0.019s
I20260709 12:20:29.757180 30061 raft_consensus.cc:359] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.758250 30061 raft_consensus.cc:385] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.758064 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c6c218d7534c3d9f2c649e99931848" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:29.759361 30061 raft_consensus.cc:740] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
W20260709 12:20:29.759862 29733 leader_election.cc:343] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.760198 30061 consensus_queue.cc:260] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.764483 30040 leader_election.cc:290] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:29.759147 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c6c218d7534c3d9f2c649e99931848" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:29.765673 29842 raft_consensus.cc:2468] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 0.
W20260709 12:20:29.765911 29713 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:29.766613 30061 ts_tablet_manager.cc:1434] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:20:29.767531 29732 leader_election.cc:304] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:29.768476 30040 raft_consensus.cc:2804] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.768918 30040 raft_consensus.cc:493] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.769307 30040 raft_consensus.cc:3060] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.773670 30059 tablet_bootstrap.cc:654] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.775048 30061 tablet_bootstrap.cc:492] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:29.777443 30040 raft_consensus.cc:515] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.780644 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c6c218d7534c3d9f2c649e99931848" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:29.781108 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c6c218d7534c3d9f2c649e99931848" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:29.781358 29842 raft_consensus.cc:3060] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.782294 30061 tablet_bootstrap.cc:654] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:29.782527 29733 leader_election.cc:343] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.786083 30058 tablet_bootstrap.cc:492] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:29.786655 30058 ts_tablet_manager.cc:1403] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.019s
I20260709 12:20:29.787261 30061 tablet_bootstrap.cc:492] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:29.787698 30061 ts_tablet_manager.cc:1403] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:20:29.780687 30040 leader_election.cc:290] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:29.789402 29842 raft_consensus.cc:2468] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:29.789770 30058 raft_consensus.cc:359] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.789999 30061 raft_consensus.cc:359] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.790664 30061 raft_consensus.cc:385] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.790537 30058 raft_consensus.cc:385] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.790869 29732 leader_election.cc:304] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:29.790933 30061 raft_consensus.cc:740] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.791595 30058 raft_consensus.cc:740] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.792428 30058 consensus_queue.cc:260] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.793275 30040 raft_consensus.cc:2804] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:29.794914 30058 ts_tablet_manager.cc:1434] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:20:29.790815 30059 tablet_bootstrap.cc:492] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:29.795681 30059 ts_tablet_manager.cc:1403] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.005s
I20260709 12:20:29.799124 30059 raft_consensus.cc:359] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.799907 30059 raft_consensus.cc:385] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.800205 30059 raft_consensus.cc:740] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.801791 30058 tablet_bootstrap.cc:492] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:29.805544 30059 consensus_queue.cc:260] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.808501 30059 ts_tablet_manager.cc:1434] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:20:29.792112 30061 consensus_queue.cc:260] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.812434 30059 tablet_bootstrap.cc:492] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:29.814055 30061 ts_tablet_manager.cc:1434] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:20:29.815080 30061 tablet_bootstrap.cc:492] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:29.820261 30059 tablet_bootstrap.cc:654] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.824980 30058 tablet_bootstrap.cc:654] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.825502 30040 raft_consensus.cc:697] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:29.824980 30061 tablet_bootstrap.cc:654] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.826519 30040 consensus_queue.cc:237] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.834107 30059 tablet_bootstrap.cc:492] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:29.834739 30059 ts_tablet_manager.cc:1403] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 12:20:29.838322 30059 raft_consensus.cc:359] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.839308 30059 raft_consensus.cc:385] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.839689 30059 raft_consensus.cc:740] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.840553 30059 consensus_queue.cc:260] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.842633 29661 catalog_manager.cc:5697] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 0 to 1, leader changed from <none> to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 1 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.845160 30059 ts_tablet_manager.cc:1434] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:20:29.846366 30059 tablet_bootstrap.cc:492] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:29.853710 30059 tablet_bootstrap.cc:654] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.867554 30061 tablet_bootstrap.cc:492] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:29.868788 30061 ts_tablet_manager.cc:1403] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.023s
I20260709 12:20:29.871872 30058 tablet_bootstrap.cc:492] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:29.871860 30061 raft_consensus.cc:359] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.872567 30058 ts_tablet_manager.cc:1403] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.071s	user 0.028s	sys 0.018s
I20260709 12:20:29.873795 30061 raft_consensus.cc:385] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.874131 30061 raft_consensus.cc:740] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.875074 30059 tablet_bootstrap.cc:492] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:29.874892 30061 consensus_queue.cc:260] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.875556 30059 ts_tablet_manager.cc:1403] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
I20260709 12:20:29.875757 30058 raft_consensus.cc:359] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.876498 30058 raft_consensus.cc:385] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.876765 30058 raft_consensus.cc:740] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.877398 30061 ts_tablet_manager.cc:1434] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:20:29.877579 30058 consensus_queue.cc:260] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.878494 30061 tablet_bootstrap.cc:492] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:29.878954 30059 raft_consensus.cc:359] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.879700 30059 raft_consensus.cc:385] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.879971 30059 raft_consensus.cc:740] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.880102 30058 ts_tablet_manager.cc:1434] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:29.880719 30059 consensus_queue.cc:260] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.881435 30058 tablet_bootstrap.cc:492] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:29.883088 30059 ts_tablet_manager.cc:1434] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:20:29.884159 30059 tablet_bootstrap.cc:492] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:29.887320 30061 tablet_bootstrap.cc:654] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.894635 30059 tablet_bootstrap.cc:654] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.899449 30058 tablet_bootstrap.cc:654] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.906100 30045 raft_consensus.cc:493] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.907856 30045 raft_consensus.cc:515] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.912395 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:29.912634 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:29.913182 29767 raft_consensus.cc:2468] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 0.
W20260709 12:20:29.914146 29883 leader_election.cc:343] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.910347 30045 leader_election.cc:290] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:29.914880 29881 leader_election.cc:304] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:29.916216 30045 raft_consensus.cc:2804] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.916719 30045 raft_consensus.cc:493] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.917119 30045 raft_consensus.cc:3060] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.926501 30061 tablet_bootstrap.cc:492] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:29.927081 30061 ts_tablet_manager.cc:1403] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.023s
I20260709 12:20:29.927292 30045 raft_consensus.cc:515] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.929706 30061 raft_consensus.cc:359] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.930538 30061 raft_consensus.cc:385] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.930897 30061 raft_consensus.cc:740] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.930611 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:29.931363 30058 tablet_bootstrap.cc:492] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:29.932092 30058 ts_tablet_manager.cc:1403] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.010s
I20260709 12:20:29.931962 30061 consensus_queue.cc:260] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.930663 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
W20260709 12:20:29.932493 29883 leader_election.cc:343] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.933173 29767 raft_consensus.cc:3060] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.935576 30058 raft_consensus.cc:359] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.936244 30059 tablet_bootstrap.cc:492] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:29.936388 30058 raft_consensus.cc:385] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.936882 30058 raft_consensus.cc:740] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.937211 30045 leader_election.cc:290] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:29.937041 30059 ts_tablet_manager.cc:1403] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.003s
I20260709 12:20:29.937810 30058 consensus_queue.cc:260] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.940805 30058 ts_tablet_manager.cc:1434] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:20:29.941335 30061 ts_tablet_manager.cc:1434] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:20:29.941893 30058 tablet_bootstrap.cc:492] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:29.942395 30061 tablet_bootstrap.cc:492] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:29.941392 30059 raft_consensus.cc:359] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.945883 30059 raft_consensus.cc:385] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.946236 30059 raft_consensus.cc:740] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.947227 30059 consensus_queue.cc:260] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.949720 30061 tablet_bootstrap.cc:654] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.949748 30059 ts_tablet_manager.cc:1434] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:20:29.951928 30058 tablet_bootstrap.cc:654] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.954308 30040 raft_consensus.cc:493] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.951999 30059 tablet_bootstrap.cc:492] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:29.954831 30040 raft_consensus.cc:515] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.957005 30040 leader_election.cc:290] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:29.958537 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
W20260709 12:20:29.960850 29733 leader_election.cc:343] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.962558 30059 tablet_bootstrap.cc:654] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.966384 29767 raft_consensus.cc:2468] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 1.
I20260709 12:20:29.967173 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:29.968546 30040 raft_consensus.cc:493] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.973030 30061 tablet_bootstrap.cc:492] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:29.972688 30040 raft_consensus.cc:515] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.973608 30061 ts_tablet_manager.cc:1403] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.008s
I20260709 12:20:29.973909 30058 tablet_bootstrap.cc:492] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:29.974421 30058 ts_tablet_manager.cc:1403] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.009s
I20260709 12:20:29.973548 29881 leader_election.cc:304] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:29.975021 30040 leader_election.cc:290] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:29.975783 30045 raft_consensus.cc:2804] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:29.976328 30045 raft_consensus.cc:697] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:29.976625 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be832a2b997a447488405c9339a62b45" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:29.977210 30061 raft_consensus.cc:359] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.977186 30045 consensus_queue.cc:237] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.977676 30058 raft_consensus.cc:359] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.978142 30061 raft_consensus.cc:385] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.978374 30058 raft_consensus.cc:385] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.978461 30061 raft_consensus.cc:740] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
W20260709 12:20:29.978509 29733 leader_election.cc:343] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.978780 30058 raft_consensus.cc:740] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.979516 30061 consensus_queue.cc:260] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.979707 30058 consensus_queue.cc:260] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
W20260709 12:20:29.974457 29732 leader_election.cc:343] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.981376 29732 leader_election.cc:304] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db; no voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:29.982059 30061 ts_tablet_manager.cc:1434] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:29.982079 30058 ts_tablet_manager.cc:1434] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:29.982903 30040 raft_consensus.cc:2749] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.983314 30058 tablet_bootstrap.cc:492] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:29.983314 30061 tablet_bootstrap.cc:492] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:29.987041 30059 tablet_bootstrap.cc:492] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:29.987599 30059 ts_tablet_manager.cc:1403] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.001s
I20260709 12:20:29.987918 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be832a2b997a447488405c9339a62b45" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:29.988703 29842 raft_consensus.cc:2468] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 0.
I20260709 12:20:29.990314 29732 leader_election.cc:304] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:29.990732 30061 tablet_bootstrap.cc:654] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.990814 30059 raft_consensus.cc:359] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.991737 30059 raft_consensus.cc:385] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.992007 30059 raft_consensus.cc:740] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.992192 30040 raft_consensus.cc:2804] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.992611 30040 raft_consensus.cc:493] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.992947 30040 raft_consensus.cc:3060] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.997731 30058 tablet_bootstrap.cc:654] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.998605 30059 consensus_queue.cc:260] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:29.998411 29661 catalog_manager.cc:5697] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.001214 30059 ts_tablet_manager.cc:1434] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:20:30.002226 30059 tablet_bootstrap.cc:492] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:30.005087 30040 raft_consensus.cc:515] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.006996 30063 raft_consensus.cc:493] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.007534 30063 raft_consensus.cc:515] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.008365 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be832a2b997a447488405c9339a62b45" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:30.008976 29842 raft_consensus.cc:3060] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.009727 30063 leader_election.cc:290] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.011273 30080 raft_consensus.cc:493] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.011782 30080 raft_consensus.cc:515] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.012182 30059 tablet_bootstrap.cc:654] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.013980 30080 leader_election.cc:290] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:30.014470 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:30.018000 30061 tablet_bootstrap.cc:492] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:30.018597 30061 ts_tablet_manager.cc:1403] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.011s
W20260709 12:20:30.019526 29805 leader_election.cc:343] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.023635 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:30.024294 29916 raft_consensus.cc:2468] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:30.025660 29808 leader_election.cc:304] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:30.027109 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c6c218d7534c3d9f2c649e99931848" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:30.028440 30061 raft_consensus.cc:359] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.029204 30061 raft_consensus.cc:385] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.029496 30061 raft_consensus.cc:740] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.029701 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c6c218d7534c3d9f2c649e99931848" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:30.030524 29843 raft_consensus.cc:2393] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3f55e4e85ec4aba84a34ce054fcc227 in current term 1: Already voted for candidate 21fec92eb1844e8a91a0aed4ca9a21db in this term.
I20260709 12:20:30.030246 30061 consensus_queue.cc:260] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.031592 30063 raft_consensus.cc:2804] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.032009 30063 raft_consensus.cc:493] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.032330 30063 raft_consensus.cc:3060] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.034202 29883 leader_election.cc:304] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3f55e4e85ec4aba84a34ce054fcc227; no voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:30.038524 30061 ts_tablet_manager.cc:1434] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:20:30.039760 30061 tablet_bootstrap.cc:492] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:30.040508 29842 raft_consensus.cc:2468] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:30.041846 30080 raft_consensus.cc:3060] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.042258 29732 leader_election.cc:304] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:30.043299 30070 raft_consensus.cc:2804] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.043753 30070 raft_consensus.cc:697] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:30.044569 30070 consensus_queue.cc:237] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.052013 30071 raft_consensus.cc:493] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.052631 30071 raft_consensus.cc:515] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.056123 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97b6c8e666b434092e7a8e29af80527" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:30.056797 29916 raft_consensus.cc:2468] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 0.
I20260709 12:20:30.058068 29733 leader_election.cc:304] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:30.059152 30069 raft_consensus.cc:2804] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.059513 30069 raft_consensus.cc:493] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.059748 30062 raft_consensus.cc:493] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.060369 30062 raft_consensus.cc:515] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.061260 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97b6c8e666b434092e7a8e29af80527" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:30.061980 29843 raft_consensus.cc:2468] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 0.
I20260709 12:20:30.062502 30040 leader_election.cc:290] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.059823 30069 raft_consensus.cc:3060] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.064368 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be832a2b997a447488405c9339a62b45" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
W20260709 12:20:30.065886 29733 leader_election.cc:343] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.066784 30063 raft_consensus.cc:515] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.067206 30071 leader_election.cc:290] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.067469 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9eaaae834404e2f95c843b8a0cf2fb8" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:30.068198 29917 raft_consensus.cc:2468] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:30.069312 30063 leader_election.cc:290] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.069900 30080 raft_consensus.cc:2749] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:30.062671 30062 leader_election.cc:290] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.070693 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9eaaae834404e2f95c843b8a0cf2fb8" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:30.071399 29767 raft_consensus.cc:2468] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:30.072610 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:30.073884 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:30.074473 29917 raft_consensus.cc:3060] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.075695 30061 tablet_bootstrap.cc:654] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.076133 30069 raft_consensus.cc:515] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.070752 29808 leader_election.cc:304] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:30.083464 30069 leader_election.cc:290] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.084585 30062 raft_consensus.cc:2804] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.085165 30062 raft_consensus.cc:493] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.085605 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97b6c8e666b434092e7a8e29af80527" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:30.085067 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97b6c8e666b434092e7a8e29af80527" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:30.087127 29916 raft_consensus.cc:3060] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:30.086242 29805 leader_election.cc:343] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:30.091481 29842 raft_consensus.cc:3060] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.090924 29664 catalog_manager.cc:5697] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 0 to 1, leader changed from <none> to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 1 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.092202 30059 tablet_bootstrap.cc:492] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:30.092741 30059 ts_tablet_manager.cc:1403] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.033s
I20260709 12:20:30.092934 30058 tablet_bootstrap.cc:492] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:30.093478 30058 ts_tablet_manager.cc:1403] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.110s	user 0.025s	sys 0.019s
I20260709 12:20:30.095853 30059 raft_consensus.cc:359] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.096659 30059 raft_consensus.cc:385] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.096480 30058 raft_consensus.cc:359] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.097255 30059 raft_consensus.cc:740] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.097604 30058 raft_consensus.cc:385] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.098387 30061 tablet_bootstrap.cc:492] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:30.098083 30059 consensus_queue.cc:260] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.100833 30059 ts_tablet_manager.cc:1434] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:30.098905 30061 ts_tablet_manager.cc:1403] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.006s
I20260709 12:20:30.105826 30059 tablet_bootstrap.cc:492] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:30.108229 30061 raft_consensus.cc:359] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.109066 30061 raft_consensus.cc:385] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.109416 30061 raft_consensus.cc:740] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.098078 30058 raft_consensus.cc:740] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.086767 30062 raft_consensus.cc:3060] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.110210 30061 consensus_queue.cc:260] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.111033 30058 consensus_queue.cc:260] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.108230 29916 raft_consensus.cc:2468] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:30.113628 30058 ts_tablet_manager.cc:1434] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:20:30.113691 29733 leader_election.cc:304] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:30.114769 30070 raft_consensus.cc:2804] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.114980 30058 tablet_bootstrap.cc:492] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:30.115362 30070 raft_consensus.cc:697] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:30.116216 30070 consensus_queue.cc:237] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.121484 30061 ts_tablet_manager.cc:1434] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:20:30.122318 29842 raft_consensus.cc:2468] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:30.113587 29917 raft_consensus.cc:2468] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:30.125087 30061 tablet_bootstrap.cc:492] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:30.126219 30058 tablet_bootstrap.cc:654] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.121644 30059 tablet_bootstrap.cc:654] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.131880 29808 leader_election.cc:304] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:30.132791 30063 raft_consensus.cc:2804] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.133358 30063 raft_consensus.cc:697] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:30.134178 30063 consensus_queue.cc:237] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.139493 30058 tablet_bootstrap.cc:492] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:30.140092 30058 ts_tablet_manager.cc:1403] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.007s
I20260709 12:20:30.141999 30061 tablet_bootstrap.cc:654] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.144977 30062 raft_consensus.cc:515] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.143146 30058 raft_consensus.cc:359] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.147766 30058 raft_consensus.cc:385] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.148087 30058 raft_consensus.cc:740] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.148139 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9eaaae834404e2f95c843b8a0cf2fb8" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:30.148849 29765 raft_consensus.cc:3060] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.150331 30058 consensus_queue.cc:260] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.154649 30058 ts_tablet_manager.cc:1434] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:20:30.155859 30058 tablet_bootstrap.cc:492] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:30.156577 29765 raft_consensus.cc:2468] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:30.157917 29805 leader_election.cc:304] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:30.158700 30063 raft_consensus.cc:2804] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.158960 30061 tablet_bootstrap.cc:492] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:30.159211 30063 raft_consensus.cc:697] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:30.159711 30061 ts_tablet_manager.cc:1403] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.003s
I20260709 12:20:30.160185 30063 consensus_queue.cc:237] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.148365 29663 catalog_manager.cc:5697] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 0 to 1, leader changed from <none> to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 1 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.162175 30058 tablet_bootstrap.cc:654] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.162962 30061 raft_consensus.cc:359] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.163800 30061 raft_consensus.cc:385] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.164132 30061 raft_consensus.cc:740] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.164892 30061 consensus_queue.cc:260] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.166293 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9eaaae834404e2f95c843b8a0cf2fb8" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:30.166930 29917 raft_consensus.cc:3060] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.167912 30061 ts_tablet_manager.cc:1434] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:30.169080 30061 tablet_bootstrap.cc:492] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227: Bootstrap starting.
I20260709 12:20:30.174901 29917 raft_consensus.cc:2468] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:30.176517 30061 tablet_bootstrap.cc:654] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.176476 30062 leader_election.cc:290] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.182957 30058 tablet_bootstrap.cc:492] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:30.183379 30058 ts_tablet_manager.cc:1403] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.006s
I20260709 12:20:30.183910 30061 tablet_bootstrap.cc:492] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227: No bootstrap required, opened a new log
I20260709 12:20:30.184424 30061 ts_tablet_manager.cc:1403] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:20:30.186659 30059 tablet_bootstrap.cc:492] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:30.187232 30059 ts_tablet_manager.cc:1403] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.082s	user 0.025s	sys 0.010s
I20260709 12:20:30.186717 30061 raft_consensus.cc:359] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.187619 30061 raft_consensus.cc:385] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.187304 30058 raft_consensus.cc:359] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.187901 30061 raft_consensus.cc:740] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.188056 30058 raft_consensus.cc:385] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.188364 30058 raft_consensus.cc:740] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.188702 30061 consensus_queue.cc:260] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.189291 30058 consensus_queue.cc:260] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.188745 29663 catalog_manager.cc:5697] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.190065 30059 raft_consensus.cc:359] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.190770 30059 raft_consensus.cc:385] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.191066 30059 raft_consensus.cc:740] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.191656 30058 ts_tablet_manager.cc:1434] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:30.191767 30059 consensus_queue.cc:260] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.191370 29663 catalog_manager.cc:5697] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.192700 30058 tablet_bootstrap.cc:492] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0: Bootstrap starting.
I20260709 12:20:30.193934 30059 ts_tablet_manager.cc:1434] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:30.194931 30059 tablet_bootstrap.cc:492] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db: Bootstrap starting.
I20260709 12:20:30.199621 30063 raft_consensus.cc:493] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.200191 30063 raft_consensus.cc:515] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.200657 30059 tablet_bootstrap.cc:654] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.202349 30063 leader_election.cc:290] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.203540 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f26d3a480944a1dadf32f91486658f9" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:30.203980 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f26d3a480944a1dadf32f91486658f9" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:30.204679 29917 raft_consensus.cc:2468] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:30.204367 29765 raft_consensus.cc:2468] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 0.
I20260709 12:20:30.206091 29808 leader_election.cc:304] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:30.207284 30063 raft_consensus.cc:2804] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.207661 30063 raft_consensus.cc:493] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.207975 30063 raft_consensus.cc:3060] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.212157 30059 tablet_bootstrap.cc:492] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db: No bootstrap required, opened a new log
I20260709 12:20:30.212658 30059 ts_tablet_manager.cc:1403] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 12:20:30.214979 30058 tablet_bootstrap.cc:654] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:30.215128 30059 raft_consensus.cc:359] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.215986 30059 raft_consensus.cc:385] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.216259 30059 raft_consensus.cc:740] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.216367 30061 ts_tablet_manager.cc:1434] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:20:30.217075 30059 consensus_queue.cc:260] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.219144 30059 ts_tablet_manager.cc:1434] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:20:30.218915 30063 raft_consensus.cc:515] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.222077 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f26d3a480944a1dadf32f91486658f9" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:30.222664 29917 raft_consensus.cc:3060] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.222862 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f26d3a480944a1dadf32f91486658f9" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:30.223467 29765 raft_consensus.cc:3060] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.229662 29765 raft_consensus.cc:2468] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:30.229955 29917 raft_consensus.cc:2468] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 1.
I20260709 12:20:30.231045 29805 leader_election.cc:304] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:30.232015 30062 raft_consensus.cc:2804] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.232509 30062 raft_consensus.cc:697] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:30.232769 30058 tablet_bootstrap.cc:492] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0: No bootstrap required, opened a new log
I20260709 12:20:30.233286 30058 ts_tablet_manager.cc:1403] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 12:20:30.233868 30063 leader_election.cc:290] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.233345 30062 consensus_queue.cc:237] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.237428 30058 raft_consensus.cc:359] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.238166 30058 raft_consensus.cc:385] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:30.238430 30058 raft_consensus.cc:740] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Initialized, Role: FOLLOWER
I20260709 12:20:30.239131 30058 consensus_queue.cc:260] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.240664 30058 ts_tablet_manager.cc:1434] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:20:30.241322 29664 catalog_manager.cc:5697] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 1 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.248790 30070 raft_consensus.cc:493] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.249392 30070 raft_consensus.cc:515] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.251574 30070 leader_election.cc:290] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.252283 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7a4917483436e8b818496202427e3" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:30.252677 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7a4917483436e8b818496202427e3" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:30.253854 29842 raft_consensus.cc:2468] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 0.
I20260709 12:20:30.254102 29917 raft_consensus.cc:2468] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 0.
I20260709 12:20:30.254997 29732 leader_election.cc:304] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:30.255805 30070 raft_consensus.cc:2804] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.256197 30070 raft_consensus.cc:493] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.256523 30070 raft_consensus.cc:3060] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.261971 30070 raft_consensus.cc:515] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.263590 30070 leader_election.cc:290] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.264353 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7a4917483436e8b818496202427e3" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:30.264524 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7a4917483436e8b818496202427e3" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:30.264932 29842 raft_consensus.cc:3060] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.265074 29917 raft_consensus.cc:3060] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.269897 29842 raft_consensus.cc:2468] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:30.270080 29917 raft_consensus.cc:2468] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 1.
I20260709 12:20:30.271003 29732 leader_election.cc:304] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:30.271736 30070 raft_consensus.cc:2804] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.272082 30070 raft_consensus.cc:697] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:30.272751 30070 consensus_queue.cc:237] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.280259 29664 catalog_manager.cc:5697] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 0 to 1, leader changed from <none> to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 1 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.299741 30080 raft_consensus.cc:493] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.300278 30080 raft_consensus.cc:515] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.302062 30080 leader_election.cc:290] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:30.302800 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:30.303117 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:30.303447 29765 raft_consensus.cc:2468] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 0.
I20260709 12:20:30.303717 29842 raft_consensus.cc:2468] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 0.
I20260709 12:20:30.304418 29881 leader_election.cc:304] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:30.305184 30080 raft_consensus.cc:2804] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:30.305454 30080 raft_consensus.cc:493] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.305677 30080 raft_consensus.cc:3060] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.311139 30080 raft_consensus.cc:515] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.312704 30070 consensus_queue.cc:1048] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:30.312968 30080 leader_election.cc:290] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:30.313807 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:30.314073 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:30.314399 29765 raft_consensus.cc:3060] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.314684 29842 raft_consensus.cc:3060] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.321439 29765 raft_consensus.cc:2468] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 1.
I20260709 12:20:30.321812 29842 raft_consensus.cc:2468] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 1.
I20260709 12:20:30.322572 29881 leader_election.cc:304] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:30.323499 30080 raft_consensus.cc:2804] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:30.323968 30080 raft_consensus.cc:697] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:30.324754 30080 consensus_queue.cc:237] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.333737 29664 catalog_manager.cc:5697] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.337275 30070 consensus_queue.cc:1048] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.367810 30080 consensus_queue.cc:1048] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.376607 29842 raft_consensus.cc:3060] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.385417 30109 consensus_queue.cc:1048] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:30.401634 29842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
mode: GRACEFUL
new_leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:34946
I20260709 12:20:30.402125 29842 raft_consensus.cc:606] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Received request to transfer leadership to TS 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:30.409691 29842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9eaaae834404e2f95c843b8a0cf2fb8"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
mode: GRACEFUL
new_leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:34946
I20260709 12:20:30.410256 29842 raft_consensus.cc:606] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Received request to transfer leadership to TS 21fec92eb1844e8a91a0aed4ca9a21db
I20260709 12:20:30.414638 29765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be832a2b997a447488405c9339a62b45"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
mode: GRACEFUL
new_leader_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:49378
I20260709 12:20:30.415160 29765 raft_consensus.cc:606] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Received request to transfer leadership to TS 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:30.419917 29917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
mode: GRACEFUL
new_leader_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:47208
I20260709 12:20:30.420473 29917 raft_consensus.cc:606] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Received request to transfer leadership to TS 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:30.425274 29917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
mode: GRACEFUL
new_leader_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:47208
I20260709 12:20:30.425781 29917 raft_consensus.cc:606] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Received request to transfer leadership to TS 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:30.432492 29765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28b7a4917483436e8b818496202427e3"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
mode: GRACEFUL
new_leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:49378
I20260709 12:20:30.432986 29765 raft_consensus.cc:606] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Received request to transfer leadership to TS c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:30.460896 29917 raft_consensus.cc:3060] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.469141 30070 consensus_queue.cc:1048] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.479902 30069 consensus_queue.cc:1048] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.487360 30040 raft_consensus.cc:993] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db: : Instructing follower 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:30.487818 30040 raft_consensus.cc:1081] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Signalling peer 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:30.489714 29842 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be832a2b997a447488405c9339a62b45"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:34944
I20260709 12:20:30.490209 29842 raft_consensus.cc:493] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.490468 29842 raft_consensus.cc:3060] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.495069 29842 raft_consensus.cc:515] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.497004 29842 leader_election.cc:290] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.497470 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be832a2b997a447488405c9339a62b45" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:30.497618 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be832a2b997a447488405c9339a62b45" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:30.498240 29917 raft_consensus.cc:3060] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.498160 29765 raft_consensus.cc:3055] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.498754 29765 raft_consensus.cc:740] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:30.499519 29765 consensus_queue.cc:260] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.500535 29765 raft_consensus.cc:3060] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.504550 29917 raft_consensus.cc:2468] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:30.505721 29808 leader_election.cc:304] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:30.505844 29765 raft_consensus.cc:2468] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:30.506565 30062 raft_consensus.cc:2804] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.507100 30062 raft_consensus.cc:697] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:30.507777 30062 consensus_queue.cc:237] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.513948 29661 catalog_manager.cc:5697] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 1 to 2, leader changed from 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1) to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.571070 30062 consensus_queue.cc:1048] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.581729 29765 raft_consensus.cc:3060] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:30.589030 30062 consensus_queue.cc:1048] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.590417 30062 consensus_queue.cc:1048] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.597061 30062 raft_consensus.cc:993] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0: : Instructing follower 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:30.598232 30063 raft_consensus.cc:993] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0: : Instructing follower 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:30.598631 30063 raft_consensus.cc:1081] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Signalling peer 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:30.599372 30063 raft_consensus.cc:1081] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Signalling peer 21fec92eb1844e8a91a0aed4ca9a21db to start an election
I20260709 12:20:30.604007 30116 consensus_queue.cc:1048] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:30.605115 29766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9eaaae834404e2f95c843b8a0cf2fb8"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:49370
I20260709 12:20:30.605404 29765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
 from {username='slave'} at 127.0.0.1:49370
I20260709 12:20:30.605974 29766 raft_consensus.cc:493] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.606160 29765 raft_consensus.cc:493] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.606405 29766 raft_consensus.cc:3060] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.606681 29765 raft_consensus.cc:3060] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.614158 29766 raft_consensus.cc:515] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.614329 29765 raft_consensus.cc:515] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.617283 29765 leader_election.cc:290] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.617697 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9eaaae834404e2f95c843b8a0cf2fb8" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:30.618407 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:30.619033 29916 raft_consensus.cc:3060] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.618944 29843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:30.620144 29843 raft_consensus.cc:3055] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.620432 29843 raft_consensus.cc:740] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:30.621246 29843 consensus_queue.cc:260] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.622566 29843 raft_consensus.cc:3060] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.618360 29842 raft_consensus.cc:3055] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.626693 29842 raft_consensus.cc:740] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:30.626816 29916 raft_consensus.cc:2468] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:30.628543 29733 leader_election.cc:304] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:30.629015 29917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9eaaae834404e2f95c843b8a0cf2fb8" candidate_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:30.629418 30069 raft_consensus.cc:2804] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.629694 29917 raft_consensus.cc:3060] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.630117 30069 raft_consensus.cc:697] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:30.630999 30069 consensus_queue.cc:237] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.634124 29842 consensus_queue.cc:260] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.635334 29842 raft_consensus.cc:3060] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.635645 29766 leader_election.cc:290] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Requested vote from peers 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.634104 29843 raft_consensus.cc:2468] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:30.642625 29842 raft_consensus.cc:2468] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:30.643349 29917 raft_consensus.cc:2468] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fec92eb1844e8a91a0aed4ca9a21db in term 2.
I20260709 12:20:30.643692 29732 leader_election.cc:304] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:30.644558 30069 raft_consensus.cc:2804] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.644935 30069 raft_consensus.cc:697] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Becoming Leader. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:30.645303 29663 catalog_manager.cc:5697] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 1 to 2, leader changed from 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2) to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 2 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.645524 30069 consensus_queue.cc:237] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.656670 29663 catalog_manager.cc:5697] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db reported cstate change: term changed from 1 to 2, leader changed from 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2) to 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1). New cstate: current_term: 2 leader_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.685739 30069 consensus_queue.cc:1048] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.689719 30069 consensus_queue.cc:1048] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.696324 30071 consensus_queue.cc:1048] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.711894 30069 consensus_queue.cc:1048] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:30.723009 30040 raft_consensus.cc:993] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db: : Instructing follower c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:30.723503 30040 raft_consensus.cc:1081] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Signalling peer c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:30.725265 29916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28b7a4917483436e8b818496202427e3"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:47204
I20260709 12:20:30.725806 29916 raft_consensus.cc:493] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.726154 29916 raft_consensus.cc:3060] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.731583 29916 raft_consensus.cc:515] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.733093 29916 leader_election.cc:290] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 2 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:30.734423 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7a4917483436e8b818496202427e3" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:30.735057 29842 raft_consensus.cc:3060] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.734313 29766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b7a4917483436e8b818496202427e3" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:30.735916 29766 raft_consensus.cc:3055] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.736264 29766 raft_consensus.cc:740] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:30.737068 29766 consensus_queue.cc:260] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.738262 29766 raft_consensus.cc:3060] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.741268 29842 raft_consensus.cc:2468] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 2.
I20260709 12:20:30.742403 29883 leader_election.cc:304] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:30.743170 30109 raft_consensus.cc:2804] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.743649 30109 raft_consensus.cc:697] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:30.744421 30109 consensus_queue.cc:237] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.744971 29766 raft_consensus.cc:2468] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 2.
I20260709 12:20:30.746915 30116 consensus_queue.cc:1048] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.748116 30109 consensus_queue.cc:1048] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.752713 29661 catalog_manager.cc:5697] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 1 to 2, leader changed from 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1) to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.757218 30063 consensus_queue.cc:1048] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.763973 30045 consensus_queue.cc:1048] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.777437 30045 raft_consensus.cc:993] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227: : Instructing follower 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:30.777940 30109 raft_consensus.cc:1081] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Signalling peer 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:30.783831 29842 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:34942
I20260709 12:20:30.784391 29842 raft_consensus.cc:493] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.784693 29842 raft_consensus.cc:3060] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.790830 29842 raft_consensus.cc:515] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.793262 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:30.793701 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:30.793879 29765 raft_consensus.cc:3060] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.794333 29916 raft_consensus.cc:3055] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.794674 29916 raft_consensus.cc:740] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:30.795396 29916 consensus_queue.cc:260] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.796593 29916 raft_consensus.cc:3060] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.801812 29765 raft_consensus.cc:2468] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:30.803025 29805 leader_election.cc:304] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:30.803580 29842 leader_election.cc:290] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:30.803869 30063 raft_consensus.cc:2804] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.804414 30063 raft_consensus.cc:697] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:30.803313 29916 raft_consensus.cc:2468] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:30.805230 30063 consensus_queue.cc:237] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:30.813144 29661 catalog_manager.cc:5697] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 1 to 2, leader changed from c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3) to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.887871 29916 raft_consensus.cc:1275] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.889020 30063 consensus_queue.cc:1048] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:30.896380 29765 raft_consensus.cc:1275] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.897935 30116 consensus_queue.cc:1048] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:30.992129 30080 raft_consensus.cc:993] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227: : Instructing follower 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:30.992558 30109 raft_consensus.cc:1081] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Signalling peer 6448facc90e842f2bf981f3648a9b0d0 to start an election
I20260709 12:20:30.993991 29842 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
 from {username='slave'} at 127.0.0.1:34942
I20260709 12:20:30.994413 29842 raft_consensus.cc:493] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.994676 29842 raft_consensus.cc:3060] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.999411 29842 raft_consensus.cc:515] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:31.001045 29842 leader_election.cc:290] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:31.001885 29766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:31.002450 29766 raft_consensus.cc:3060] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.002951 29916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
I20260709 12:20:31.003522 29916 raft_consensus.cc:3055] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:31.004154 29916 raft_consensus.cc:740] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:31.005088 29916 consensus_queue.cc:260] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:31.006095 29916 raft_consensus.cc:3060] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:31.008164 29766 raft_consensus.cc:2468] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:31.009263 29805 leader_election.cc:304] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0; no voters: 
I20260709 12:20:31.009902 30116 raft_consensus.cc:2804] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:31.010385 30116 raft_consensus.cc:697] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Becoming Leader. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:31.011178 30116 consensus_queue.cc:237] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:31.011448 29916 raft_consensus.cc:2468] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6448facc90e842f2bf981f3648a9b0d0 in term 2.
I20260709 12:20:31.017917 29663 catalog_manager.cc:5697] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 reported cstate change: term changed from 1 to 2, leader changed from c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3) to 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2). New cstate: current_term: 2 leader_uuid: "6448facc90e842f2bf981f3648a9b0d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.036427 29842 raft_consensus.cc:1275] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.037519 30071 consensus_queue.cc:1048] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.044432 29916 raft_consensus.cc:1275] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.045782 30040 consensus_queue.cc:1048] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.049368 29843 raft_consensus.cc:1275] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.052570 30071 consensus_queue.cc:1048] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.061110 29917 raft_consensus.cc:1275] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 21fec92eb1844e8a91a0aed4ca9a21db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.062491 30040 consensus_queue.cc:1048] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.242391 29917 raft_consensus.cc:1275] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.243673 30116 consensus_queue.cc:1048] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.250701 29766 raft_consensus.cc:1275] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.252460 30063 consensus_queue.cc:1048] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.258558 29765 raft_consensus.cc:1275] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.260056 30109 consensus_queue.cc:1048] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.268705 29842 raft_consensus.cc:1275] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:31.270207 30045 consensus_queue.cc:1048] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:32.058563 29765 raft_consensus.cc:1275] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:32.070807 30130 consensus_queue.cc:1048] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:32.093094 29915 raft_consensus.cc:1275] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Refusing update from remote peer 6448facc90e842f2bf981f3648a9b0d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:32.098074 30132 consensus_queue.cc:1048] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:32.465432 29788 debug-util.cc:398] Leaking SignalData structure 0x7b080013b500 after lost signal to thread 19891
W20260709 12:20:32.466485 29788 debug-util.cc:398] Leaking SignalData structure 0x7b0800213960 after lost signal to thread 29699
W20260709 12:20:32.467537 29788 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5b40 after lost signal to thread 29791
W20260709 12:20:32.468474 29788 debug-util.cc:398] Leaking SignalData structure 0x7b080023e400 after lost signal to thread 29868
W20260709 12:20:32.469376 29788 debug-util.cc:398] Leaking SignalData structure 0x7b0800096ae0 after lost signal to thread 29943
I20260709 12:20:33.555222 29664 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40764:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:20:33.575774 29664 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40764:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:20:33.734051 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:20:33.725356 29733 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:38529, user_credentials={real_user=slave}} blocked reactor thread for 66612.4us
W20260709 12:20:33.872941 30180 log.cc:927] Time spent T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:20:33.833060 30191 tablet.cc:1724] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:33.857596 30187 tablet.cc:1724] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:33.902024 30193 tablet.cc:1724] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:33.928193 30190 log.cc:927] Time spent T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:20:33.983937 30189 log.cc:927] Time spent T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:20:33.882634 30198 tablet.cc:1724] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:33.939030 30201 tablet.cc:1724] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:33.933926 30199 tablet.cc:1724] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:33.999516 30197 log.cc:927] Time spent T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:20:34.004081 30194 log.cc:927] Time spent T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:20:33.998708 30200 log.cc:927] Time spent T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:20:33.912498 30196 tablet.cc:1724] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:33.999390 30208 tablet.cc:1724] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:34.056670 29945 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:75c6c218d7534c3d9f2c649e99931848)
W20260709 12:20:34.071862 29945 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:75c6c218d7534c3d9f2c649e99931848)
W20260709 12:20:34.072947 29945 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:75c6c218d7534c3d9f2c649e99931848)
I20260709 12:20:34.076838 29762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
mode: GRACEFUL
new_leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:53806
I20260709 12:20:34.077687 29762 raft_consensus.cc:606] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Received request to transfer leadership to TS c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:34.101718 30212 tablet.cc:1724] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.103632 30210 tablet.cc:1724] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.105584 30199 tablet.cc:1724] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.111035 30209 tablet.cc:1724] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.123238 30193 tablet.cc:1724] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.124720 30191 tablet.cc:1724] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.134083 30208 tablet.cc:1724] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.148499 30201 tablet.cc:1724] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.126675 30215 tablet.cc:1724] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.155509 30198 tablet.cc:1724] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.159240 30209 tablet.cc:1724] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.157068 30196 tablet.cc:1724] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.169516 30210 tablet.cc:1724] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.175593 30212 tablet.cc:1724] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.177232 30209 tablet.cc:1724] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.207100 30215 tablet.cc:1724] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.209486 30187 tablet.cc:1724] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.213686 30199 tablet.cc:1724] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.231997 30212 tablet.cc:1724] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:34.240691 29842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
mode: GRACEFUL
new_leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:52618
I20260709 12:20:34.241285 29842 raft_consensus.cc:606] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Received request to transfer leadership to TS c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:34.242828 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:20:34.243486 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:34.253724 29842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa"
dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
mode: GRACEFUL
new_leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:52618
I20260709 12:20:34.254300 29842 raft_consensus.cc:606] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Received request to transfer leadership to TS c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:34.257782 29765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f"
dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
mode: GRACEFUL
new_leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:53806
I20260709 12:20:34.258360 29765 raft_consensus.cc:606] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Received request to transfer leadership to TS c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:34.260008 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:34.260643 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:34.265741 29664 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef: soft_deleted_table [id=f167672c178c42bb8dc95fd586f79ae1] alter complete (version 1)
I20260709 12:20:34.389468 30176 raft_consensus.cc:993] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db: : Instructing follower c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:34.389952 30176 raft_consensus.cc:1081] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Signalling peer c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:34.391739 29912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:47204
I20260709 12:20:34.392355 29912 raft_consensus.cc:493] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:34.392779 29912 raft_consensus.cc:3060] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.398350 30176 raft_consensus.cc:993] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db: : Instructing follower c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:34.399608 30178 raft_consensus.cc:1081] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Signalling peer c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:34.400609 29912 raft_consensus.cc:515] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:34.401456 29911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:47204
I20260709 12:20:34.402078 29911 raft_consensus.cc:493] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:34.402421 29911 raft_consensus.cc:3060] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.402601 29912 leader_election.cc:290] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:34.403609 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:34.404175 29765 raft_consensus.cc:3055] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:34.404438 29765 raft_consensus.cc:740] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:34.405223 29765 consensus_queue.cc:260] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:34.404845 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee6d776bed5f4744924d72a4575b239f" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:34.412365 29842 raft_consensus.cc:3060] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.412748 29765 raft_consensus.cc:3060] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.410084 29911 raft_consensus.cc:515] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:34.416198 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:34.416766 29767 raft_consensus.cc:3055] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:34.417063 29767 raft_consensus.cc:740] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21fec92eb1844e8a91a0aed4ca9a21db, State: Running, Role: LEADER
I20260709 12:20:34.417325 29911 leader_election.cc:290] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:34.417822 29767 consensus_queue.cc:260] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:34.419158 29767 raft_consensus.cc:3060] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.421108 29842 raft_consensus.cc:2468] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 3.
I20260709 12:20:34.419924 29841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8061b3a4f7ff477eb5045ad4bf4bae91" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:34.421766 29841 raft_consensus.cc:3060] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.422392 29883 leader_election.cc:304] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:34.423398 30177 raft_consensus.cc:2804] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.423854 30177 raft_consensus.cc:697] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:34.424615 30177 consensus_queue.cc:237] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } }
I20260709 12:20:34.429795 29765 raft_consensus.cc:2468] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 3.
I20260709 12:20:34.430761 29767 raft_consensus.cc:2468] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 3.
I20260709 12:20:34.432103 29881 leader_election.cc:304] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:34.432948 30177 raft_consensus.cc:2804] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.433763 30177 raft_consensus.cc:697] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:34.434562 30207 raft_consensus.cc:993] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0: : Instructing follower c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:34.435221 30207 raft_consensus.cc:1081] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Signalling peer c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:34.434566 30177 consensus_queue.cc:237] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:34.437037 29911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:47196
I20260709 12:20:34.437582 29911 raft_consensus.cc:493] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:34.437922 29911 raft_consensus.cc:3060] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.438071 29663 catalog_manager.cc:5697] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 2 to 3, leader changed from 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1) to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.440394 29841 raft_consensus.cc:2468] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 3.
I20260709 12:20:34.445158 29911 raft_consensus.cc:515] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:34.447713 29911 leader_election.cc:290] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:34.449440 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:34.449851 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4973015cb0d4f629236264dcb97045a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:34.450415 29767 raft_consensus.cc:3060] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.450009 29842 raft_consensus.cc:3055] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:34.453053 29842 raft_consensus.cc:740] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:34.453799 29842 consensus_queue.cc:260] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:34.454973 29842 raft_consensus.cc:3060] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.457129 29663 catalog_manager.cc:5697] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 2 to 3, leader changed from 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1) to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.457940 29767 raft_consensus.cc:2468] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 3.
I20260709 12:20:34.459242 29881 leader_election.cc:304] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:34.460109 30177 raft_consensus.cc:2804] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.460768 30177 raft_consensus.cc:697] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:34.461553 29842 raft_consensus.cc:2468] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 3.
I20260709 12:20:34.461594 30177 consensus_queue.cc:237] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:34.471802 29663 catalog_manager.cc:5697] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 2 to 3, leader changed from 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2) to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.745894 30192 raft_consensus.cc:993] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0: : Instructing follower c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:34.746399 30207 raft_consensus.cc:1081] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Signalling peer c3f55e4e85ec4aba84a34ce054fcc227 to start an election
I20260709 12:20:34.747949 29911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa"
dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227"
 from {username='slave'} at 127.0.0.1:47196
I20260709 12:20:34.748587 29911 raft_consensus.cc:493] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:34.748945 29911 raft_consensus.cc:3060] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.756495 29911 raft_consensus.cc:515] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:34.758725 29911 leader_election.cc:290] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 election: Requested vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:34.759927 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db"
I20260709 12:20:34.760425 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b813e56fef6947cebacbfa438d6ad4fa" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6448facc90e842f2bf981f3648a9b0d0"
I20260709 12:20:34.760613 29767 raft_consensus.cc:3060] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.761035 29842 raft_consensus.cc:3055] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:34.761338 29842 raft_consensus.cc:740] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6448facc90e842f2bf981f3648a9b0d0, State: Running, Role: LEADER
I20260709 12:20:34.762049 29842 consensus_queue.cc:260] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:34.763257 29842 raft_consensus.cc:3060] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.767637 29767 raft_consensus.cc:2468] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 3.
I20260709 12:20:34.768795 29881 leader_election.cc:304] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227; no voters: 
I20260709 12:20:34.769647 30177 raft_consensus.cc:2804] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.769814 29842 raft_consensus.cc:2468] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f55e4e85ec4aba84a34ce054fcc227 in term 3.
I20260709 12:20:34.770141 30177 raft_consensus.cc:697] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 LEADER]: Becoming Leader. State: Replica: c3f55e4e85ec4aba84a34ce054fcc227, State: Running, Role: LEADER
I20260709 12:20:34.771093 30177 consensus_queue.cc:237] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:34.780550 29663 catalog_manager.cc:5697] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 reported cstate change: term changed from 2 to 3, leader changed from 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2) to c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.849457 29842 raft_consensus.cc:1275] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:34.850627 30177 consensus_queue.cc:1048] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:34.862316 29767 raft_consensus.cc:1275] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:34.863924 30177 consensus_queue.cc:1048] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:34.928280 29842 raft_consensus.cc:1275] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:34.929435 30177 consensus_queue.cc:1048] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:34.940999 29761 raft_consensus.cc:1275] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:34.942781 29767 raft_consensus.cc:1275] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:34.942726 30177 consensus_queue.cc:1048] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:34.946344 30224 consensus_queue.cc:1048] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:34.964406 29842 raft_consensus.cc:1275] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:34.969275 30224 consensus_queue.cc:1048] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:20:35.233520 29808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:38529, user_credentials={real_user=slave}} blocked reactor thread for 52559.2us
I20260709 12:20:35.261179 29761 raft_consensus.cc:1275] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:35.262369 30228 consensus_queue.cc:1048] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:35.270828 29842 raft_consensus.cc:1275] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Refusing update from remote peer c3f55e4e85ec4aba84a34ce054fcc227: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:35.272811 30224 consensus_queue.cc:1048] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:35.317914 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:35.325471 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:35.326066 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:35.333474 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:35.334010 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:20:36.174655 29940 debug-util.cc:398] Leaking SignalData structure 0x7b080018a160 after lost signal to thread 19891
W20260709 12:20:36.175729 29940 debug-util.cc:398] Leaking SignalData structure 0x7b0800074f00 after lost signal to thread 29699
W20260709 12:20:36.176769 29940 debug-util.cc:398] Leaking SignalData structure 0x7b08003514c0 after lost signal to thread 29791
W20260709 12:20:36.177675 29940 debug-util.cc:398] Leaking SignalData structure 0x7b080026ca40 after lost signal to thread 29868
W20260709 12:20:36.178560 29940 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6900 after lost signal to thread 29943
I20260709 12:20:36.335101 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:36.341372 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:36.341789 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:36.346431 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:36.346817 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:20:37.594040 29806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.011s	sys 0.013s
W20260709 12:20:37.594920 29806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.013s	sys 0.013s
W20260709 12:20:37.621145 29807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.014s	sys 0.001s
W20260709 12:20:37.621606 29807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.014s	sys 0.001s
W20260709 12:20:37.634033 29805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.018s	sys 0.010s
W20260709 12:20:37.634510 29805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.019s	sys 0.010s
I20260709 12:20:37.649195 30192 raft_consensus.cc:493] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21fec92eb1844e8a91a0aed4ca9a21db)
I20260709 12:20:37.650576 30192 raft_consensus.cc:515] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:37.654788 30192 leader_election.cc:290] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), c3f55e4e85ec4aba84a34ce054fcc227 (127.19.108.3:38529)
I20260709 12:20:37.667680 29767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97b6c8e666b434092e7a8e29af80527" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:37.668879 30249 raft_consensus.cc:493] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6448facc90e842f2bf981f3648a9b0d0)
I20260709 12:20:37.669776 30249 raft_consensus.cc:515] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 40789 } } peers { permanent_uuid: "6448facc90e842f2bf981f3648a9b0d0" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 39927 } } peers { permanent_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38529 } }
I20260709 12:20:37.672828 30249 leader_election.cc:290] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789), 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927)
I20260709 12:20:37.673583 29842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6448facc90e842f2bf981f3648a9b0d0" is_pre_election: true
I20260709 12:20:37.685469 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d236d1acfb4c1d84ed502b20b5f69a" candidate_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "21fec92eb1844e8a91a0aed4ca9a21db" is_pre_election: true
I20260709 12:20:37.715986 29881 leader_election.cc:304] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3f55e4e85ec4aba84a34ce054fcc227; no voters: 21fec92eb1844e8a91a0aed4ca9a21db, 6448facc90e842f2bf981f3648a9b0d0
I20260709 12:20:37.717052 29912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97b6c8e666b434092e7a8e29af80527" candidate_uuid: "6448facc90e842f2bf981f3648a9b0d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c3f55e4e85ec4aba84a34ce054fcc227" is_pre_election: true
I20260709 12:20:37.718703 30177 raft_consensus.cc:2749] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:37.722271 29808 leader_election.cc:304] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6448facc90e842f2bf981f3648a9b0d0; no voters: 21fec92eb1844e8a91a0aed4ca9a21db, c3f55e4e85ec4aba84a34ce054fcc227
I20260709 12:20:37.723464 30244 raft_consensus.cc:2749] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:38.025940 19893 debug-util.cc:398] Leaking SignalData structure 0x7b08002b59e0 after lost signal to thread 29807
W20260709 12:20:38.153821 29788 debug-util.cc:398] Leaking SignalData structure 0x7b08000d69e0 after lost signal to thread 19891
W20260709 12:20:38.155263 29788 debug-util.cc:398] Leaking SignalData structure 0x7b080026e660 after lost signal to thread 29699
W20260709 12:20:38.157212 29788 debug-util.cc:398] Leaking SignalData structure 0x7b08001324a0 after lost signal to thread 29791
W20260709 12:20:38.158572 29788 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd660 after lost signal to thread 29868
W20260709 12:20:38.159778 29788 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8720 after lost signal to thread 29943
I20260709 12:20:38.377494 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:38.387727 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:38.388368 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:38.397140 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:38.397730 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:39.399137 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:39.406492 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:39.407055 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:39.414072 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:39.414600 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:40.415663 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:40.420583 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:40.420974 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:40.425410 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:40.425740 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:41.426697 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:41.431910 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:41.432303 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:41.436772 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:41.437139 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:42.438082 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:42.443835 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:42.444375 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:42.450969 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:42.451393 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:43.452410 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:43.457777 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:43.458221 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:43.462972 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:43.463346 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:44.464380 19888 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:44.469539 19888 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:44.469904 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:44.474349 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:44.474685 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:45.527601 19888 tablet_server.cc:179] TabletServer@127.19.108.1:0 shutting down...
I20260709 12:20:45.560004 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:45.560756 19888 tablet_replica.cc:333] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.561805 19888 raft_consensus.cc:2243] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.562386 19888 raft_consensus.cc:2272] T 28b7a4917483436e8b818496202427e3 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.566103 19888 tablet_replica.cc:333] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.567085 19888 raft_consensus.cc:2243] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.567648 19888 raft_consensus.cc:2272] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.570127 19888 tablet_replica.cc:333] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.570724 19888 raft_consensus.cc:2243] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.571280 19888 raft_consensus.cc:2272] T 8f26d3a480944a1dadf32f91486658f9 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.573827 19888 tablet_replica.cc:333] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.574472 19888 raft_consensus.cc:2243] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.575011 19888 raft_consensus.cc:2272] T c8d236d1acfb4c1d84ed502b20b5f69a P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.577286 19888 tablet_replica.cc:333] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.577979 19888 raft_consensus.cc:2243] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.578473 19888 raft_consensus.cc:2272] T f4973015cb0d4f629236264dcb97045a P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:45.580596 29805 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 12:20:45.581656 19888 tablet_replica.cc:333] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.582563 19888 raft_consensus.cc:2243] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.583659 19888 raft_consensus.cc:2272] T e757509278314c5488ceaeb9d1a547ca P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:45.583813 29805 consensus_peers.cc:597] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 -> Peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Couldn't send request to peer 21fec92eb1844e8a91a0aed4ca9a21db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.586256 19888 tablet_replica.cc:333] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.586913 19888 raft_consensus.cc:2243] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.587373 19888 raft_consensus.cc:2272] T f7e81ee769c14958aaf73370eb16d780 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.589510 19888 tablet_replica.cc:333] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.590023 19888 raft_consensus.cc:2243] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.590502 19888 raft_consensus.cc:2272] T be832a2b997a447488405c9339a62b45 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.592761 19888 tablet_replica.cc:333] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.593286 19888 raft_consensus.cc:2243] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.594111 19888 raft_consensus.cc:2272] T 8885c880561f4dd59288e67dfe291a18 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.596388 19888 tablet_replica.cc:333] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.596937 19888 raft_consensus.cc:2243] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.597797 19888 raft_consensus.cc:2272] T 75c6c218d7534c3d9f2c649e99931848 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.600131 19888 tablet_replica.cc:333] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.600684 19888 raft_consensus.cc:2243] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.601171 19888 raft_consensus.cc:2272] T de59eec5a3fa4c16a615ab4f271aeac0 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.603425 19888 tablet_replica.cc:333] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.603950 19888 raft_consensus.cc:2243] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.604923 19888 raft_consensus.cc:2272] T e9eaaae834404e2f95c843b8a0cf2fb8 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.607625 19888 tablet_replica.cc:333] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.608371 19888 raft_consensus.cc:2243] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.609540 19888 raft_consensus.cc:2272] T b97b6c8e666b434092e7a8e29af80527 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:45.610147 29881 consensus_peers.cc:597] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 -> Peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Couldn't send request to peer 21fec92eb1844e8a91a0aed4ca9a21db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.611912 19888 tablet_replica.cc:333] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.612525 19888 raft_consensus.cc:2243] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.613030 19888 raft_consensus.cc:2272] T cd3f4a36ccac40b0b7a763c02d0a8002 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.615320 19888 tablet_replica.cc:333] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.615811 19888 raft_consensus.cc:2243] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.616299 19888 raft_consensus.cc:2272] T b813e56fef6947cebacbfa438d6ad4fa P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.618618 19888 tablet_replica.cc:333] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.619148 19888 raft_consensus.cc:2243] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.619573 19888 raft_consensus.cc:2272] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 21fec92eb1844e8a91a0aed4ca9a21db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.621622 19888 tablet_replica.cc:333] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.622130 19888 raft_consensus.cc:2243] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.622561 19888 raft_consensus.cc:2272] T ee6d776bed5f4744924d72a4575b239f P 21fec92eb1844e8a91a0aed4ca9a21db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.624791 19888 tablet_replica.cc:333] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db: stopping tablet replica
I20260709 12:20:45.625241 19888 raft_consensus.cc:2243] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.626045 19888 raft_consensus.cc:2272] T 703154aeb5de48ee977cc29ff0564c52 P 21fec92eb1844e8a91a0aed4ca9a21db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.702589 19888 tablet_server.cc:196] TabletServer@127.19.108.1:0 shutdown complete.
W20260709 12:20:45.702687 29805 consensus_peers.cc:597] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 -> Peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Couldn't send request to peer 21fec92eb1844e8a91a0aed4ca9a21db. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:45.730016 29805 consensus_peers.cc:597] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 -> Peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Couldn't send request to peer 21fec92eb1844e8a91a0aed4ca9a21db. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:45.739687 29805 consensus_peers.cc:597] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 -> Peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Couldn't send request to peer 21fec92eb1844e8a91a0aed4ca9a21db. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.747742 19888 tablet_server.cc:179] TabletServer@127.19.108.2:0 shutting down...
W20260709 12:20:45.768738 29883 consensus_peers.cc:597] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 -> Peer 6448facc90e842f2bf981f3648a9b0d0 (127.19.108.2:39927): Couldn't send request to peer 6448facc90e842f2bf981f3648a9b0d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.775731 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:45.776485 19888 tablet_replica.cc:333] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.777192 19888 raft_consensus.cc:2243] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.777844 19888 raft_consensus.cc:2272] T 28b7a4917483436e8b818496202427e3 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.781113 19888 tablet_replica.cc:333] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.781975 19888 raft_consensus.cc:2243] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.782490 19888 raft_consensus.cc:2272] T f4973015cb0d4f629236264dcb97045a P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:45.782583 29881 consensus_peers.cc:597] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 -> Peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Couldn't send request to peer 21fec92eb1844e8a91a0aed4ca9a21db. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.785112 19888 tablet_replica.cc:333] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.785737 19888 raft_consensus.cc:2243] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.786572 19888 raft_consensus.cc:2272] T 8f26d3a480944a1dadf32f91486658f9 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.788905 19888 tablet_replica.cc:333] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.789529 19888 raft_consensus.cc:2243] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.790349 19888 raft_consensus.cc:2272] T c8d236d1acfb4c1d84ed502b20b5f69a P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.792582 19888 tablet_replica.cc:333] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.793162 19888 raft_consensus.cc:2243] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.793599 19888 raft_consensus.cc:2272] T e757509278314c5488ceaeb9d1a547ca P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.795820 19888 tablet_replica.cc:333] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.796341 19888 raft_consensus.cc:2243] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.796777 19888 raft_consensus.cc:2272] T f7e81ee769c14958aaf73370eb16d780 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.798943 19888 tablet_replica.cc:333] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.799480 19888 raft_consensus.cc:2243] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.800280 19888 raft_consensus.cc:2272] T be832a2b997a447488405c9339a62b45 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.802292 19888 tablet_replica.cc:333] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.802781 19888 raft_consensus.cc:2243] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.803252 19888 raft_consensus.cc:2272] T 8885c880561f4dd59288e67dfe291a18 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.805219 19888 tablet_replica.cc:333] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.805706 19888 raft_consensus.cc:2243] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.806175 19888 raft_consensus.cc:2272] T 75c6c218d7534c3d9f2c649e99931848 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.808602 19888 tablet_replica.cc:333] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.809170 19888 raft_consensus.cc:2243] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.809850 19888 raft_consensus.cc:2272] T b97b6c8e666b434092e7a8e29af80527 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.812135 19888 tablet_replica.cc:333] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.812683 19888 raft_consensus.cc:2243] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.813184 19888 raft_consensus.cc:2272] T e9eaaae834404e2f95c843b8a0cf2fb8 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.815343 19888 tablet_replica.cc:333] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.815855 19888 raft_consensus.cc:2243] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.816645 19888 raft_consensus.cc:2272] T cd3f4a36ccac40b0b7a763c02d0a8002 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.818863 19888 tablet_replica.cc:333] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.819373 19888 raft_consensus.cc:2243] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.820145 19888 raft_consensus.cc:2272] T de59eec5a3fa4c16a615ab4f271aeac0 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.822216 19888 tablet_replica.cc:333] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.822767 19888 raft_consensus.cc:2243] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.823205 19888 raft_consensus.cc:2272] T 8061b3a4f7ff477eb5045ad4bf4bae91 P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.825270 19888 tablet_replica.cc:333] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.825773 19888 raft_consensus.cc:2243] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.826653 19888 raft_consensus.cc:2272] T 2d9baf3160f54118b5ff0e7bc9dd1688 P 6448facc90e842f2bf981f3648a9b0d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.828745 19888 tablet_replica.cc:333] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.829258 19888 raft_consensus.cc:2243] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.829690 19888 raft_consensus.cc:2272] T b813e56fef6947cebacbfa438d6ad4fa P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.831693 19888 tablet_replica.cc:333] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.832168 19888 raft_consensus.cc:2243] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.832662 19888 raft_consensus.cc:2272] T ee6d776bed5f4744924d72a4575b239f P 6448facc90e842f2bf981f3648a9b0d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.834625 19888 tablet_replica.cc:333] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0: stopping tablet replica
I20260709 12:20:45.835100 19888 raft_consensus.cc:2243] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.835563 19888 raft_consensus.cc:2272] T 703154aeb5de48ee977cc29ff0564c52 P 6448facc90e842f2bf981f3648a9b0d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.877137 19888 tablet_server.cc:196] TabletServer@127.19.108.2:0 shutdown complete.
I20260709 12:20:45.913501 19888 tablet_server.cc:179] TabletServer@127.19.108.3:0 shutting down...
W20260709 12:20:45.941206 29881 consensus_peers.cc:597] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 -> Peer 21fec92eb1844e8a91a0aed4ca9a21db (127.19.108.1:40789): Couldn't send request to peer 21fec92eb1844e8a91a0aed4ca9a21db. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:40789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:45.942363 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:45.943203 19888 tablet_replica.cc:333] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.944056 19888 raft_consensus.cc:2243] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.945036 19888 raft_consensus.cc:2272] T 28b7a4917483436e8b818496202427e3 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.947253 19888 tablet_replica.cc:333] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.947846 19888 raft_consensus.cc:2243] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.948303 19888 raft_consensus.cc:2272] T 8f26d3a480944a1dadf32f91486658f9 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.950327 19888 tablet_replica.cc:333] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.950964 19888 raft_consensus.cc:2243] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.951378 19888 raft_consensus.cc:2272] T c8d236d1acfb4c1d84ed502b20b5f69a P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.953310 19888 tablet_replica.cc:333] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.953827 19888 raft_consensus.cc:2243] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.954630 19888 raft_consensus.cc:2272] T 8061b3a4f7ff477eb5045ad4bf4bae91 P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.956741 19888 tablet_replica.cc:333] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.957360 19888 raft_consensus.cc:2243] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.958146 19888 raft_consensus.cc:2272] T f4973015cb0d4f629236264dcb97045a P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.960264 19888 tablet_replica.cc:333] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.960768 19888 raft_consensus.cc:2243] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.961179 19888 raft_consensus.cc:2272] T e757509278314c5488ceaeb9d1a547ca P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.963255 19888 tablet_replica.cc:333] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.963783 19888 raft_consensus.cc:2243] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.964572 19888 raft_consensus.cc:2272] T f7e81ee769c14958aaf73370eb16d780 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.966586 19888 tablet_replica.cc:333] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.967128 19888 raft_consensus.cc:2243] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.967901 19888 raft_consensus.cc:2272] T b813e56fef6947cebacbfa438d6ad4fa P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.969877 19888 tablet_replica.cc:333] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.970378 19888 raft_consensus.cc:2243] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.970803 19888 raft_consensus.cc:2272] T 2d9baf3160f54118b5ff0e7bc9dd1688 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.972700 19888 tablet_replica.cc:333] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.973189 19888 raft_consensus.cc:2243] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.973651 19888 raft_consensus.cc:2272] T 703154aeb5de48ee977cc29ff0564c52 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.975601 19888 tablet_replica.cc:333] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.976104 19888 raft_consensus.cc:2243] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.976869 19888 raft_consensus.cc:2272] T ee6d776bed5f4744924d72a4575b239f P c3f55e4e85ec4aba84a34ce054fcc227 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.978804 19888 tablet_replica.cc:333] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.979293 19888 raft_consensus.cc:2243] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.979745 19888 raft_consensus.cc:2272] T 75c6c218d7534c3d9f2c649e99931848 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.981629 19888 tablet_replica.cc:333] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.982084 19888 raft_consensus.cc:2243] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.982509 19888 raft_consensus.cc:2272] T e9eaaae834404e2f95c843b8a0cf2fb8 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.984522 19888 tablet_replica.cc:333] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.984972 19888 raft_consensus.cc:2243] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.985391 19888 raft_consensus.cc:2272] T b97b6c8e666b434092e7a8e29af80527 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.987285 19888 tablet_replica.cc:333] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.987766 19888 raft_consensus.cc:2243] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.988183 19888 raft_consensus.cc:2272] T cd3f4a36ccac40b0b7a763c02d0a8002 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.990113 19888 tablet_replica.cc:333] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.990598 19888 raft_consensus.cc:2243] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.990998 19888 raft_consensus.cc:2272] T de59eec5a3fa4c16a615ab4f271aeac0 P c3f55e4e85ec4aba84a34ce054fcc227 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.992873 19888 tablet_replica.cc:333] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.993319 19888 raft_consensus.cc:2243] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.993786 19888 raft_consensus.cc:2272] T be832a2b997a447488405c9339a62b45 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.995754 19888 tablet_replica.cc:333] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227: stopping tablet replica
I20260709 12:20:45.996248 19888 raft_consensus.cc:2243] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:45.996766 19888 raft_consensus.cc:2272] T 8885c880561f4dd59288e67dfe291a18 P c3f55e4e85ec4aba84a34ce054fcc227 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.056401 19888 tablet_server.cc:196] TabletServer@127.19.108.3:0 shutdown complete.
I20260709 12:20:46.092278 19888 master.cc:562] Master@127.19.108.62:43449 shutting down...
I20260709 12:20:46.113050 19888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:46.113660 19888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:46.113987 19888 tablet_replica.cc:333] T 00000000000000000000000000000000 P 98a0cd3cad3e4403ab0ee29ef82716ef: stopping tablet replica
I20260709 12:20:46.133312 19888 master.cc:584] Master@127.19.108.62:43449 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21578 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:20:46.182724 19888 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.108.62:34889
I20260709 12:20:46.184082 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.189265 30275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.190122 30276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.191825 30278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.192094 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:46.193141 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:46.193327 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.193476 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599646193461 us; error 0 us; skew 500 ppm
I20260709 12:20:46.193956 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.196285 19888 webserver.cc:533] Webserver started at http://127.19.108.62:34027/ using document root <none> and password file <none>
I20260709 12:20:46.196748 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.196933 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.197222 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.198364 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/master-0-root/instance:
uuid: "9c2390f5c3d74a789f19b48aa62bbf52"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-0g1j"
I20260709 12:20:46.202534 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:20:46.205770 30283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.206421 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:46.206678 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/master-0-root
uuid: "9c2390f5c3d74a789f19b48aa62bbf52"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-0g1j"
I20260709 12:20:46.206997 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.220374 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.221575 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.258154 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.62:34889
I20260709 12:20:46.258255 30335 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.62:34889 every 8 connection(s)
I20260709 12:20:46.262072 30336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.273442 30336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52: Bootstrap starting.
I20260709 12:20:46.278260 30336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:46.282591 30336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52: No bootstrap required, opened a new log
I20260709 12:20:46.284888 30336 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c2390f5c3d74a789f19b48aa62bbf52" member_type: VOTER }
I20260709 12:20:46.285269 30336 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:46.285506 30336 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c2390f5c3d74a789f19b48aa62bbf52, State: Initialized, Role: FOLLOWER
I20260709 12:20:46.286046 30336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c2390f5c3d74a789f19b48aa62bbf52" member_type: VOTER }
I20260709 12:20:46.286489 30336 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:46.286695 30336 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:46.286970 30336 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:46.291729 30336 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c2390f5c3d74a789f19b48aa62bbf52" member_type: VOTER }
I20260709 12:20:46.292212 30336 leader_election.cc:304] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c2390f5c3d74a789f19b48aa62bbf52; no voters: 
I20260709 12:20:46.293322 30336 leader_election.cc:290] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:46.293716 30339 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:46.295015 30339 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 1 LEADER]: Becoming Leader. State: Replica: 9c2390f5c3d74a789f19b48aa62bbf52, State: Running, Role: LEADER
I20260709 12:20:46.295691 30339 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c2390f5c3d74a789f19b48aa62bbf52" member_type: VOTER }
I20260709 12:20:46.296164 30336 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:46.300588 30341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c2390f5c3d74a789f19b48aa62bbf52. Latest consensus state: current_term: 1 leader_uuid: "9c2390f5c3d74a789f19b48aa62bbf52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c2390f5c3d74a789f19b48aa62bbf52" member_type: VOTER } }
I20260709 12:20:46.300652 30340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c2390f5c3d74a789f19b48aa62bbf52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c2390f5c3d74a789f19b48aa62bbf52" member_type: VOTER } }
I20260709 12:20:46.301499 30340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:46.301437 30341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:46.303920 30346 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:46.309031 30346 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:46.311640 19888 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:46.318447 30346 catalog_manager.cc:1383] Generated new cluster ID: 698ec81d1c12401fa1059343b9638857
I20260709 12:20:46.318698 30346 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:46.355510 30346 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:46.356833 30346 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:46.369546 30346 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52: Generated new TSK 0
I20260709 12:20:46.370106 30346 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:46.380302 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.386106 30357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.387171 30358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.388326 30360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.388777 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:46.389798 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:46.389981 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.390142 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599646390123 us; error 0 us; skew 500 ppm
I20260709 12:20:46.390627 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.392829 19888 webserver.cc:533] Webserver started at http://127.19.108.1:43303/ using document root <none> and password file <none>
I20260709 12:20:46.393287 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.393460 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.393707 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.394879 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-0-root/instance:
uuid: "8f9cd366f8ae43a09328075ce5b33c68"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-0g1j"
I20260709 12:20:46.399188 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:20:46.402302 30365 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.402992 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:20:46.403292 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-0-root
uuid: "8f9cd366f8ae43a09328075ce5b33c68"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-0g1j"
I20260709 12:20:46.403549 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.424044 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.425263 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.426666 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:46.428871 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:46.429068 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.429287 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:46.429448 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.467639 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.1:42561
I20260709 12:20:46.467744 30427 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.1:42561 every 8 connection(s)
I20260709 12:20:46.472360 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.480295 30433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.481453 30434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.483552 30436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.484200 30428 heartbeater.cc:344] Connected to a master server at 127.19.108.62:34889
I20260709 12:20:46.484416 19888 server_base.cc:1061] running on GCE node
I20260709 12:20:46.484654 30428 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:46.485522 30428 heartbeater.cc:507] Master 127.19.108.62:34889 requested a full tablet report, sending...
I20260709 12:20:46.486069 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:46.486392 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.486588 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599646486569 us; error 0 us; skew 500 ppm
I20260709 12:20:46.487239 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.487825 30301 ts_manager.cc:194] Registered new tserver with Master: 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561)
I20260709 12:20:46.489897 19888 webserver.cc:533] Webserver started at http://127.19.108.2:42053/ using document root <none> and password file <none>
I20260709 12:20:46.490401 30301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47334
I20260709 12:20:46.490576 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.490888 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.491225 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.492686 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-1-root/instance:
uuid: "c1c801c5e2ba4c60b1eff73283196afa"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-0g1j"
I20260709 12:20:46.497046 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:20:46.500324 30441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.501024 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:20:46.501283 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-1-root
uuid: "c1c801c5e2ba4c60b1eff73283196afa"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-0g1j"
I20260709 12:20:46.501541 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.517031 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.518168 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.519579 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:46.521775 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:46.521962 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.522182 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:46.522331 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.559877 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.2:46105
I20260709 12:20:46.560009 30503 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.2:46105 every 8 connection(s)
I20260709 12:20:46.564435 19888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.571249 30507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.571635 30508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.574263 19888 server_base.cc:1061] running on GCE node
W20260709 12:20:46.575043 30510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.576140 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:46.576390 19888 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.576607 19888 hybrid_clock.cc:648] HybridClock initialized: now 1783599646576588 us; error 0 us; skew 500 ppm
I20260709 12:20:46.577291 19888 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.577306 30504 heartbeater.cc:344] Connected to a master server at 127.19.108.62:34889
I20260709 12:20:46.577767 30504 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:46.578622 30504 heartbeater.cc:507] Master 127.19.108.62:34889 requested a full tablet report, sending...
I20260709 12:20:46.579828 19888 webserver.cc:533] Webserver started at http://127.19.108.3:37147/ using document root <none> and password file <none>
I20260709 12:20:46.580349 19888 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.580528 19888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.580487 30301 ts_manager.cc:194] Registered new tserver with Master: c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:46.580960 19888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.581988 30301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47338
I20260709 12:20:46.582055 19888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-2-root/instance:
uuid: "6845868c2cad4fc1a0733b72a1b568c6"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-0g1j"
I20260709 12:20:46.586863 19888 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:46.589865 30515 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.590528 19888 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:46.590796 19888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-2-root
uuid: "6845868c2cad4fc1a0733b72a1b568c6"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-0g1j"
I20260709 12:20:46.591094 19888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksFXpD4/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599318085381-19888-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.607556 19888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.608753 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.610112 19888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:46.612223 19888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:46.612411 19888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.612632 19888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:46.612783 19888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.649416 19888 rpc_server.cc:307] RPC server started. Bound to: 127.19.108.3:38261
I20260709 12:20:46.649511 30577 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.108.3:38261 every 8 connection(s)
I20260709 12:20:46.663256 30578 heartbeater.cc:344] Connected to a master server at 127.19.108.62:34889
I20260709 12:20:46.663704 30578 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:46.664381 30578 heartbeater.cc:507] Master 127.19.108.62:34889 requested a full tablet report, sending...
I20260709 12:20:46.666221 30301 ts_manager.cc:194] Registered new tserver with Master: 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:46.666858 19888 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014417514s
I20260709 12:20:46.667564 30301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47342
I20260709 12:20:46.689811 30301 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47354:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:46.692549 30301 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:46.773386 30543 tablet_service.cc:1511] Processing CreateTablet for tablet 50f6e0e4ef834d2c97a3ffd51c8acf34 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:46.774816 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f6e0e4ef834d2c97a3ffd51c8acf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.775979 30542 tablet_service.cc:1511] Processing CreateTablet for tablet 15e9b563b23842ef8d1d42aafea0e22c (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:46.782446 30465 tablet_service.cc:1511] Processing CreateTablet for tablet a0ebc021d56a4e68bf1154f505e082dc (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:46.783924 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ebc021d56a4e68bf1154f505e082dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.784811 30536 tablet_service.cc:1511] Processing CreateTablet for tablet e8119ed06b1745fea3ce3a45aa3aabb4 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:46.786228 30542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e9b563b23842ef8d1d42aafea0e22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.786986 30464 tablet_service.cc:1511] Processing CreateTablet for tablet ff7ba666f8cd42769ba75fd1682fba28 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:46.788216 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8119ed06b1745fea3ce3a45aa3aabb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.789222 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 4654e11a7be44d9eaec7da3f6dad02ca (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:46.789448 30461 tablet_service.cc:1511] Processing CreateTablet for tablet e20d73b79d934d4cadab76e175aa2271 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:46.777143 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 771637c3e2a24b2bbd4124919214d90b (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:46.791751 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771637c3e2a24b2bbd4124919214d90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.791555 30462 tablet_service.cc:1511] Processing CreateTablet for tablet e8119ed06b1745fea3ce3a45aa3aabb4 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:46.777593 30538 tablet_service.cc:1511] Processing CreateTablet for tablet ff7ba666f8cd42769ba75fd1682fba28 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:46.794407 30535 tablet_service.cc:1511] Processing CreateTablet for tablet e20d73b79d934d4cadab76e175aa2271 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:46.795400 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ba666f8cd42769ba75fd1682fba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.778690 30539 tablet_service.cc:1511] Processing CreateTablet for tablet a0ebc021d56a4e68bf1154f505e082dc (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:46.799126 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ebc021d56a4e68bf1154f505e082dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.780787 30466 tablet_service.cc:1511] Processing CreateTablet for tablet e59e52afc0014336bf2cf20cab81256f (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:46.780792 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 4654e11a7be44d9eaec7da3f6dad02ca (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:46.801255 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4654e11a7be44d9eaec7da3f6dad02ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.779294 30468 tablet_service.cc:1511] Processing CreateTablet for tablet 15e9b563b23842ef8d1d42aafea0e22c (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:46.779809 30540 tablet_service.cc:1511] Processing CreateTablet for tablet e59e52afc0014336bf2cf20cab81256f (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:46.804020 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59e52afc0014336bf2cf20cab81256f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.804680 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20d73b79d934d4cadab76e175aa2271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.788229 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ba666f8cd42769ba75fd1682fba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.805758 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e9b563b23842ef8d1d42aafea0e22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.779165 30467 tablet_service.cc:1511] Processing CreateTablet for tablet 771637c3e2a24b2bbd4124919214d90b (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:46.806983 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8119ed06b1745fea3ce3a45aa3aabb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.809391 30467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771637c3e2a24b2bbd4124919214d90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.778158 30469 tablet_service.cc:1511] Processing CreateTablet for tablet 50f6e0e4ef834d2c97a3ffd51c8acf34 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:46.811932 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f6e0e4ef834d2c97a3ffd51c8acf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.815106 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59e52afc0014336bf2cf20cab81256f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.819201 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20d73b79d934d4cadab76e175aa2271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.820334 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4654e11a7be44d9eaec7da3f6dad02ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.858739 30389 tablet_service.cc:1511] Processing CreateTablet for tablet a0ebc021d56a4e68bf1154f505e082dc (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:46.865000 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ebc021d56a4e68bf1154f505e082dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.867934 30385 tablet_service.cc:1511] Processing CreateTablet for tablet e20d73b79d934d4cadab76e175aa2271 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:46.869237 30385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20d73b79d934d4cadab76e175aa2271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.859866 30388 tablet_service.cc:1511] Processing CreateTablet for tablet ff7ba666f8cd42769ba75fd1682fba28 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:46.872282 30388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ba666f8cd42769ba75fd1682fba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.860320 30393 tablet_service.cc:1511] Processing CreateTablet for tablet 50f6e0e4ef834d2c97a3ffd51c8acf34 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:46.877628 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f6e0e4ef834d2c97a3ffd51c8acf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.860955 30387 tablet_service.cc:1511] Processing CreateTablet for tablet 4654e11a7be44d9eaec7da3f6dad02ca (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:46.879613 30594 tablet_bootstrap.cc:492] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:46.880251 30387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4654e11a7be44d9eaec7da3f6dad02ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.861419 30392 tablet_service.cc:1511] Processing CreateTablet for tablet 15e9b563b23842ef8d1d42aafea0e22c (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:46.884287 30392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e9b563b23842ef8d1d42aafea0e22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.861999 30386 tablet_service.cc:1511] Processing CreateTablet for tablet e8119ed06b1745fea3ce3a45aa3aabb4 (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:46.888266 30386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8119ed06b1745fea3ce3a45aa3aabb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.863094 30390 tablet_service.cc:1511] Processing CreateTablet for tablet e59e52afc0014336bf2cf20cab81256f (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:46.892266 30390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59e52afc0014336bf2cf20cab81256f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.897419 30594 tablet_bootstrap.cc:654] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:46.863656 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 771637c3e2a24b2bbd4124919214d90b (DEFAULT_TABLE table=test-workload [id=6b51315613504861b6a638b01aaf9843]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:46.900288 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771637c3e2a24b2bbd4124919214d90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.910024 30593 tablet_bootstrap.cc:492] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:46.917003 30593 tablet_bootstrap.cc:654] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:46.935009 30594 tablet_bootstrap.cc:492] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:46.935518 30594 ts_tablet_manager.cc:1403] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.056s	user 0.006s	sys 0.010s
I20260709 12:20:46.938351 30594 raft_consensus.cc:359] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:46.939085 30594 raft_consensus.cc:385] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:46.939365 30594 raft_consensus.cc:740] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:46.940317 30594 consensus_queue.cc:260] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:46.950420 30597 tablet_bootstrap.cc:492] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:46.951133 30593 tablet_bootstrap.cc:492] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:46.951756 30593 ts_tablet_manager.cc:1403] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.016s
I20260709 12:20:46.951972 30594 ts_tablet_manager.cc:1434] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.006s
I20260709 12:20:46.952811 30578 heartbeater.cc:499] Master 127.19.108.62:34889 was elected leader, sending a full tablet report...
I20260709 12:20:46.958190 30594 tablet_bootstrap.cc:492] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:46.954733 30593 raft_consensus.cc:359] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:46.962627 30593 raft_consensus.cc:385] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:46.962880 30593 raft_consensus.cc:740] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:46.964991 30594 tablet_bootstrap.cc:654] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:46.965976 30597 tablet_bootstrap.cc:654] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:46.967177 30593 consensus_queue.cc:260] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:46.987867 30504 heartbeater.cc:499] Master 127.19.108.62:34889 was elected leader, sending a full tablet report...
I20260709 12:20:46.988657 30593 ts_tablet_manager.cc:1434] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.017s
I20260709 12:20:46.989693 30594 tablet_bootstrap.cc:492] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:46.989892 30593 tablet_bootstrap.cc:492] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:46.990197 30597 tablet_bootstrap.cc:492] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:46.990286 30594 ts_tablet_manager.cc:1403] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.020s
I20260709 12:20:46.990813 30597 ts_tablet_manager.cc:1403] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.016s
I20260709 12:20:46.993736 30594 raft_consensus.cc:359] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:46.994479 30594 raft_consensus.cc:385] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:46.993937 30597 raft_consensus.cc:359] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:46.994822 30594 raft_consensus.cc:740] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:46.994969 30597 raft_consensus.cc:385] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:46.995360 30597 raft_consensus.cc:740] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:46.995695 30594 consensus_queue.cc:260] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:46.996713 30593 tablet_bootstrap.cc:654] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:46.997920 30594 ts_tablet_manager.cc:1434] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:20:46.998893 30594 tablet_bootstrap.cc:492] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:46.996204 30597 consensus_queue.cc:260] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.005216 30594 tablet_bootstrap.cc:654] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.006250 30597 ts_tablet_manager.cc:1434] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.006s
I20260709 12:20:47.007066 30428 heartbeater.cc:499] Master 127.19.108.62:34889 was elected leader, sending a full tablet report...
I20260709 12:20:47.007372 30597 tablet_bootstrap.cc:492] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:47.013824 30597 tablet_bootstrap.cc:654] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.018405 30593 tablet_bootstrap.cc:492] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:47.019024 30593 ts_tablet_manager.cc:1403] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.011s
I20260709 12:20:47.021889 30593 raft_consensus.cc:359] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.022447 30593 raft_consensus.cc:385] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.022739 30593 raft_consensus.cc:740] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.023456 30593 consensus_queue.cc:260] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.025063 30593 ts_tablet_manager.cc:1434] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:47.025949 30593 tablet_bootstrap.cc:492] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:47.032713 30593 tablet_bootstrap.cc:654] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.034062 30594 tablet_bootstrap.cc:492] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:47.034603 30594 ts_tablet_manager.cc:1403] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.022s
I20260709 12:20:47.037719 30597 tablet_bootstrap.cc:492] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:47.038154 30597 ts_tablet_manager.cc:1403] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.031s	user 0.004s	sys 0.007s
I20260709 12:20:47.038316 30593 tablet_bootstrap.cc:492] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:47.038012 30594 raft_consensus.cc:359] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.038833 30594 raft_consensus.cc:385] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.038986 30593 ts_tablet_manager.cc:1403] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:20:47.039171 30594 raft_consensus.cc:740] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.039966 30594 consensus_queue.cc:260] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.040846 30597 raft_consensus.cc:359] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.041555 30597 raft_consensus.cc:385] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.041831 30597 raft_consensus.cc:740] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.042101 30594 ts_tablet_manager.cc:1434] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:47.041879 30593 raft_consensus.cc:359] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.042666 30593 raft_consensus.cc:385] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.042622 30597 consensus_queue.cc:260] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.043161 30594 tablet_bootstrap.cc:492] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:47.043126 30593 raft_consensus.cc:740] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.044310 30593 consensus_queue.cc:260] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.045130 30597 ts_tablet_manager.cc:1434] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:47.046092 30597 tablet_bootstrap.cc:492] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:47.046569 30593 ts_tablet_manager.cc:1434] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:20:47.047695 30593 tablet_bootstrap.cc:492] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:47.050107 30594 tablet_bootstrap.cc:654] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.052054 30597 tablet_bootstrap.cc:654] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.053946 30593 tablet_bootstrap.cc:654] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.061894 30594 tablet_bootstrap.cc:492] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:47.062444 30594 ts_tablet_manager.cc:1403] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
W20260709 12:20:47.064358 30505 tablet.cc:2406] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:47.067700 30594 raft_consensus.cc:359] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.068456 30594 raft_consensus.cc:385] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.068761 30594 raft_consensus.cc:740] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.070516 30594 consensus_queue.cc:260] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.073129 30594 ts_tablet_manager.cc:1434] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:20:47.074075 30594 tablet_bootstrap.cc:492] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:47.074447 30597 tablet_bootstrap.cc:492] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:47.074988 30597 ts_tablet_manager.cc:1403] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 12:20:47.077142 30593 tablet_bootstrap.cc:492] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:47.077747 30593 ts_tablet_manager.cc:1403] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.010s
I20260709 12:20:47.078090 30597 raft_consensus.cc:359] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.078908 30597 raft_consensus.cc:385] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.079210 30597 raft_consensus.cc:740] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.079931 30597 consensus_queue.cc:260] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.081235 30594 tablet_bootstrap.cc:654] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.080994 30593 raft_consensus.cc:359] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.081840 30593 raft_consensus.cc:385] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.082191 30593 raft_consensus.cc:740] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.083003 30593 consensus_queue.cc:260] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.084751 30597 ts_tablet_manager.cc:1434] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:47.085788 30597 tablet_bootstrap.cc:492] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:47.087563 30593 ts_tablet_manager.cc:1434] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:47.088682 30593 tablet_bootstrap.cc:492] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:47.092394 30597 tablet_bootstrap.cc:654] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.092404 30594 tablet_bootstrap.cc:492] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:47.095665 30594 ts_tablet_manager.cc:1403] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:20:47.097921 30597 tablet_bootstrap.cc:492] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:47.098452 30597 ts_tablet_manager.cc:1403] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:20:47.098416 30594 raft_consensus.cc:359] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.095036 30593 tablet_bootstrap.cc:654] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.099362 30594 raft_consensus.cc:385] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.099823 30594 raft_consensus.cc:740] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.100584 30594 consensus_queue.cc:260] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.101759 30597 raft_consensus.cc:359] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.102567 30597 raft_consensus.cc:385] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.102774 30594 ts_tablet_manager.cc:1434] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:47.102872 30597 raft_consensus.cc:740] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.103886 30594 tablet_bootstrap.cc:492] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:47.103820 30597 consensus_queue.cc:260] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.110718 30594 tablet_bootstrap.cc:654] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.114951 30597 ts_tablet_manager.cc:1434] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:20:47.116992 30593 tablet_bootstrap.cc:492] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:47.117421 30593 ts_tablet_manager.cc:1403] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.005s
I20260709 12:20:47.118287 30597 tablet_bootstrap.cc:492] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:47.119964 30593 raft_consensus.cc:359] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.120609 30593 raft_consensus.cc:385] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.120893 30593 raft_consensus.cc:740] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.121623 30593 consensus_queue.cc:260] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.123481 30597 tablet_bootstrap.cc:654] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.123620 30593 ts_tablet_manager.cc:1434] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:20:47.124962 30593 tablet_bootstrap.cc:492] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:47.125519 30594 tablet_bootstrap.cc:492] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:47.126024 30594 ts_tablet_manager.cc:1403] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 12:20:47.129076 30594 raft_consensus.cc:359] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.129808 30594 raft_consensus.cc:385] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.130081 30594 raft_consensus.cc:740] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.131206 30593 tablet_bootstrap.cc:654] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.130786 30594 consensus_queue.cc:260] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.135576 30594 ts_tablet_manager.cc:1434] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:20:47.136690 30594 tablet_bootstrap.cc:492] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:47.140587 30598 raft_consensus.cc:493] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.140692 30601 raft_consensus.cc:493] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.141355 30601 raft_consensus.cc:515] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.145231 30594 tablet_bootstrap.cc:654] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.141335 30598 raft_consensus.cc:515] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:47.151252 30598 leader_election.cc:290] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561)
I20260709 12:20:47.156652 30601 leader_election.cc:290] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.190204 30601 raft_consensus.cc:493] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.193819 30593 tablet_bootstrap.cc:492] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:47.194574 30593 ts_tablet_manager.cc:1403] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.001s
I20260709 12:20:47.195667 30603 raft_consensus.cc:493] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.196204 30603 raft_consensus.cc:515] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.199863 30593 raft_consensus.cc:359] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.200742 30593 raft_consensus.cc:385] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.193992 30597 tablet_bootstrap.cc:492] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:47.199744 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:47.201620 30597 ts_tablet_manager.cc:1403] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.015s
I20260709 12:20:47.202621 30603 leader_election.cc:290] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.203142 30601 raft_consensus.cc:515] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
W20260709 12:20:47.206188 30518 leader_election.cc:343] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.211696 30597 raft_consensus.cc:359] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.212535 30597 raft_consensus.cc:385] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.212841 30597 raft_consensus.cc:740] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.212044 30601 leader_election.cc:290] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.201046 30593 raft_consensus.cc:740] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.217648 30593 consensus_queue.cc:260] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.219256 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4654e11a7be44d9eaec7da3f6dad02ca" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.219976 30403 raft_consensus.cc:2468] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.221474 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20d73b79d934d4cadab76e175aa2271" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.220121 30593 ts_tablet_manager.cc:1434] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:20:47.226552 30593 tablet_bootstrap.cc:492] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:47.229720 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4654e11a7be44d9eaec7da3f6dad02ca" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.230141 30598 raft_consensus.cc:493] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.230752 30598 raft_consensus.cc:515] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.231076 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20d73b79d934d4cadab76e175aa2271" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.231767 30552 raft_consensus.cc:2468] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.232971 30598 leader_election.cc:290] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:47.230499 30553 raft_consensus.cc:2468] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.233125 30443 leader_election.cc:304] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.235045 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:47.235140 30443 leader_election.cc:304] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.236123 30619 raft_consensus.cc:2804] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.236529 30619 raft_consensus.cc:493] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.236831 30619 raft_consensus.cc:3060] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:47.237066 30518 leader_election.cc:343] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.237836 30603 raft_consensus.cc:493] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.237852 30601 raft_consensus.cc:2804] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.238384 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.239637 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.239886 30597 consensus_queue.cc:260] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.240334 30401 raft_consensus.cc:2468] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 0.
I20260709 12:20:47.240862 30403 raft_consensus.cc:2468] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.238427 30603 raft_consensus.cc:515] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.243610 30603 leader_election.cc:290] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
W20260709 12:20:47.244331 30518 leader_election.cc:343] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.244837 30518 leader_election.cc:304] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6; no voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:47.246152 30518 leader_election.cc:304] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:47.247176 30598 raft_consensus.cc:2749] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:47.238433 30601 raft_consensus.cc:493] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.248008 30601 raft_consensus.cc:3060] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.248649 30598 raft_consensus.cc:2804] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.249293 30598 raft_consensus.cc:493] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.249617 30598 raft_consensus.cc:3060] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.250795 30597 ts_tablet_manager.cc:1434] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 12:20:47.251811 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59e52afc0014336bf2cf20cab81256f" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:47.252467 30479 raft_consensus.cc:2468] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 0.
I20260709 12:20:47.253870 30597 tablet_bootstrap.cc:492] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:47.254164 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:47.255964 30601 raft_consensus.cc:515] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.258100 30601 leader_election.cc:290] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.259207 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4654e11a7be44d9eaec7da3f6dad02ca" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:47.259793 30553 raft_consensus.cc:3060] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.260066 30594 tablet_bootstrap.cc:492] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:47.260613 30594 ts_tablet_manager.cc:1403] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.124s	user 0.054s	sys 0.052s
I20260709 12:20:47.260421 30368 leader_election.cc:304] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.261061 30597 tablet_bootstrap.cc:654] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:47.261436 30368 leader_election.cc:343] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.262710 30603 raft_consensus.cc:2804] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.263128 30603 raft_consensus.cc:493] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.263439 30603 raft_consensus.cc:3060] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.263721 30594 raft_consensus.cc:359] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.264418 30594 raft_consensus.cc:385] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.264714 30594 raft_consensus.cc:740] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.265425 30594 consensus_queue.cc:260] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.267186 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4654e11a7be44d9eaec7da3f6dad02ca" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:47.267608 30594 ts_tablet_manager.cc:1434] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:47.267764 30403 raft_consensus.cc:3060] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.270398 30594 tablet_bootstrap.cc:492] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:47.275065 30553 raft_consensus.cc:2468] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.276057 30593 tablet_bootstrap.cc:654] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.276471 30443 leader_election.cc:304] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.277530 30601 raft_consensus.cc:2804] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.277760 30598 raft_consensus.cc:515] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.279996 30598 leader_election.cc:290] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:47.281680 30619 raft_consensus.cc:515] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.277537 30594 tablet_bootstrap.cc:654] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.284848 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20d73b79d934d4cadab76e175aa2271" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:47.285521 30401 raft_consensus.cc:3060] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.285327 30603 raft_consensus.cc:515] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
W20260709 12:20:47.292013 30518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.108.1:42561, user_credentials={real_user=slave}} blocked reactor thread for 45944.5us
I20260709 12:20:47.293879 30401 raft_consensus.cc:2468] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.295326 30444 leader_election.cc:304] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.298249 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:47.298961 30402 raft_consensus.cc:3060] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.299193 30403 raft_consensus.cc:2468] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.298367 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:47.304666 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20d73b79d934d4cadab76e175aa2271" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:47.305620 30553 raft_consensus.cc:3060] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.307569 30402 raft_consensus.cc:2468] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 1.
W20260709 12:20:47.307092 30349 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:47.309320 30518 leader_election.cc:304] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
W20260709 12:20:47.310880 30518 leader_election.cc:343] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.314088 30625 raft_consensus.cc:2804] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.315196 30625 raft_consensus.cc:697] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:47.316090 30625 consensus_queue.cc:237] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.316762 30630 raft_consensus.cc:2804] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.317384 30630 raft_consensus.cc:697] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:47.319317 30603 leader_election.cc:290] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.318271 30630 consensus_queue.cc:237] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.320904 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59e52afc0014336bf2cf20cab81256f" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.321632 30552 raft_consensus.cc:2468] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 0.
I20260709 12:20:47.323031 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.324496 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59e52afc0014336bf2cf20cab81256f" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:47.325048 30552 raft_consensus.cc:3060] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.325752 30553 raft_consensus.cc:2468] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.329098 30631 raft_consensus.cc:493] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.329674 30631 raft_consensus.cc:515] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.331915 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59e52afc0014336bf2cf20cab81256f" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:47.332515 30479 raft_consensus.cc:3060] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.334153 30552 raft_consensus.cc:2468] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 1.
I20260709 12:20:47.309336 30619 leader_election.cc:290] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
W20260709 12:20:47.337605 30367 leader_election.cc:343] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.338117 30367 leader_election.cc:304] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68; no voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:47.339309 30603 raft_consensus.cc:2749] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:47.340413 30367 leader_election.cc:304] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:47.340867 30479 raft_consensus.cc:2468] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 1.
I20260709 12:20:47.341306 30603 raft_consensus.cc:2804] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.344677 30594 tablet_bootstrap.cc:492] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:47.345075 30594 ts_tablet_manager.cc:1403] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.020s
I20260709 12:20:47.344305 30601 raft_consensus.cc:697] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:47.347344 30593 tablet_bootstrap.cc:492] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:47.347856 30593 ts_tablet_manager.cc:1403] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.000s
I20260709 12:20:47.347255 30601 consensus_queue.cc:237] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.349579 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
W20260709 12:20:47.351406 30444 leader_election.cc:343] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.353084 30594 raft_consensus.cc:359] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.353559 30594 raft_consensus.cc:385] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.353718 30594 raft_consensus.cc:740] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.354226 30594 consensus_queue.cc:260] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.356184 30594 ts_tablet_manager.cc:1434] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:20:47.356568 30603 raft_consensus.cc:697] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:47.357157 30594 tablet_bootstrap.cc:492] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:47.357656 30603 consensus_queue.cc:237] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.359380 30631 leader_election.cc:290] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.360617 30593 raft_consensus.cc:359] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.361404 30593 raft_consensus.cc:385] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.361681 30593 raft_consensus.cc:740] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.355099 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.362414 30593 consensus_queue.cc:260] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
W20260709 12:20:47.364113 30443 leader_election.cc:343] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.364554 30443 leader_election.cc:304] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1c801c5e2ba4c60b1eff73283196afa; no voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:47.365458 30593 ts_tablet_manager.cc:1434] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:20:47.366364 30593 tablet_bootstrap.cc:492] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:47.366292 30299 catalog_manager.cc:5697] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 0 to 1, leader changed from <none> to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 1 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.367918 30597 tablet_bootstrap.cc:492] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:47.368425 30597 ts_tablet_manager.cc:1403] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.115s	user 0.024s	sys 0.072s
I20260709 12:20:47.370893 30630 raft_consensus.cc:2749] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:47.373171 30593 tablet_bootstrap.cc:654] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.373955 30594 tablet_bootstrap.cc:654] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.376005 30597 raft_consensus.cc:359] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.376753 30597 raft_consensus.cc:385] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.377053 30597 raft_consensus.cc:740] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.377784 30597 consensus_queue.cc:260] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.388584 30594 tablet_bootstrap.cc:492] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:47.388638 30597 ts_tablet_manager.cc:1434] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:20:47.389242 30594 ts_tablet_manager.cc:1403] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.003s
I20260709 12:20:47.390254 30597 tablet_bootstrap.cc:492] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:47.391469 30593 tablet_bootstrap.cc:492] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:47.392001 30593 ts_tablet_manager.cc:1403] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 12:20:47.392334 30594 raft_consensus.cc:359] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.393200 30594 raft_consensus.cc:385] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.393471 30594 raft_consensus.cc:740] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.392925 30301 catalog_manager.cc:5697] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.394276 30594 consensus_queue.cc:260] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.394899 30593 raft_consensus.cc:359] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.395569 30593 raft_consensus.cc:385] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.395820 30593 raft_consensus.cc:740] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.396595 30594 ts_tablet_manager.cc:1434] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:47.396572 30593 consensus_queue.cc:260] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.397032 30597 tablet_bootstrap.cc:654] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.398671 30593 ts_tablet_manager.cc:1434] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:47.396944 30300 catalog_manager.cc:5697] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.407629 30593 tablet_bootstrap.cc:492] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:47.409258 30597 tablet_bootstrap.cc:492] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:47.408615 30299 catalog_manager.cc:5697] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 0 to 1, leader changed from <none> to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 1 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.409919 30597 ts_tablet_manager.cc:1403] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:20:47.412948 30593 tablet_bootstrap.cc:654] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.413036 30597 raft_consensus.cc:359] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:47.413986 30597 raft_consensus.cc:385] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.414330 30597 raft_consensus.cc:740] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.415230 30597 consensus_queue.cc:260] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:47.417666 30597 ts_tablet_manager.cc:1434] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:20:47.418787 30597 tablet_bootstrap.cc:492] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:47.420408 30593 tablet_bootstrap.cc:492] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:47.420902 30593 ts_tablet_manager.cc:1403] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 12:20:47.423563 30593 raft_consensus.cc:359] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:47.424196 30593 raft_consensus.cc:385] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.424455 30593 raft_consensus.cc:740] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.425262 30597 tablet_bootstrap.cc:654] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.425175 30593 consensus_queue.cc:260] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:47.427448 30593 ts_tablet_manager.cc:1434] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:20:47.430418 30597 tablet_bootstrap.cc:492] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:47.430826 30597 ts_tablet_manager.cc:1403] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:20:47.431636 30630 raft_consensus.cc:493] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.432137 30630 raft_consensus.cc:515] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.433064 30597 raft_consensus.cc:359] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.433739 30597 raft_consensus.cc:385] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.434015 30597 raft_consensus.cc:740] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.434206 30630 leader_election.cc:290] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.434861 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ba666f8cd42769ba75fd1682fba28" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.434799 30597 consensus_queue.cc:260] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.435334 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ba666f8cd42769ba75fd1682fba28" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.435735 30402 raft_consensus.cc:2468] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.436772 30597 ts_tablet_manager.cc:1434] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:47.436972 30444 leader_election.cc:304] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.437562 30597 tablet_bootstrap.cc:492] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:47.437781 30630 raft_consensus.cc:2804] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.438148 30630 raft_consensus.cc:493] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.438446 30630 raft_consensus.cc:3060] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.441077 30553 raft_consensus.cc:2468] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.441432 30625 raft_consensus.cc:493] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.441905 30625 raft_consensus.cc:515] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.443921 30625 leader_election.cc:290] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:47.444679 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.445338 30597 tablet_bootstrap.cc:654] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.447789 30630 raft_consensus.cc:515] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.450366 30630 leader_election.cc:290] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.450560 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ba666f8cd42769ba75fd1682fba28" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:47.451776 30403 raft_consensus.cc:3060] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.452059 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ba666f8cd42769ba75fd1682fba28" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:47.452641 30553 raft_consensus.cc:3060] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.454325 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:47.454990 30479 raft_consensus.cc:2468] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 0.
I20260709 12:20:47.456161 30518 leader_election.cc:304] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
W20260709 12:20:47.457697 30518 leader_election.cc:343] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.458550 30625 raft_consensus.cc:2804] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.458971 30625 raft_consensus.cc:493] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.459298 30625 raft_consensus.cc:3060] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.461022 30553 raft_consensus.cc:2468] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.461833 30403 raft_consensus.cc:2468] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.461615 30630 raft_consensus.cc:493] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.462529 30630 raft_consensus.cc:515] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.463068 30444 leader_election.cc:304] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.465816 30631 raft_consensus.cc:2804] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.466159 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ebc021d56a4e68bf1154f505e082dc" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.466497 30630 leader_election.cc:290] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.466861 30402 raft_consensus.cc:2468] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.466281 30631 raft_consensus.cc:697] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:47.467970 30444 leader_election.cc:304] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.468130 30625 raft_consensus.cc:515] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.469003 30630 raft_consensus.cc:2804] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.469448 30630 raft_consensus.cc:493] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.467968 30631 consensus_queue.cc:237] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.469954 30630 raft_consensus.cc:3060] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.470894 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
W20260709 12:20:47.472244 30518 leader_election.cc:343] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:47.473071 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ebc021d56a4e68bf1154f505e082dc" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.473701 30553 raft_consensus.cc:2468] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.474261 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:47.474830 30479 raft_consensus.cc:3060] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.477948 30630 raft_consensus.cc:515] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.480954 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ebc021d56a4e68bf1154f505e082dc" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:47.481519 30403 raft_consensus.cc:3060] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.482182 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ebc021d56a4e68bf1154f505e082dc" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:47.483134 30553 raft_consensus.cc:3060] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.483213 30479 raft_consensus.cc:2468] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 1.
I20260709 12:20:47.484484 30518 leader_election.cc:304] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:47.485359 30598 raft_consensus.cc:2804] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.487279 30598 raft_consensus.cc:697] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:47.488240 30598 consensus_queue.cc:237] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.481603 30630 leader_election.cc:290] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.491459 30553 raft_consensus.cc:2468] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.491935 30625 leader_election.cc:290] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:47.495782 30443 leader_election.cc:304] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.496680 30631 raft_consensus.cc:2804] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.497241 30631 raft_consensus.cc:697] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:47.496881 30403 raft_consensus.cc:2468] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.498378 30631 consensus_queue.cc:237] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.498201 30298 catalog_manager.cc:5697] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.500865 30299 catalog_manager.cc:5697] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 0 to 1, leader changed from <none> to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 1 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.504560 30597 tablet_bootstrap.cc:492] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:47.505016 30597 ts_tablet_manager.cc:1403] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.024s
I20260709 12:20:47.507481 30597 raft_consensus.cc:359] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.508041 30597 raft_consensus.cc:385] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.508245 30597 raft_consensus.cc:740] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.508970 30597 consensus_queue.cc:260] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.511049 30597 ts_tablet_manager.cc:1434] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:20:47.516010 30299 catalog_manager.cc:5697] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 0 to 1, leader changed from <none> to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 1 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.614687 30631 raft_consensus.cc:493] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.615612 30631 raft_consensus.cc:515] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.618139 30631 leader_election.cc:290] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.619865 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.620030 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.620985 30403 raft_consensus.cc:2393] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1c801c5e2ba4c60b1eff73283196afa in current term 1: Already voted for candidate 6845868c2cad4fc1a0733b72a1b568c6 in this term.
I20260709 12:20:47.622151 30444 leader_election.cc:304] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1c801c5e2ba4c60b1eff73283196afa; no voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:47.622808 30631 raft_consensus.cc:3060] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.630538 30631 raft_consensus.cc:2749] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:47.651325 30625 raft_consensus.cc:493] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.651985 30625 raft_consensus.cc:515] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.654115 30625 leader_election.cc:290] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:47.655260 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.655717 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:47.656145 30403 raft_consensus.cc:2468] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 0.
I20260709 12:20:47.656580 30479 raft_consensus.cc:2468] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 0.
I20260709 12:20:47.657521 30518 leader_election.cc:304] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:47.658429 30625 raft_consensus.cc:2804] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.658946 30625 raft_consensus.cc:493] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.659345 30625 raft_consensus.cc:3060] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.665405 30631 raft_consensus.cc:493] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.666121 30631 raft_consensus.cc:515] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:47.667301 30625 raft_consensus.cc:515] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.668309 30631 leader_election.cc:290] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261), 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561)
I20260709 12:20:47.669122 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.669430 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:47.669691 30625 leader_election.cc:290] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:47.670131 30553 raft_consensus.cc:2468] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.670310 30403 raft_consensus.cc:2468] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:47.670324 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:47.671221 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:47.671610 30402 raft_consensus.cc:3060] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.671787 30479 raft_consensus.cc:3060] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.671628 30444 leader_election.cc:304] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.672869 30631 raft_consensus.cc:2804] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:47.673276 30631 raft_consensus.cc:493] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.673574 30631 raft_consensus.cc:3060] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.678932 30631 raft_consensus.cc:515] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:47.680543 30631 leader_election.cc:290] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Requested vote from peers 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261), 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561)
I20260709 12:20:47.681854 30402 raft_consensus.cc:2468] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 1.
I20260709 12:20:47.681854 30479 raft_consensus.cc:2468] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 1.
I20260709 12:20:47.683104 30518 leader_election.cc:304] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:47.683447 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:47.683595 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:47.683846 30625 raft_consensus.cc:2804] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.684026 30553 raft_consensus.cc:3060] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.684181 30402 raft_consensus.cc:3060] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.684525 30625 raft_consensus.cc:697] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:47.685952 30625 consensus_queue.cc:237] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.690269 30402 raft_consensus.cc:2468] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.691674 30444 leader_election.cc:304] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:47.692641 30631 raft_consensus.cc:2804] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:47.693181 30631 raft_consensus.cc:697] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:47.694350 30631 consensus_queue.cc:237] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:47.695161 30553 raft_consensus.cc:2468] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:47.699469 30299 catalog_manager.cc:5697] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.704758 30298 catalog_manager.cc:5697] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 0 to 1, leader changed from <none> to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 1 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:47.724596 30625 consensus_queue.cc:1048] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:47.742122 30625 consensus_queue.cc:1048] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:47.791811 30631 consensus_queue.cc:1048] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:47.803804 30631 consensus_queue.cc:1048] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:47.868192 30633 consensus_queue.cc:1048] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:47.879647 30603 consensus_queue.cc:1048] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:47.901168 30603 raft_consensus.cc:493] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.901688 30603 raft_consensus.cc:515] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:47.903810 30603 leader_election.cc:290] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:47.904428 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:47.905418 30479 raft_consensus.cc:2393] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f9cd366f8ae43a09328075ce5b33c68 in current term 1: Already voted for candidate 6845868c2cad4fc1a0733b72a1b568c6 in this term.
I20260709 12:20:47.905336 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:47.907998 30368 leader_election.cc:304] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68; no voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:47.908236 30631 consensus_queue.cc:1048] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:47.908864 30603 raft_consensus.cc:3060] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:47.908833 30479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34"
dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
mode: GRACEFUL
new_leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:52614
I20260709 12:20:47.909607 30479 raft_consensus.cc:606] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Received request to transfer leadership to TS 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:47.917083 30603 raft_consensus.cc:2749] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:47.927737 30631 consensus_queue.cc:1048] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:47.932758 30552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
mode: GRACEFUL
new_leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:33768
I20260709 12:20:47.933388 30552 raft_consensus.cc:606] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Received request to transfer leadership to TS 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:47.939527 30631 consensus_queue.cc:1048] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:47.940541 30553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
mode: GRACEFUL
new_leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:33768
I20260709 12:20:47.941067 30553 raft_consensus.cc:606] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Received request to transfer leadership to TS 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:47.952025 30601 consensus_queue.cc:1048] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:47.972506 30553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
mode: GRACEFUL
new_leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
 from {username='slave'} at 127.0.0.1:33768
I20260709 12:20:47.973202 30553 raft_consensus.cc:606] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Received request to transfer leadership to TS c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:47.978227 30479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e20d73b79d934d4cadab76e175aa2271"
dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
mode: GRACEFUL
new_leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
 from {username='slave'} at 127.0.0.1:52614
I20260709 12:20:47.978711 30479 raft_consensus.cc:606] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Received request to transfer leadership to TS 6845868c2cad4fc1a0733b72a1b568c6
I20260709 12:20:47.997866 30625 consensus_queue.cc:1048] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:48.004590 30598 raft_consensus.cc:993] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6: : Instructing follower 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:48.005035 30598 raft_consensus.cc:1081] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Signalling peer 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:48.006819 30403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:49708
I20260709 12:20:48.010164 30403 raft_consensus.cc:493] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:48.010238 30598 consensus_queue.cc:1048] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:48.010576 30403 raft_consensus.cc:3060] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.020293 30403 raft_consensus.cc:515] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.026297 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:48.026918 30553 raft_consensus.cc:3055] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:48.027268 30553 raft_consensus.cc:740] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:48.028162 30553 consensus_queue.cc:260] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.029289 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771637c3e2a24b2bbd4124919214d90b" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:48.029307 30553 raft_consensus.cc:3060] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.029397 30403 leader_election.cc:290] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:48.029990 30479 raft_consensus.cc:3060] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.037006 30553 raft_consensus.cc:2468] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:48.038240 30367 leader_election.cc:304] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:48.038591 30479 raft_consensus.cc:2468] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:48.039129 30603 raft_consensus.cc:2804] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:48.039645 30603 raft_consensus.cc:697] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:48.040512 30603 consensus_queue.cc:237] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.043365 30671 consensus_queue.cc:1048] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:48.046885 30300 catalog_manager.cc:5697] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 1 to 2, leader changed from 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3) to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:48.055639 30601 consensus_queue.cc:1048] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:48.123006 30625 raft_consensus.cc:993] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6: : Instructing follower c1c801c5e2ba4c60b1eff73283196afa to start an election
I20260709 12:20:48.123502 30598 raft_consensus.cc:1081] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Signalling peer c1c801c5e2ba4c60b1eff73283196afa to start an election
I20260709 12:20:48.123346 30601 consensus_queue.cc:1048] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:48.125197 30479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4"
dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
 from {username='slave'} at 127.0.0.1:52592
I20260709 12:20:48.125756 30479 raft_consensus.cc:493] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:48.126123 30479 raft_consensus.cc:3060] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.133517 30625 consensus_queue.cc:1048] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:48.133937 30479 raft_consensus.cc:515] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.138635 30479 leader_election.cc:290] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 2 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:48.140034 30601 consensus_queue.cc:1048] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:48.141073 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:48.141682 30403 raft_consensus.cc:3060] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.143271 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:48.143910 30553 raft_consensus.cc:3055] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:48.144241 30553 raft_consensus.cc:740] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:48.145099 30553 consensus_queue.cc:260] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.146369 30553 raft_consensus.cc:3060] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.151804 30403 raft_consensus.cc:2468] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 2.
I20260709 12:20:48.152135 30631 raft_consensus.cc:993] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa: : Instructing follower 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:48.152688 30631 raft_consensus.cc:1081] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Signalling peer 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:48.156148 30444 leader_election.cc:304] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:48.155625 30553 raft_consensus.cc:2468] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 2.
I20260709 12:20:48.159126 30631 raft_consensus.cc:2804] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:48.159591 30631 raft_consensus.cc:697] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:48.160601 30631 consensus_queue.cc:237] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.162752 30402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:49696
I20260709 12:20:48.163931 30402 raft_consensus.cc:493] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:48.164361 30402 raft_consensus.cc:3060] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.166260 30625 consensus_queue.cc:1048] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:48.172643 30402 raft_consensus.cc:515] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:48.172827 30299 catalog_manager.cc:5697] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 1 to 2, leader changed from 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3) to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 2 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:48.175024 30625 raft_consensus.cc:993] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6: : Instructing follower 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:48.175498 30402 leader_election.cc:290] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:48.175518 30625 raft_consensus.cc:1081] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Signalling peer 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:48.176728 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:48.177328 30553 raft_consensus.cc:3060] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.178705 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f6e0e4ef834d2c97a3ffd51c8acf34" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:48.179284 30402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:49708
I20260709 12:20:48.179867 30402 raft_consensus.cc:493] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:48.180223 30402 raft_consensus.cc:3060] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.179342 30478 raft_consensus.cc:3055] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:48.181986 30478 raft_consensus.cc:740] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:48.182829 30478 consensus_queue.cc:260] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:48.183701 30553 raft_consensus.cc:2468] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:48.184111 30478 raft_consensus.cc:3060] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.184928 30367 leader_election.cc:304] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:48.186105 30603 raft_consensus.cc:2804] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:48.186573 30603 raft_consensus.cc:697] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:48.187300 30402 raft_consensus.cc:515] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.187474 30603 consensus_queue.cc:237] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } }
I20260709 12:20:48.189381 30402 leader_election.cc:290] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:48.191565 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:48.191701 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e9b563b23842ef8d1d42aafea0e22c" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:48.192133 30479 raft_consensus.cc:3060] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.192301 30553 raft_consensus.cc:3055] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:48.192718 30553 raft_consensus.cc:740] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:48.193586 30553 consensus_queue.cc:260] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.194103 30478 raft_consensus.cc:2468] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:48.195852 30553 raft_consensus.cc:3060] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.195917 30300 catalog_manager.cc:5697] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 1 to 2, leader changed from c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2) to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.198722 30479 raft_consensus.cc:2468] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:48.199787 30368 leader_election.cc:304] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:48.200557 30603 raft_consensus.cc:2804] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:48.201023 30603 raft_consensus.cc:697] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:48.201941 30603 consensus_queue.cc:237] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.202486 30553 raft_consensus.cc:2468] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:48.209839 30300 catalog_manager.cc:5697] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 1 to 2, leader changed from 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3) to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:48.293745 30630 raft_consensus.cc:993] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa: : Instructing follower 6845868c2cad4fc1a0733b72a1b568c6 to start an election
I20260709 12:20:48.294276 30631 raft_consensus.cc:1081] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Signalling peer 6845868c2cad4fc1a0733b72a1b568c6 to start an election
I20260709 12:20:48.295969 30553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e20d73b79d934d4cadab76e175aa2271"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
 from {username='slave'} at 127.0.0.1:33742
I20260709 12:20:48.296419 30553 raft_consensus.cc:493] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:48.296794 30553 raft_consensus.cc:3060] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.301721 30553 raft_consensus.cc:515] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.303328 30553 leader_election.cc:290] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:48.304075 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20d73b79d934d4cadab76e175aa2271" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:48.304279 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20d73b79d934d4cadab76e175aa2271" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:48.304735 30402 raft_consensus.cc:3060] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.304809 30479 raft_consensus.cc:3055] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:48.305275 30479 raft_consensus.cc:740] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:48.305969 30479 consensus_queue.cc:260] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.306950 30479 raft_consensus.cc:3060] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:48.310259 30402 raft_consensus.cc:2468] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 2.
I20260709 12:20:48.311456 30518 leader_election.cc:304] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:48.312124 30625 raft_consensus.cc:2804] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:48.312552 30625 raft_consensus.cc:697] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:48.313393 30479 raft_consensus.cc:2468] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 2.
I20260709 12:20:48.313372 30625 consensus_queue.cc:237] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:48.319765 30300 catalog_manager.cc:5697] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 1 to 2, leader changed from c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2) to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.444294 30553 raft_consensus.cc:1275] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.445469 30682 consensus_queue.cc:1048] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:48.452709 30479 raft_consensus.cc:1275] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.454984 30663 consensus_queue.cc:1048] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:48.559785 30553 raft_consensus.cc:1275] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer c1c801c5e2ba4c60b1eff73283196afa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.561035 30631 consensus_queue.cc:1048] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:48.569902 30402 raft_consensus.cc:1275] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Refusing update from remote peer c1c801c5e2ba4c60b1eff73283196afa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.571214 30630 consensus_queue.cc:1048] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:48.668936 30553 raft_consensus.cc:1275] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.670099 30663 consensus_queue.cc:1048] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:48.677599 30479 raft_consensus.cc:1275] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.679653 30682 consensus_queue.cc:1048] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:48.716984 30402 raft_consensus.cc:1275] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Refusing update from remote peer 6845868c2cad4fc1a0733b72a1b568c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.718168 30625 consensus_queue.cc:1048] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:48.726136 30479 raft_consensus.cc:1275] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Refusing update from remote peer 6845868c2cad4fc1a0733b72a1b568c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.727638 30625 consensus_queue.cc:1048] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:48.748471 30553 raft_consensus.cc:1275] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.749579 30663 consensus_queue.cc:1048] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:48.757275 30479 raft_consensus.cc:1275] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:48.759233 30682 consensus_queue.cc:1048] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:51.006240 30300 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48682:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:51.009363 30300 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:51.056705 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 132c553b5f2d4ec7b9a77e44c7cb9a72 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:51.059015 30469 tablet_service.cc:1511] Processing CreateTablet for tablet 132c553b5f2d4ec7b9a77e44c7cb9a72 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:51.059048 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132c553b5f2d4ec7b9a77e44c7cb9a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.061527 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 132c553b5f2d4ec7b9a77e44c7cb9a72 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:51.061652 30393 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada40eb5c194b68a512c31a6b2b932e (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:51.063071 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132c553b5f2d4ec7b9a77e44c7cb9a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.063941 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132c553b5f2d4ec7b9a77e44c7cb9a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.064769 30542 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada40eb5c194b68a512c31a6b2b932e (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:51.066143 30542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada40eb5c194b68a512c31a6b2b932e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.066025 30388 tablet_service.cc:1511] Processing CreateTablet for tablet 40aa143e534746f4a20b10777ab7366a (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:51.069455 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada40eb5c194b68a512c31a6b2b932e (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:51.070789 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada40eb5c194b68a512c31a6b2b932e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.071928 30389 tablet_service.cc:1511] Processing CreateTablet for tablet 90a11f6ff29648ce81cd4a605a2e2740 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:51.074637 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 40aa143e534746f4a20b10777ab7366a (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:51.075990 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40aa143e534746f4a20b10777ab7366a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.063083 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada40eb5c194b68a512c31a6b2b932e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.078207 30388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40aa143e534746f4a20b10777ab7366a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.076010 30465 tablet_service.cc:1511] Processing CreateTablet for tablet 40aa143e534746f4a20b10777ab7366a (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:51.080127 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40aa143e534746f4a20b10777ab7366a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.081331 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 90a11f6ff29648ce81cd4a605a2e2740 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:51.078651 30390 tablet_service.cc:1511] Processing CreateTablet for tablet 5bdb43fec18544b18712578a0c3fa153 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:51.082585 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90a11f6ff29648ce81cd4a605a2e2740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.082991 30390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdb43fec18544b18712578a0c3fa153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.085861 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 90a11f6ff29648ce81cd4a605a2e2740 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:51.087229 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90a11f6ff29648ce81cd4a605a2e2740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.088961 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90a11f6ff29648ce81cd4a605a2e2740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.096226 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 5bdb43fec18544b18712578a0c3fa153 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:51.097671 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdb43fec18544b18712578a0c3fa153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.098297 30543 tablet_service.cc:1511] Processing CreateTablet for tablet 5bdb43fec18544b18712578a0c3fa153 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:51.099727 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdb43fec18544b18712578a0c3fa153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.099598 30385 tablet_service.cc:1511] Processing CreateTablet for tablet bb619ea56cf54693b88ce4baf238029d (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:51.101011 30385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb619ea56cf54693b88ce4baf238029d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.112432 30468 tablet_service.cc:1511] Processing CreateTablet for tablet bb619ea56cf54693b88ce4baf238029d (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:51.113837 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb619ea56cf54693b88ce4baf238029d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.124643 30540 tablet_service.cc:1511] Processing CreateTablet for tablet bb619ea56cf54693b88ce4baf238029d (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:51.126044 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb619ea56cf54693b88ce4baf238029d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.145552 30386 tablet_service.cc:1511] Processing CreateTablet for tablet b61212eb05e341c8b6ce0893a7cdf61f (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:51.147279 30386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61212eb05e341c8b6ce0893a7cdf61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.149361 30537 tablet_service.cc:1511] Processing CreateTablet for tablet b61212eb05e341c8b6ce0893a7cdf61f (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:51.150777 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61212eb05e341c8b6ce0893a7cdf61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.147215 30468 tablet_service.cc:1511] Processing CreateTablet for tablet b61212eb05e341c8b6ce0893a7cdf61f (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:51.160797 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61212eb05e341c8b6ce0893a7cdf61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.193693 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 95f8a5d12d65452c9ccb26c6b3db350d (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:51.195133 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f8a5d12d65452c9ccb26c6b3db350d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.202800 30535 tablet_service.cc:1511] Processing CreateTablet for tablet 95f8a5d12d65452c9ccb26c6b3db350d (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:51.204196 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f8a5d12d65452c9ccb26c6b3db350d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.206058 30699 tablet_bootstrap.cc:492] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:51.209337 30700 tablet_bootstrap.cc:492] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:51.221738 30385 tablet_service.cc:1511] Processing CreateTablet for tablet 65ede6aeeca14ca480c93b44f8864819 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:51.223186 30385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ede6aeeca14ca480c93b44f8864819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.223928 30701 tablet_bootstrap.cc:492] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:51.238636 30701 tablet_bootstrap.cc:654] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.240625 30540 tablet_service.cc:1511] Processing CreateTablet for tablet 65ede6aeeca14ca480c93b44f8864819 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:51.242221 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ede6aeeca14ca480c93b44f8864819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.247879 30393 tablet_service.cc:1511] Processing CreateTablet for tablet 95f8a5d12d65452c9ccb26c6b3db350d (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:51.249409 30699 tablet_bootstrap.cc:654] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.252570 30700 tablet_bootstrap.cc:654] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.253652 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 65ede6aeeca14ca480c93b44f8864819 (DEFAULT_TABLE table=soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:51.267761 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ede6aeeca14ca480c93b44f8864819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.262403 30701 tablet_bootstrap.cc:492] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:51.275915 30701 ts_tablet_manager.cc:1403] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.011s
I20260709 12:20:51.277724 30700 tablet_bootstrap.cc:492] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:51.278270 30700 ts_tablet_manager.cc:1403] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.069s	user 0.006s	sys 0.007s
I20260709 12:20:51.279583 30701 raft_consensus.cc:359] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.280553 30701 raft_consensus.cc:385] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.280941 30701 raft_consensus.cc:740] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.273283 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f8a5d12d65452c9ccb26c6b3db350d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:51.281821 30701 consensus_queue.cc:260] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.284714 30701 ts_tablet_manager.cc:1434] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:51.285895 30701 tablet_bootstrap.cc:492] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:51.281131 30700 raft_consensus.cc:359] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.286371 30700 raft_consensus.cc:385] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.286724 30700 raft_consensus.cc:740] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.287626 30700 consensus_queue.cc:260] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.292707 30701 tablet_bootstrap.cc:654] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.293416 30700 ts_tablet_manager.cc:1434] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:20:51.295712 30700 tablet_bootstrap.cc:492] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:51.311630 30699 tablet_bootstrap.cc:492] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:51.311630 30700 tablet_bootstrap.cc:654] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.312258 30699 ts_tablet_manager.cc:1403] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.106s	user 0.027s	sys 0.022s
I20260709 12:20:51.314236 30701 tablet_bootstrap.cc:492] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:51.317516 30701 ts_tablet_manager.cc:1403] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.012s
I20260709 12:20:51.317427 30699 raft_consensus.cc:359] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.318210 30699 raft_consensus.cc:385] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.318576 30699 raft_consensus.cc:740] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.319514 30699 consensus_queue.cc:260] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.320711 30701 raft_consensus.cc:359] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.321499 30701 raft_consensus.cc:385] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.321882 30701 raft_consensus.cc:740] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.321178 30700 tablet_bootstrap.cc:492] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:51.322937 30700 ts_tablet_manager.cc:1403] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.008s
I20260709 12:20:51.323129 30699 ts_tablet_manager.cc:1434] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:20:51.323489 30701 consensus_queue.cc:260] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.324172 30699 tablet_bootstrap.cc:492] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:51.326006 30701 ts_tablet_manager.cc:1434] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:20:51.330101 30701 tablet_bootstrap.cc:492] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:51.330729 30699 tablet_bootstrap.cc:654] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.330253 30700 raft_consensus.cc:359] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.335418 30700 raft_consensus.cc:385] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.335779 30700 raft_consensus.cc:740] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.336438 30699 tablet_bootstrap.cc:492] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:51.337013 30699 ts_tablet_manager.cc:1403] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 12:20:51.336637 30700 consensus_queue.cc:260] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.337261 30701 tablet_bootstrap.cc:654] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.339982 30699 raft_consensus.cc:359] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.340816 30699 raft_consensus.cc:385] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.341182 30699 raft_consensus.cc:740] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.342069 30699 consensus_queue.cc:260] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.343544 30700 ts_tablet_manager.cc:1434] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:20:51.344735 30700 tablet_bootstrap.cc:492] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
W20260709 12:20:51.348179 30349 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:51.346447 30699 ts_tablet_manager.cc:1434] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:20:51.349450 30699 tablet_bootstrap.cc:492] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:51.351660 30700 tablet_bootstrap.cc:654] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.354391 30687 raft_consensus.cc:493] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.354892 30687 raft_consensus.cc:515] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.357069 30687 leader_election.cc:290] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.357898 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb619ea56cf54693b88ce4baf238029d" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:51.358357 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb619ea56cf54693b88ce4baf238029d" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:51.358598 30402 raft_consensus.cc:2468] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:51.359138 30552 raft_consensus.cc:2468] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:51.360100 30444 leader_election.cc:304] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:51.361307 30687 raft_consensus.cc:2804] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.361431 30699 tablet_bootstrap.cc:654] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.363965 30687 raft_consensus.cc:493] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.364332 30687 raft_consensus.cc:3060] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.372816 30700 tablet_bootstrap.cc:492] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:51.373529 30700 ts_tablet_manager.cc:1403] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.005s
I20260709 12:20:51.374329 30687 raft_consensus.cc:515] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.377533 30699 tablet_bootstrap.cc:492] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:51.378125 30699 ts_tablet_manager.cc:1403] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.000s
I20260709 12:20:51.380869 30700 raft_consensus.cc:359] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.381256 30699 raft_consensus.cc:359] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.382172 30687 leader_election.cc:290] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.383064 30700 raft_consensus.cc:385] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.383210 30699 raft_consensus.cc:385] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.383463 30700 raft_consensus.cc:740] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.383592 30699 raft_consensus.cc:740] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.384353 30700 consensus_queue.cc:260] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.383917 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb619ea56cf54693b88ce4baf238029d" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:51.385390 30552 raft_consensus.cc:3060] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.384533 30699 consensus_queue.cc:260] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.386153 30701 tablet_bootstrap.cc:492] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:51.386646 30701 ts_tablet_manager.cc:1403] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.026s
I20260709 12:20:51.389753 30699 ts_tablet_manager.cc:1434] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:20:51.389597 30701 raft_consensus.cc:359] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.390309 30701 raft_consensus.cc:385] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.390599 30701 raft_consensus.cc:740] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.390974 30699 tablet_bootstrap.cc:492] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:51.384357 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb619ea56cf54693b88ce4baf238029d" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:51.391364 30701 consensus_queue.cc:260] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.391906 30402 raft_consensus.cc:3060] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.393934 30701 ts_tablet_manager.cc:1434] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:51.395555 30686 raft_consensus.cc:493] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.396096 30686 raft_consensus.cc:515] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.398234 30699 tablet_bootstrap.cc:654] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.399699 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:51.400395 30553 raft_consensus.cc:2468] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 0.
I20260709 12:20:51.402133 30701 tablet_bootstrap.cc:492] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:51.402150 30367 leader_election.cc:304] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:51.409287 30701 tablet_bootstrap.cc:654] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.421510 30701 tablet_bootstrap.cc:492] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:51.422181 30701 ts_tablet_manager.cc:1403] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:20:51.425299 30701 raft_consensus.cc:359] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.426252 30701 raft_consensus.cc:385] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.426628 30701 raft_consensus.cc:740] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.427587 30701 consensus_queue.cc:260] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.430119 30701 ts_tablet_manager.cc:1434] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:20:51.431006 30686 leader_election.cc:290] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.432096 30686 raft_consensus.cc:2804] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.432520 30686 raft_consensus.cc:493] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.432940 30686 raft_consensus.cc:3060] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.441177 30686 raft_consensus.cc:515] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.442816 30701 tablet_bootstrap.cc:492] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:51.453233 30701 tablet_bootstrap.cc:654] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.456835 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:51.457561 30553 raft_consensus.cc:3060] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.465088 30553 raft_consensus.cc:2468] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 1.
I20260709 12:20:51.466483 30367 leader_election.cc:304] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:51.467585 30552 raft_consensus.cc:2468] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:51.469370 30443 leader_election.cc:304] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:51.470531 30687 raft_consensus.cc:2804] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.471042 30687 raft_consensus.cc:697] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:51.471906 30687 consensus_queue.cc:237] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.454949 30402 raft_consensus.cc:2468] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:51.455554 30686 leader_election.cc:290] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.481264 30686 raft_consensus.cc:493] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.481783 30686 raft_consensus.cc:515] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.484670 30714 raft_consensus.cc:2804] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.485162 30686 leader_election.cc:290] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.486372 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada40eb5c194b68a512c31a6b2b932e" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:51.487226 30552 raft_consensus.cc:2468] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 0.
I20260709 12:20:51.488502 30367 leader_election.cc:304] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:51.489500 30715 raft_consensus.cc:2804] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.489976 30715 raft_consensus.cc:493] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.490351 30715 raft_consensus.cc:3060] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.504347 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:51.504827 30701 tablet_bootstrap.cc:492] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:51.505604 30701 ts_tablet_manager.cc:1403] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.008s
I20260709 12:20:51.504735 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:51.506590 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada40eb5c194b68a512c31a6b2b932e" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:51.507316 30477 raft_consensus.cc:2468] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 0.
I20260709 12:20:51.511699 30701 raft_consensus.cc:359] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.512647 30701 raft_consensus.cc:385] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.513005 30701 raft_consensus.cc:740] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.513996 30701 consensus_queue.cc:260] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.516736 30701 ts_tablet_manager.cc:1434] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:20:51.518007 30701 tablet_bootstrap.cc:492] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:51.524948 30701 tablet_bootstrap.cc:654] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.534965 30715 raft_consensus.cc:515] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.541112 30715 leader_election.cc:290] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.542215 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada40eb5c194b68a512c31a6b2b932e" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:51.543138 30552 raft_consensus.cc:3060] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.553293 30552 raft_consensus.cc:2468] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 1.
I20260709 12:20:51.554742 30367 leader_election.cc:304] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:51.555735 30715 raft_consensus.cc:2804] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.556208 30715 raft_consensus.cc:697] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:51.557101 30715 consensus_queue.cc:237] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.485307 30714 raft_consensus.cc:697] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:51.559753 30714 consensus_queue.cc:237] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
W20260709 12:20:51.562860 30368 leader_election.cc:343] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:51.573227 30368 leader_election.cc:343] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.575542 30699 tablet_bootstrap.cc:492] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:51.576180 30699 ts_tablet_manager.cc:1403] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.185s	user 0.075s	sys 0.094s
I20260709 12:20:51.576308 30700 ts_tablet_manager.cc:1434] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.202s	user 0.088s	sys 0.088s
I20260709 12:20:51.578061 30700 tablet_bootstrap.cc:492] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:51.579311 30699 raft_consensus.cc:359] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.580139 30699 raft_consensus.cc:385] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.579749 30300 catalog_manager.cc:5697] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.582347 30298 catalog_manager.cc:5697] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 0 to 1, leader changed from <none> to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 1 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.580472 30699 raft_consensus.cc:740] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.584447 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada40eb5c194b68a512c31a6b2b932e" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:51.585131 30700 tablet_bootstrap.cc:654] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.584865 30699 consensus_queue.cc:260] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.585230 30477 raft_consensus.cc:3060] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.587311 30699 ts_tablet_manager.cc:1434] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:20:51.588277 30699 tablet_bootstrap.cc:492] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:51.592865 30687 raft_consensus.cc:493] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.593461 30687 raft_consensus.cc:515] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.594636 30477 raft_consensus.cc:2468] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 1.
I20260709 12:20:51.596926 30687 leader_election.cc:290] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.599401 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
W20260709 12:20:51.602685 30444 leader_election.cc:343] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.603389 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:51.604055 30552 raft_consensus.cc:2468] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 0.
I20260709 12:20:51.604432 30699 tablet_bootstrap.cc:654] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.605368 30701 tablet_bootstrap.cc:492] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:51.606622 30443 leader_election.cc:304] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:51.608459 30687 raft_consensus.cc:2804] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.608820 30687 raft_consensus.cc:493] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.609135 30687 raft_consensus.cc:3060] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.610702 30700 tablet_bootstrap.cc:492] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:51.611231 30700 ts_tablet_manager.cc:1403] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.010s
I20260709 12:20:51.615806 30700 raft_consensus.cc:359] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.616607 30700 raft_consensus.cc:385] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.616938 30700 raft_consensus.cc:740] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.617182 30701 ts_tablet_manager.cc:1403] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.020s
I20260709 12:20:51.617762 30700 consensus_queue.cc:260] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.620201 30700 ts_tablet_manager.cc:1434] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:51.621248 30700 tablet_bootstrap.cc:492] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:51.617069 30687 raft_consensus.cc:515] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.625968 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
W20260709 12:20:51.627808 30444 leader_election.cc:343] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.627931 30700 tablet_bootstrap.cc:654] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.625880 30701 raft_consensus.cc:359] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.630017 30701 raft_consensus.cc:385] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.630102 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:51.630401 30701 raft_consensus.cc:740] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.630715 30552 raft_consensus.cc:3060] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.631325 30701 consensus_queue.cc:260] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.632552 30687 leader_election.cc:290] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.636488 30699 tablet_bootstrap.cc:492] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:51.637152 30699 ts_tablet_manager.cc:1403] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.018s
I20260709 12:20:51.637584 30701 ts_tablet_manager.cc:1434] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:20:51.638309 30552 raft_consensus.cc:2468] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 1.
I20260709 12:20:51.638707 30701 tablet_bootstrap.cc:492] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:51.639655 30443 leader_election.cc:304] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:51.640735 30687 raft_consensus.cc:2804] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.640422 30699 raft_consensus.cc:359] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.641300 30699 raft_consensus.cc:385] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.641321 30687 raft_consensus.cc:697] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:51.641737 30699 raft_consensus.cc:740] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.642616 30699 consensus_queue.cc:260] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.642640 30687 consensus_queue.cc:237] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.644112 30700 tablet_bootstrap.cc:492] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:51.644673 30700 ts_tablet_manager.cc:1403] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 12:20:51.645164 30699 ts_tablet_manager.cc:1434] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:51.646252 30699 tablet_bootstrap.cc:492] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:51.647735 30700 raft_consensus.cc:359] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.648573 30700 raft_consensus.cc:385] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.648924 30700 raft_consensus.cc:740] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.649680 30700 consensus_queue.cc:260] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.651949 30700 ts_tablet_manager.cc:1434] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:20:51.652915 30700 tablet_bootstrap.cc:492] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:51.659428 30700 tablet_bootstrap.cc:654] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.666589 30299 catalog_manager.cc:5697] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 0 to 1, leader changed from <none> to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 1 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.668172 30701 tablet_bootstrap.cc:654] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.669684 30298 catalog_manager.cc:5697] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.671069 30700 tablet_bootstrap.cc:492] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:51.671567 30700 ts_tablet_manager.cc:1403] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 12:20:51.674577 30700 raft_consensus.cc:359] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.675180 30699 tablet_bootstrap.cc:654] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.675436 30700 raft_consensus.cc:385] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.675806 30700 raft_consensus.cc:740] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.676611 30700 consensus_queue.cc:260] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.677810 30685 raft_consensus.cc:493] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.678316 30685 raft_consensus.cc:515] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.679045 30700 ts_tablet_manager.cc:1434] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:20:51.680064 30700 tablet_bootstrap.cc:492] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:51.681274 30685 leader_election.cc:290] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:51.681447 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:51.682082 30402 raft_consensus.cc:2468] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 0.
I20260709 12:20:51.682322 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:51.683139 30518 leader_election.cc:304] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
W20260709 12:20:51.684501 30518 leader_election.cc:343] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.685437 30685 raft_consensus.cc:2804] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.685882 30685 raft_consensus.cc:493] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.686270 30685 raft_consensus.cc:3060] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.692224 30701 tablet_bootstrap.cc:492] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:51.693257 30700 tablet_bootstrap.cc:654] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.693552 30701 ts_tablet_manager.cc:1403] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.003s
I20260709 12:20:51.698238 30685 raft_consensus.cc:515] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.700495 30701 raft_consensus.cc:359] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.701396 30701 raft_consensus.cc:385] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.701753 30701 raft_consensus.cc:740] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.702545 30701 consensus_queue.cc:260] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.705842 30700 tablet_bootstrap.cc:492] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:51.706431 30700 ts_tablet_manager.cc:1403] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.006s
I20260709 12:20:51.709486 30700 raft_consensus.cc:359] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.710398 30700 raft_consensus.cc:385] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.710757 30700 raft_consensus.cc:740] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.711210 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:51.711920 30402 raft_consensus.cc:3060] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.711627 30700 consensus_queue.cc:260] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.714322 30700 ts_tablet_manager.cc:1434] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:20:51.715378 30700 tablet_bootstrap.cc:492] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:51.720578 30402 raft_consensus.cc:2468] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 1.
I20260709 12:20:51.722868 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:51.721833 30700 tablet_bootstrap.cc:654] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.723973 30518 leader_election.cc:304] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:51.727634 30733 raft_consensus.cc:493] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.730978 30733 raft_consensus.cc:515] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.733287 30733 leader_election.cc:290] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:51.722658 30685 leader_election.cc:290] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:51.730460 30699 tablet_bootstrap.cc:492] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:51.734325 30699 ts_tablet_manager.cc:1403] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.088s	user 0.019s	sys 0.003s
I20260709 12:20:51.734141 30685 raft_consensus.cc:2804] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.734942 30700 tablet_bootstrap.cc:492] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:51.735374 30685 raft_consensus.cc:697] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:51.735603 30700 ts_tablet_manager.cc:1403] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:20:51.736304 30685 consensus_queue.cc:237] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.738487 30700 raft_consensus.cc:359] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.739243 30700 raft_consensus.cc:385] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.739817 30700 raft_consensus.cc:740] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.737581 30699 raft_consensus.cc:359] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.740633 30700 consensus_queue.cc:260] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.741031 30699 raft_consensus.cc:385] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.741454 30699 raft_consensus.cc:740] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.742812 30700 ts_tablet_manager.cc:1434] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:51.743001 30699 consensus_queue.cc:260] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.744061 30700 tablet_bootstrap.cc:492] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68: Bootstrap starting.
I20260709 12:20:51.750430 30700 tablet_bootstrap.cc:654] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.752355 30699 ts_tablet_manager.cc:1434] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 12:20:51.756250 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:51.760035 30699 tablet_bootstrap.cc:492] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:51.762359 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:51.763945 30700 tablet_bootstrap.cc:492] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68: No bootstrap required, opened a new log
I20260709 12:20:51.764060 30402 raft_consensus.cc:2468] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 0.
W20260709 12:20:51.763336 30518 leader_election.cc:343] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.765050 30714 raft_consensus.cc:493] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.765745 30518 leader_election.cc:343] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.765551 30714 raft_consensus.cc:515] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.764585 30700 ts_tablet_manager.cc:1403] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:20:51.767649 30714 leader_election.cc:290] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.768883 30700 raft_consensus.cc:359] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.769834 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:51.770512 30699 tablet_bootstrap.cc:654] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.771716 30700 raft_consensus.cc:385] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.772065 30700 raft_consensus.cc:740] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.772435 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:51.773283 30552 raft_consensus.cc:2393] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f9cd366f8ae43a09328075ce5b33c68 in current term 1: Already voted for candidate c1c801c5e2ba4c60b1eff73283196afa in this term.
I20260709 12:20:51.772913 30700 consensus_queue.cc:260] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.775233 30700 ts_tablet_manager.cc:1434] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:51.777092 30518 leader_election.cc:304] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:51.778116 30735 raft_consensus.cc:2804] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.778515 30735 raft_consensus.cc:493] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.778887 30735 raft_consensus.cc:3060] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.779837 30367 leader_election.cc:304] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68; no voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:51.782557 30701 ts_tablet_manager.cc:1434] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.089s	user 0.034s	sys 0.040s
I20260709 12:20:51.785750 30699 tablet_bootstrap.cc:492] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:51.787422 30699 ts_tablet_manager.cc:1403] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.010s
I20260709 12:20:51.787715 30714 raft_consensus.cc:3060] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.787885 30701 tablet_bootstrap.cc:492] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:51.793533 30300 catalog_manager.cc:5697] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.795629 30699 raft_consensus.cc:359] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.796449 30699 raft_consensus.cc:385] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.796722 30699 raft_consensus.cc:740] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.797490 30699 consensus_queue.cc:260] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.800201 30701 tablet_bootstrap.cc:654] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.800114 30735 raft_consensus.cc:515] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.803047 30735 leader_election.cc:290] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:51.803478 30699 ts_tablet_manager.cc:1434] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 12:20:51.804265 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:51.804605 30699 tablet_bootstrap.cc:492] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
W20260709 12:20:51.806001 30518 leader_election.cc:343] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.811899 30699 tablet_bootstrap.cc:654] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.817162 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:51.817773 30402 raft_consensus.cc:3060] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.818949 30714 raft_consensus.cc:2749] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.824524 30701 tablet_bootstrap.cc:492] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:51.825016 30701 ts_tablet_manager.cc:1403] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.020s
I20260709 12:20:51.825300 30402 raft_consensus.cc:2468] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 1.
I20260709 12:20:51.826287 30518 leader_election.cc:304] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:51.826946 30735 raft_consensus.cc:2804] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.827399 30735 raft_consensus.cc:697] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:51.827435 30701 raft_consensus.cc:359] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.828177 30701 raft_consensus.cc:385] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.828586 30701 raft_consensus.cc:740] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.828310 30735 consensus_queue.cc:237] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.829303 30701 consensus_queue.cc:260] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.829978 30699 tablet_bootstrap.cc:492] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:51.830457 30699 ts_tablet_manager.cc:1403] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 12:20:51.831426 30701 ts_tablet_manager.cc:1434] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:51.832418 30701 tablet_bootstrap.cc:492] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6: Bootstrap starting.
I20260709 12:20:51.833019 30699 raft_consensus.cc:359] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.833664 30699 raft_consensus.cc:385] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.833920 30699 raft_consensus.cc:740] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.834445 30699 consensus_queue.cc:260] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.836614 30699 ts_tablet_manager.cc:1434] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:51.837630 30699 tablet_bootstrap.cc:492] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa: Bootstrap starting.
I20260709 12:20:51.838008 30701 tablet_bootstrap.cc:654] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.837428 30299 catalog_manager.cc:5697] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.845396 30699 tablet_bootstrap.cc:654] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.855786 30699 tablet_bootstrap.cc:492] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa: No bootstrap required, opened a new log
I20260709 12:20:51.856243 30699 ts_tablet_manager.cc:1403] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 12:20:51.865537 30699 raft_consensus.cc:359] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.865849 30701 tablet_bootstrap.cc:492] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6: No bootstrap required, opened a new log
I20260709 12:20:51.866042 30699 raft_consensus.cc:385] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.866318 30699 raft_consensus.cc:740] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.866379 30701 ts_tablet_manager.cc:1403] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.018s
I20260709 12:20:51.866888 30699 consensus_queue.cc:260] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.868803 30699 ts_tablet_manager.cc:1434] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.007s
I20260709 12:20:51.869094 30701 raft_consensus.cc:359] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.869767 30701 raft_consensus.cc:385] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.869969 30701 raft_consensus.cc:740] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.870746 30701 consensus_queue.cc:260] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.872627 30701 ts_tablet_manager.cc:1434] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:20:51.888870 30687 raft_consensus.cc:493] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.889379 30687 raft_consensus.cc:515] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.891115 30687 leader_election.cc:290] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.891714 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:51.891948 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:51.892781 30552 raft_consensus.cc:2393] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1c801c5e2ba4c60b1eff73283196afa in current term 1: Already voted for candidate 8f9cd366f8ae43a09328075ce5b33c68 in this term.
I20260709 12:20:51.893687 30443 leader_election.cc:304] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1c801c5e2ba4c60b1eff73283196afa; no voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:51.894287 30687 raft_consensus.cc:3060] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.899333 30687 raft_consensus.cc:2749] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.908468 30687 raft_consensus.cc:493] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.908924 30687 raft_consensus.cc:515] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.910873 30687 leader_election.cc:290] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.911597 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:51.911926 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:51.912452 30403 raft_consensus.cc:2393] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1c801c5e2ba4c60b1eff73283196afa in current term 1: Already voted for candidate 6845868c2cad4fc1a0733b72a1b568c6 in this term.
I20260709 12:20:51.913371 30444 leader_election.cc:304] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1c801c5e2ba4c60b1eff73283196afa; no voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:51.913945 30687 raft_consensus.cc:3060] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.918720 30687 raft_consensus.cc:2749] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.941956 30711 raft_consensus.cc:493] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.942466 30711 raft_consensus.cc:515] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.944224 30711 leader_election.cc:290] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.945080 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ede6aeeca14ca480c93b44f8864819" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:51.945182 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ede6aeeca14ca480c93b44f8864819" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:51.945674 30477 raft_consensus.cc:2468] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 0.
I20260709 12:20:51.945809 30553 raft_consensus.cc:2468] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 0.
I20260709 12:20:51.946353 30687 consensus_queue.cc:1048] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.946758 30368 leader_election.cc:304] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:51.947537 30711 raft_consensus.cc:2804] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.947881 30711 raft_consensus.cc:493] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.948145 30711 raft_consensus.cc:3060] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.955220 30711 raft_consensus.cc:515] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.957267 30711 leader_election.cc:290] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.958638 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ede6aeeca14ca480c93b44f8864819" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:51.959209 30553 raft_consensus.cc:3060] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.959470 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ede6aeeca14ca480c93b44f8864819" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:51.960059 30477 raft_consensus.cc:3060] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.962509 30687 consensus_queue.cc:1048] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:51.963729 30735 raft_consensus.cc:493] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.964210 30735 raft_consensus.cc:515] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.966156 30735 leader_election.cc:290] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:51.967770 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f8a5d12d65452c9ccb26c6b3db350d" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:51.968320 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f8a5d12d65452c9ccb26c6b3db350d" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:51.968945 30478 raft_consensus.cc:2468] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 0.
I20260709 12:20:51.968375 30402 raft_consensus.cc:2468] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 0.
I20260709 12:20:51.970096 30518 leader_election.cc:304] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:51.974272 30477 raft_consensus.cc:2468] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 1.
I20260709 12:20:51.975422 30368 leader_election.cc:304] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:51.975651 30735 raft_consensus.cc:2804] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.976045 30735 raft_consensus.cc:493] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.976399 30735 raft_consensus.cc:3060] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.978289 30553 raft_consensus.cc:2468] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 1.
I20260709 12:20:51.980203 30711 raft_consensus.cc:493] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.980778 30711 raft_consensus.cc:515] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.983027 30711 leader_election.cc:290] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:51.984659 30711 raft_consensus.cc:2804] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.985098 30711 raft_consensus.cc:697] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:51.985510 30735 raft_consensus.cc:515] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.985891 30711 consensus_queue.cc:237] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:51.988045 30735 leader_election.cc:290] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:51.989121 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb43fec18544b18712578a0c3fa153" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:51.989181 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f8a5d12d65452c9ccb26c6b3db350d" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:51.989732 30553 raft_consensus.cc:2468] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 0.
I20260709 12:20:51.990537 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f8a5d12d65452c9ccb26c6b3db350d" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:51.991091 30402 raft_consensus.cc:3060] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.993446 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb43fec18544b18712578a0c3fa153" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa" is_pre_election: true
I20260709 12:20:51.994059 30478 raft_consensus.cc:2468] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 0.
I20260709 12:20:51.990799 30367 leader_election.cc:304] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:51.995769 30714 raft_consensus.cc:2804] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.996127 30714 raft_consensus.cc:493] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.996441 30714 raft_consensus.cc:3060] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.990067 30477 raft_consensus.cc:3060] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.000414 30402 raft_consensus.cc:2468] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 1.
I20260709 12:20:52.006714 30518 leader_election.cc:304] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:52.007606 30735 raft_consensus.cc:2804] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.006038 30714 raft_consensus.cc:515] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.008116 30735 raft_consensus.cc:697] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:52.008430 30477 raft_consensus.cc:2468] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 1.
I20260709 12:20:52.008971 30735 consensus_queue.cc:237] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.010357 30714 leader_election.cc:290] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:52.011262 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb43fec18544b18712578a0c3fa153" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:52.011925 30477 raft_consensus.cc:3060] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.012781 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb43fec18544b18712578a0c3fa153" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:52.013350 30553 raft_consensus.cc:3060] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.013684 30299 catalog_manager.cc:5697] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.020237 30477 raft_consensus.cc:2468] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 1.
I20260709 12:20:52.027806 30553 raft_consensus.cc:2468] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 1.
I20260709 12:20:52.027956 30368 leader_election.cc:304] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:52.027995 30748 raft_consensus.cc:493] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.028885 30714 raft_consensus.cc:2804] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.029457 30714 raft_consensus.cc:697] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:52.029266 30748 raft_consensus.cc:515] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.030390 30714 consensus_queue.cc:237] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.031284 30300 catalog_manager.cc:5697] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 1 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.032336 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6" is_pre_election: true
I20260709 12:20:52.033982 30748 leader_election.cc:290] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:52.034063 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68" is_pre_election: true
I20260709 12:20:52.034834 30402 raft_consensus.cc:2393] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1c801c5e2ba4c60b1eff73283196afa in current term 1: Already voted for candidate 6845868c2cad4fc1a0733b72a1b568c6 in this term.
I20260709 12:20:52.035900 30444 leader_election.cc:304] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1c801c5e2ba4c60b1eff73283196afa; no voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:52.037026 30748 raft_consensus.cc:3060] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.036921 30711 consensus_queue.cc:1048] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.046594 30299 catalog_manager.cc:5697] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 1 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.051326 30748 raft_consensus.cc:2749] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.055649 30711 consensus_queue.cc:1048] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.120950 30711 consensus_queue.cc:1048] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.140025 30714 consensus_queue.cc:1048] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.173010 30735 consensus_queue.cc:1048] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.188114 30733 consensus_queue.cc:1048] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.188333 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72"
dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
mode: GRACEFUL
new_leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:52614
I20260709 12:20:52.188937 30477 raft_consensus.cc:606] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Received request to transfer leadership to TS 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:52.190205 30716 consensus_queue.cc:1048] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.198891 30553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
mode: GRACEFUL
new_leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:33768
I20260709 12:20:52.199456 30553 raft_consensus.cc:606] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Received request to transfer leadership to TS 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:52.204622 30687 consensus_queue.cc:1048] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.205595 30748 raft_consensus.cc:993] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa: : Instructing follower 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:52.206072 30748 raft_consensus.cc:1081] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Signalling peer 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:52.206310 30553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
mode: GRACEFUL
new_leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:33768
I20260709 12:20:52.208367 30553 raft_consensus.cc:606] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Received request to transfer leadership to TS 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:52.211131 30403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:49696
I20260709 12:20:52.211766 30403 raft_consensus.cc:493] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.212126 30403 raft_consensus.cc:3060] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.223035 30403 raft_consensus.cc:515] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.226325 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:52.227083 30552 raft_consensus.cc:3060] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.233496 30403 leader_election.cc:290] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:52.235730 30552 raft_consensus.cc:2468] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:52.236323 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132c553b5f2d4ec7b9a77e44c7cb9a72" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:52.236953 30477 raft_consensus.cc:3055] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.237298 30477 raft_consensus.cc:740] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:52.237332 30367 leader_election.cc:304] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, 8f9cd366f8ae43a09328075ce5b33c68; no voters: 
I20260709 12:20:52.238276 30759 raft_consensus.cc:2804] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.238173 30477 consensus_queue.cc:260] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.238730 30759 raft_consensus.cc:697] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:52.239603 30477 raft_consensus.cc:3060] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.239540 30759 consensus_queue.cc:237] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.246068 30477 raft_consensus.cc:2468] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:52.246381 30403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bdb43fec18544b18712578a0c3fa153"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
mode: GRACEFUL
new_leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
 from {username='slave'} at 127.0.0.1:48198
I20260709 12:20:52.247011 30403 raft_consensus.cc:606] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Received request to transfer leadership to TS c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:52.248121 30300 catalog_manager.cc:5697] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 1 to 2, leader changed from c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2) to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.255432 30403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
mode: GRACEFUL
new_leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
 from {username='slave'} at 127.0.0.1:48198
I20260709 12:20:52.255928 30403 raft_consensus.cc:606] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Received request to transfer leadership to TS c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:52.260700 30552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f8a5d12d65452c9ccb26c6b3db350d"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
mode: GRACEFUL
new_leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
 from {username='slave'} at 127.0.0.1:33768
I20260709 12:20:52.261175 30552 raft_consensus.cc:606] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Received request to transfer leadership to TS c1c801c5e2ba4c60b1eff73283196afa
I20260709 12:20:52.265583 30403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ede6aeeca14ca480c93b44f8864819"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
mode: GRACEFUL
new_leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
 from {username='slave'} at 127.0.0.1:48198
I20260709 12:20:52.266014 30403 raft_consensus.cc:606] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Received request to transfer leadership to TS 6845868c2cad4fc1a0733b72a1b568c6
I20260709 12:20:52.317713 30733 consensus_queue.cc:1048] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.327325 30735 consensus_queue.cc:1048] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.335072 30685 raft_consensus.cc:993] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6: : Instructing follower 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:52.335531 30735 raft_consensus.cc:1081] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Signalling peer 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:52.337056 30403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:49708
I20260709 12:20:52.337670 30403 raft_consensus.cc:493] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.338037 30403 raft_consensus.cc:3060] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.343190 30403 raft_consensus.cc:515] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.345432 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:52.345667 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40aa143e534746f4a20b10777ab7366a" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:52.345816 30403 leader_election.cc:290] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:52.345894 30477 raft_consensus.cc:3060] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.346453 30552 raft_consensus.cc:3055] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.346833 30552 raft_consensus.cc:740] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:52.347647 30552 consensus_queue.cc:260] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.348582 30552 raft_consensus.cc:3060] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.352581 30477 raft_consensus.cc:2468] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:52.353564 30368 leader_election.cc:304] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:52.354202 30759 raft_consensus.cc:2804] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.354585 30759 raft_consensus.cc:697] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:52.355340 30759 consensus_queue.cc:237] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.355722 30552 raft_consensus.cc:2468] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:52.361950 30301 catalog_manager.cc:5697] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 1 to 2, leader changed from 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3) to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.431843 30759 consensus_queue.cc:1048] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.442499 30758 consensus_queue.cc:1048] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.449932 30711 raft_consensus.cc:993] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68: : Instructing follower 6845868c2cad4fc1a0733b72a1b568c6 to start an election
I20260709 12:20:52.450412 30711 raft_consensus.cc:1081] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Signalling peer 6845868c2cad4fc1a0733b72a1b568c6 to start an election
I20260709 12:20:52.451856 30552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ede6aeeca14ca480c93b44f8864819"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
 from {username='slave'} at 127.0.0.1:33752
I20260709 12:20:52.452419 30552 raft_consensus.cc:493] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.452804 30552 raft_consensus.cc:3060] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.458813 30552 raft_consensus.cc:515] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.460575 30552 leader_election.cc:290] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:52.461361 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ede6aeeca14ca480c93b44f8864819" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:52.461931 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ede6aeeca14ca480c93b44f8864819" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:52.461990 30403 raft_consensus.cc:3055] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.462452 30403 raft_consensus.cc:740] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:52.462816 30477 raft_consensus.cc:3060] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.463285 30403 consensus_queue.cc:260] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.464637 30403 raft_consensus.cc:3060] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.468071 30477 raft_consensus.cc:2468] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 2.
I20260709 12:20:52.469368 30518 leader_election.cc:304] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:52.471103 30735 raft_consensus.cc:2804] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.471072 30403 raft_consensus.cc:2468] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 2.
I20260709 12:20:52.471808 30735 raft_consensus.cc:697] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:52.472688 30735 consensus_queue.cc:237] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.474560 30759 raft_consensus.cc:993] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68: : Instructing follower c1c801c5e2ba4c60b1eff73283196afa to start an election
I20260709 12:20:52.475024 30759 raft_consensus.cc:1081] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Signalling peer c1c801c5e2ba4c60b1eff73283196afa to start an election
I20260709 12:20:52.476784 30479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f"
dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
 from {username='slave'} at 127.0.0.1:52598
I20260709 12:20:52.477376 30479 raft_consensus.cc:493] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.477692 30479 raft_consensus.cc:3060] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.483487 30301 catalog_manager.cc:5697] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 1 to 2, leader changed from 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1) to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.485159 30479 raft_consensus.cc:515] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.487687 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:52.488094 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61212eb05e341c8b6ce0893a7cdf61f" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:52.488260 30403 raft_consensus.cc:3055] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.488690 30403 raft_consensus.cc:740] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:52.488713 30552 raft_consensus.cc:3060] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.489705 30403 consensus_queue.cc:260] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.490799 30403 raft_consensus.cc:3060] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.494961 30479 leader_election.cc:290] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 2 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:52.495987 30552 raft_consensus.cc:2468] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 2.
I20260709 12:20:52.497229 30443 leader_election.cc:304] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:52.497696 30403 raft_consensus.cc:2468] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 2.
I20260709 12:20:52.497978 30687 raft_consensus.cc:2804] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.498458 30687 raft_consensus.cc:697] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:52.499212 30687 consensus_queue.cc:237] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.505486 30301 catalog_manager.cc:5697] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 1 to 2, leader changed from 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1) to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 2 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.535226 30735 consensus_queue.cc:1048] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.541314 30685 raft_consensus.cc:993] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6: : Instructing follower c1c801c5e2ba4c60b1eff73283196afa to start an election
I20260709 12:20:52.541852 30685 raft_consensus.cc:1081] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Signalling peer c1c801c5e2ba4c60b1eff73283196afa to start an election
I20260709 12:20:52.547711 30685 consensus_queue.cc:1048] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.548621 30479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95f8a5d12d65452c9ccb26c6b3db350d"
dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
 from {username='slave'} at 127.0.0.1:52592
I20260709 12:20:52.549547 30479 raft_consensus.cc:493] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.549994 30479 raft_consensus.cc:3060] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.557107 30479 raft_consensus.cc:515] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.559685 30479 leader_election.cc:290] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 2 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:52.559998 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f8a5d12d65452c9ccb26c6b3db350d" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:52.560268 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f8a5d12d65452c9ccb26c6b3db350d" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:52.560921 30552 raft_consensus.cc:3055] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.561192 30552 raft_consensus.cc:740] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:52.562036 30552 consensus_queue.cc:260] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.563375 30552 raft_consensus.cc:3060] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.570053 30552 raft_consensus.cc:2468] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 2.
I20260709 12:20:52.571210 30443 leader_election.cc:304] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 8f9cd366f8ae43a09328075ce5b33c68
I20260709 12:20:52.571974 30748 raft_consensus.cc:2804] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.572402 30748 raft_consensus.cc:697] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:52.573205 30748 consensus_queue.cc:237] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.579581 30301 catalog_manager.cc:5697] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 1 to 2, leader changed from 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3) to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 2 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.595892 30711 consensus_queue.cc:1048] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.601863 30758 raft_consensus.cc:993] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68: : Instructing follower c1c801c5e2ba4c60b1eff73283196afa to start an election
I20260709 12:20:52.602386 30714 raft_consensus.cc:1081] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Signalling peer c1c801c5e2ba4c60b1eff73283196afa to start an election
I20260709 12:20:52.604362 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bdb43fec18544b18712578a0c3fa153"
dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
 from {username='slave'} at 127.0.0.1:52598
I20260709 12:20:52.606781 30477 raft_consensus.cc:493] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.607189 30477 raft_consensus.cc:3060] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.607345 30711 consensus_queue.cc:1048] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.615685 30477 raft_consensus.cc:515] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.618563 30477 leader_election.cc:290] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 2 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:52.618716 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb43fec18544b18712578a0c3fa153" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:52.619164 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdb43fec18544b18712578a0c3fa153" candidate_uuid: "c1c801c5e2ba4c60b1eff73283196afa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:52.619442 30403 raft_consensus.cc:3055] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.619773 30403 raft_consensus.cc:740] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:52.619786 30552 raft_consensus.cc:3060] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.620676 30403 consensus_queue.cc:260] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.621938 30403 raft_consensus.cc:3060] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.626992 30552 raft_consensus.cc:2468] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 2.
I20260709 12:20:52.628064 30443 leader_election.cc:304] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:52.628916 30748 raft_consensus.cc:2804] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.628921 30403 raft_consensus.cc:2468] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c801c5e2ba4c60b1eff73283196afa in term 2.
I20260709 12:20:52.629670 30748 raft_consensus.cc:697] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Becoming Leader. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:52.630483 30748 consensus_queue.cc:237] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.637526 30301 catalog_manager.cc:5697] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa reported cstate change: term changed from 1 to 2, leader changed from 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1) to c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2). New cstate: current_term: 2 leader_uuid: "c1c801c5e2ba4c60b1eff73283196afa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.721555 30685 raft_consensus.cc:993] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6: : Instructing follower 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:52.722028 30735 raft_consensus.cc:1081] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Signalling peer 8f9cd366f8ae43a09328075ce5b33c68 to start an election
I20260709 12:20:52.723388 30403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
 from {username='slave'} at 127.0.0.1:49708
I20260709 12:20:52.723829 30403 raft_consensus.cc:493] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.724079 30403 raft_consensus.cc:3060] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.728932 30403 raft_consensus.cc:515] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.730242 30403 leader_election.cc:290] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Requested vote from peers c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105), 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3:38261)
I20260709 12:20:52.731181 30552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
I20260709 12:20:52.731123 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90a11f6ff29648ce81cd4a605a2e2740" candidate_uuid: "8f9cd366f8ae43a09328075ce5b33c68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:52.731915 30552 raft_consensus.cc:3055] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.731978 30477 raft_consensus.cc:3060] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.732273 30552 raft_consensus.cc:740] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:52.733053 30552 consensus_queue.cc:260] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.734221 30552 raft_consensus.cc:3060] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.739188 30477 raft_consensus.cc:2468] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:52.740358 30368 leader_election.cc:304] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9cd366f8ae43a09328075ce5b33c68, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:52.740687 30552 raft_consensus.cc:2468] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9cd366f8ae43a09328075ce5b33c68 in term 2.
I20260709 12:20:52.740971 30711 raft_consensus.cc:2804] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.741485 30711 raft_consensus.cc:697] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:52.742548 30711 consensus_queue.cc:237] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:52.748847 30301 catalog_manager.cc:5697] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 reported cstate change: term changed from 1 to 2, leader changed from 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3) to 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1). New cstate: current_term: 2 leader_uuid: "8f9cd366f8ae43a09328075ce5b33c68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.755132 30477 raft_consensus.cc:1275] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.756438 30711 consensus_queue.cc:1048] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.763379 30552 raft_consensus.cc:1275] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.764765 30711 consensus_queue.cc:1048] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.897730 30403 raft_consensus.cc:1275] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Refusing update from remote peer 6845868c2cad4fc1a0733b72a1b568c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.899189 30735 consensus_queue.cc:1048] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.906663 30477 raft_consensus.cc:1275] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Refusing update from remote peer 6845868c2cad4fc1a0733b72a1b568c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.908711 30733 consensus_queue.cc:1048] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.929632 30477 raft_consensus.cc:1275] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.930685 30758 consensus_queue.cc:1048] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.937492 30552 raft_consensus.cc:1275] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.938874 30759 consensus_queue.cc:1048] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.950681 30552 raft_consensus.cc:1275] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer c1c801c5e2ba4c60b1eff73283196afa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.951843 30748 consensus_queue.cc:1048] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.959092 30402 raft_consensus.cc:1275] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Refusing update from remote peer c1c801c5e2ba4c60b1eff73283196afa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:52.961409 30687 consensus_queue.cc:1048] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.078424 30402 raft_consensus.cc:3060] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.083232 30402 raft_consensus.cc:1275] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Refusing update from remote peer c1c801c5e2ba4c60b1eff73283196afa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.084311 30687 consensus_queue.cc:1048] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.091809 30552 raft_consensus.cc:1275] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer c1c801c5e2ba4c60b1eff73283196afa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.093284 30687 consensus_queue.cc:1048] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.135272 30552 raft_consensus.cc:1275] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer c1c801c5e2ba4c60b1eff73283196afa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.135468 30403 raft_consensus.cc:1275] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Refusing update from remote peer c1c801c5e2ba4c60b1eff73283196afa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.136799 30748 consensus_queue.cc:1048] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.137499 30775 consensus_queue.cc:1048] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.137940 30552 raft_consensus.cc:1275] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.139303 30758 consensus_queue.cc:1048] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.162235 30477 raft_consensus.cc:1275] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Refusing update from remote peer 8f9cd366f8ae43a09328075ce5b33c68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.164506 30714 consensus_queue.cc:1048] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.268811 30300 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48682:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:20:55.287830 30300 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48682:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:20:55.346975 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:55.409832 30790 log.cc:927] Time spent T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:20:55.488804 30819 tablet.cc:1724] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.450887 30817 tablet.cc:1724] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.494632 30823 tablet.cc:1724] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:55.509716 30808 log.cc:927] Time spent T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:55.528469 30828 tablet.cc:1724] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.535772 30826 tablet.cc:1724] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:55.545964 30810 log.cc:927] Time spent T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa: Append to log took a long time: real 0.139s	user 0.003s	sys 0.000s
I20260709 12:20:55.600557 30400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e59e52afc0014336bf2cf20cab81256f"
dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
mode: GRACEFUL
new_leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
 from {username='slave'} at 127.0.0.1:48202
I20260709 12:20:55.601351 30400 raft_consensus.cc:606] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Received request to transfer leadership to TS 6845868c2cad4fc1a0733b72a1b568c6
I20260709 12:20:55.600862 30834 tablet.cc:1724] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.566408 30827 tablet.cc:1724] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:55.621657 30825 log.cc:927] Time spent T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:20:55.636148 30833 tablet.cc:1724] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.626016 30823 tablet.cc:1724] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.661412 30844 tablet.cc:1724] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:55.666520 30443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.108.3:38261, user_credentials={real_user=slave}} blocked reactor thread for 58419.3us
I20260709 12:20:55.690071 30843 tablet.cc:1724] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.677802 30842 tablet.cc:1724] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.712183 30817 tablet.cc:1724] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.717466 30827 tablet.cc:1724] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.712672 30819 tablet.cc:1724] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.725431 30826 tablet.cc:1724] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.708480 30833 tablet.cc:1724] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.769294 30823 tablet.cc:1724] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.779865 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4"
dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
mode: GRACEFUL
new_leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
 from {username='slave'} at 127.0.0.1:37012
I20260709 12:20:55.780601 30477 raft_consensus.cc:606] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Received request to transfer leadership to TS 6845868c2cad4fc1a0733b72a1b568c6
I20260709 12:20:55.782006 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:55.782640 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:55.783188 30844 tablet.cc:1724] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.797256 30819 tablet.cc:1724] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.799567 30823 tablet.cc:1724] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.818992 30834 tablet.cc:1724] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.828531 30840 raft_consensus.cc:993] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa: : Instructing follower 6845868c2cad4fc1a0733b72a1b568c6 to start an election
I20260709 12:20:55.828199 30827 tablet.cc:1724] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.836355 30843 tablet.cc:1724] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.839709 30815 raft_consensus.cc:1081] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Signalling peer 6845868c2cad4fc1a0733b72a1b568c6 to start an election
I20260709 12:20:55.845216 30844 tablet.cc:1724] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.849319 30552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
 from {username='slave'} at 127.0.0.1:33742
I20260709 12:20:55.849912 30552 raft_consensus.cc:493] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:55.850275 30552 raft_consensus.cc:3060] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.851656 30819 tablet.cc:1724] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.857978 30552 raft_consensus.cc:515] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:55.853996 30833 tablet.cc:1724] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:55.861653 30552 leader_election.cc:290] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 3 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:55.861824 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:55.860811 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8119ed06b1745fea3ce3a45aa3aabb4" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:55.862440 30477 raft_consensus.cc:3055] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:55.862763 30477 raft_consensus.cc:740] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c1c801c5e2ba4c60b1eff73283196afa, State: Running, Role: LEADER
I20260709 12:20:55.863476 30477 consensus_queue.cc:260] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:55.864638 30477 raft_consensus.cc:3060] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.873944 30401 raft_consensus.cc:3060] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.878657 30477 raft_consensus.cc:2468] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 3.
I20260709 12:20:55.879973 30518 leader_election.cc:304] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:55.880899 30780 raft_consensus.cc:2804] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.881374 30780 raft_consensus.cc:697] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 3 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:55.882160 30780 consensus_queue.cc:237] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:55.890870 30401 raft_consensus.cc:2468] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 3.
I20260709 12:20:55.896703 30299 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52: soft_deleted_table [id=e61dc8b0d99e4845beab6a7e59fa7e05] alter complete (version 1)
I20260709 12:20:55.905215 30299 catalog_manager.cc:5697] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 2 to 3, leader changed from c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2) to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 3 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.954152 30795 raft_consensus.cc:993] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68: : Instructing follower 6845868c2cad4fc1a0733b72a1b568c6 to start an election
I20260709 12:20:55.954612 30795 raft_consensus.cc:1081] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Signalling peer 6845868c2cad4fc1a0733b72a1b568c6 to start an election
I20260709 12:20:55.956077 30552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e59e52afc0014336bf2cf20cab81256f"
dest_uuid: "6845868c2cad4fc1a0733b72a1b568c6"
 from {username='slave'} at 127.0.0.1:33752
I20260709 12:20:55.956599 30552 raft_consensus.cc:493] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:55.956909 30552 raft_consensus.cc:3060] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:55.961457 30552 raft_consensus.cc:515] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:55.962862 30552 leader_election.cc:290] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561), c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105)
I20260709 12:20:55.963783 30401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59e52afc0014336bf2cf20cab81256f" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9cd366f8ae43a09328075ce5b33c68"
I20260709 12:20:55.963827 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59e52afc0014336bf2cf20cab81256f" candidate_uuid: "6845868c2cad4fc1a0733b72a1b568c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1c801c5e2ba4c60b1eff73283196afa"
I20260709 12:20:55.964409 30401 raft_consensus.cc:3055] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:55.964488 30477 raft_consensus.cc:3060] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:55.964701 30401 raft_consensus.cc:740] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f9cd366f8ae43a09328075ce5b33c68, State: Running, Role: LEADER
I20260709 12:20:55.965399 30401 consensus_queue.cc:260] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:55.966478 30401 raft_consensus.cc:3060] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:55.970134 30477 raft_consensus.cc:2468] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 2.
I20260709 12:20:55.971114 30518 leader_election.cc:304] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6845868c2cad4fc1a0733b72a1b568c6, c1c801c5e2ba4c60b1eff73283196afa; no voters: 
I20260709 12:20:55.971699 30780 raft_consensus.cc:2804] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:55.972000 30401 raft_consensus.cc:2468] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6845868c2cad4fc1a0733b72a1b568c6 in term 2.
I20260709 12:20:55.972189 30780 raft_consensus.cc:697] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 LEADER]: Becoming Leader. State: Replica: 6845868c2cad4fc1a0733b72a1b568c6, State: Running, Role: LEADER
I20260709 12:20:55.973094 30780 consensus_queue.cc:237] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } }
I20260709 12:20:55.980763 30299 catalog_manager.cc:5697] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 reported cstate change: term changed from 1 to 2, leader changed from 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1) to 6845868c2cad4fc1a0733b72a1b568c6 (127.19.108.3). New cstate: current_term: 2 leader_uuid: "6845868c2cad4fc1a0733b72a1b568c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6845868c2cad4fc1a0733b72a1b568c6" member_type: VOTER last_known_addr { host: "127.19.108.3" port: 38261 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:56.356318 30401 raft_consensus.cc:1275] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 3 FOLLOWER]: Refusing update from remote peer 6845868c2cad4fc1a0733b72a1b568c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:56.357352 30780 consensus_queue.cc:1048] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:56.369459 30477 raft_consensus.cc:1275] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 3 FOLLOWER]: Refusing update from remote peer 6845868c2cad4fc1a0733b72a1b568c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:56.371217 30780 consensus_queue.cc:1048] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:56.492588 30477 raft_consensus.cc:1275] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Refusing update from remote peer 6845868c2cad4fc1a0733b72a1b568c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:56.493753 30858 consensus_queue.cc:1048] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1c801c5e2ba4c60b1eff73283196afa" member_type: VOTER last_known_addr { host: "127.19.108.2" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:56.501663 30401 raft_consensus.cc:1275] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Refusing update from remote peer 6845868c2cad4fc1a0733b72a1b568c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:56.503599 30858 consensus_queue.cc:1048] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9cd366f8ae43a09328075ce5b33c68" member_type: VOTER last_known_addr { host: "127.19.108.1" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:56.783694 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:56.789573 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:56.789938 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:57.791186 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:57.799889 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:57.800329 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:58.801502 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:58.807196 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:58.807646 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:59.808583 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:59.813503 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:59.813930 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:00.814864 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:00.819905 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:00.820379 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:01.821241 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:01.826670 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:01.827190 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:02.828287 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:02.833360 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:02.833778 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:03.834717 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:03.839936 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:03.840361 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:04.841297 19888 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:04.846921 19888 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:04.847307 19888 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:05.899010 19888 tablet_server.cc:179] TabletServer@127.19.108.1:0 shutting down...
I20260709 12:21:05.940210 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:05.941042 19888 tablet_replica.cc:333] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.941985 19888 raft_consensus.cc:2243] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.942713 19888 raft_consensus.cc:2272] T 5bdb43fec18544b18712578a0c3fa153 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.945361 19888 tablet_replica.cc:333] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.946266 19888 raft_consensus.cc:2243] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.947467 19888 raft_consensus.cc:2272] T 90a11f6ff29648ce81cd4a605a2e2740 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:05.947562 30444 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 12:21:05.950484 19888 tablet_replica.cc:333] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
W20260709 12:21:05.950836 30444 consensus_peers.cc:597] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa -> Peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Couldn't send request to peer 8f9cd366f8ae43a09328075ce5b33c68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:05.951381 19888 raft_consensus.cc:2243] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.952270 19888 raft_consensus.cc:2272] T 40aa143e534746f4a20b10777ab7366a P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.954488 19888 tablet_replica.cc:333] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.955138 19888 raft_consensus.cc:2243] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.955708 19888 raft_consensus.cc:2272] T b61212eb05e341c8b6ce0893a7cdf61f P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.958529 19888 tablet_replica.cc:333] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.959394 19888 raft_consensus.cc:2243] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.960493 19888 raft_consensus.cc:2272] T 6ada40eb5c194b68a512c31a6b2b932e P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.962885 19888 tablet_replica.cc:333] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.963470 19888 raft_consensus.cc:2243] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.963907 19888 raft_consensus.cc:2272] T a0ebc021d56a4e68bf1154f505e082dc P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.966104 19888 tablet_replica.cc:333] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.966611 19888 raft_consensus.cc:2243] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.967469 19888 raft_consensus.cc:2272] T 771637c3e2a24b2bbd4124919214d90b P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.969693 19888 tablet_replica.cc:333] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.970294 19888 raft_consensus.cc:2243] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.971145 19888 raft_consensus.cc:2272] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.973428 19888 tablet_replica.cc:333] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.973937 19888 raft_consensus.cc:2243] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.974804 19888 raft_consensus.cc:2272] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.977159 19888 tablet_replica.cc:333] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.977798 19888 raft_consensus.cc:2243] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.978428 19888 raft_consensus.cc:2272] T 95f8a5d12d65452c9ccb26c6b3db350d P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.981196 19888 tablet_replica.cc:333] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.981756 19888 raft_consensus.cc:2243] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.982309 19888 raft_consensus.cc:2272] T e20d73b79d934d4cadab76e175aa2271 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.984612 19888 tablet_replica.cc:333] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.985118 19888 raft_consensus.cc:2243] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.985620 19888 raft_consensus.cc:2272] T bb619ea56cf54693b88ce4baf238029d P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.987804 19888 tablet_replica.cc:333] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.988267 19888 raft_consensus.cc:2243] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.988660 19888 raft_consensus.cc:2272] T e59e52afc0014336bf2cf20cab81256f P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.990778 19888 tablet_replica.cc:333] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.991320 19888 raft_consensus.cc:2243] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.991783 19888 raft_consensus.cc:2272] T 65ede6aeeca14ca480c93b44f8864819 P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.994036 19888 tablet_replica.cc:333] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.994524 19888 raft_consensus.cc:2243] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.995486 19888 raft_consensus.cc:2272] T 15e9b563b23842ef8d1d42aafea0e22c P 8f9cd366f8ae43a09328075ce5b33c68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.997860 19888 tablet_replica.cc:333] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:05.998373 19888 raft_consensus.cc:2243] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.998781 19888 raft_consensus.cc:2272] T ff7ba666f8cd42769ba75fd1682fba28 P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.001479 19888 tablet_replica.cc:333] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:06.001929 19888 raft_consensus.cc:2243] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.002313 19888 raft_consensus.cc:2272] T 4654e11a7be44d9eaec7da3f6dad02ca P 8f9cd366f8ae43a09328075ce5b33c68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.004707 19888 tablet_replica.cc:333] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68: stopping tablet replica
I20260709 12:21:06.005234 19888 raft_consensus.cc:2243] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.005729 19888 raft_consensus.cc:2272] T e8119ed06b1745fea3ce3a45aa3aabb4 P 8f9cd366f8ae43a09328075ce5b33c68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.053619 19888 tablet_server.cc:196] TabletServer@127.19.108.1:0 shutdown complete.
I20260709 12:21:06.095732 19888 tablet_server.cc:179] TabletServer@127.19.108.2:0 shutting down...
I20260709 12:21:06.120434 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:06.121186 19888 tablet_replica.cc:333] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.122027 19888 raft_consensus.cc:2243] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.122586 19888 raft_consensus.cc:2272] T 40aa143e534746f4a20b10777ab7366a P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.125077 19888 tablet_replica.cc:333] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.125738 19888 raft_consensus.cc:2243] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.126196 19888 raft_consensus.cc:2272] T 90a11f6ff29648ce81cd4a605a2e2740 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.128345 19888 tablet_replica.cc:333] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.128911 19888 raft_consensus.cc:2243] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.129747 19888 raft_consensus.cc:2272] T b61212eb05e341c8b6ce0893a7cdf61f P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.132288 19888 tablet_replica.cc:333] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.132899 19888 raft_consensus.cc:2243] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.133733 19888 raft_consensus.cc:2272] T 5bdb43fec18544b18712578a0c3fa153 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.135811 19888 tablet_replica.cc:333] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.136375 19888 raft_consensus.cc:2243] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.136870 19888 raft_consensus.cc:2272] T 6ada40eb5c194b68a512c31a6b2b932e P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.139078 19888 tablet_replica.cc:333] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.139609 19888 raft_consensus.cc:2243] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.140092 19888 raft_consensus.cc:2272] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.142313 19888 tablet_replica.cc:333] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.142985 19888 raft_consensus.cc:2243] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.143651 19888 raft_consensus.cc:2272] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.146132 19888 tablet_replica.cc:333] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.146750 19888 raft_consensus.cc:2243] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.147284 19888 raft_consensus.cc:2272] T e8119ed06b1745fea3ce3a45aa3aabb4 P c1c801c5e2ba4c60b1eff73283196afa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.150530 19888 tablet_replica.cc:333] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.151197 19888 raft_consensus.cc:2243] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.152354 19888 raft_consensus.cc:2272] T bb619ea56cf54693b88ce4baf238029d P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.152407 30518 consensus_peers.cc:597] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 -> Peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Couldn't send request to peer c1c801c5e2ba4c60b1eff73283196afa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:06.154675 19888 tablet_replica.cc:333] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.155486 19888 raft_consensus.cc:2243] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.156085 19888 raft_consensus.cc:2272] T 65ede6aeeca14ca480c93b44f8864819 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.159108 19888 tablet_replica.cc:333] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.159828 19888 raft_consensus.cc:2243] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.160478 19888 raft_consensus.cc:2272] T 15e9b563b23842ef8d1d42aafea0e22c P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.160791 30518 consensus_peers.cc:597] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 -> Peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Couldn't send request to peer 8f9cd366f8ae43a09328075ce5b33c68. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:06.161659 30518 consensus_peers.cc:597] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 -> Peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Couldn't send request to peer c1c801c5e2ba4c60b1eff73283196afa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:06.163311 19888 tablet_replica.cc:333] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.163918 19888 raft_consensus.cc:2243] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.164368 19888 raft_consensus.cc:2272] T e59e52afc0014336bf2cf20cab81256f P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.166522 19888 tablet_replica.cc:333] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.167096 19888 raft_consensus.cc:2243] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.167912 19888 raft_consensus.cc:2272] T 95f8a5d12d65452c9ccb26c6b3db350d P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.170706 19888 tablet_replica.cc:333] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.171303 19888 raft_consensus.cc:2243] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.172004 19888 raft_consensus.cc:2272] T e20d73b79d934d4cadab76e175aa2271 P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.174193 19888 tablet_replica.cc:333] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.174700 19888 raft_consensus.cc:2243] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.175524 19888 raft_consensus.cc:2272] T ff7ba666f8cd42769ba75fd1682fba28 P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.177686 19888 tablet_replica.cc:333] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.178158 19888 raft_consensus.cc:2243] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.178970 19888 raft_consensus.cc:2272] T 4654e11a7be44d9eaec7da3f6dad02ca P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.181023 19888 tablet_replica.cc:333] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.181474 19888 raft_consensus.cc:2243] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.181878 19888 raft_consensus.cc:2272] T 771637c3e2a24b2bbd4124919214d90b P c1c801c5e2ba4c60b1eff73283196afa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.184031 19888 tablet_replica.cc:333] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa: stopping tablet replica
I20260709 12:21:06.184453 19888 raft_consensus.cc:2243] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.185207 19888 raft_consensus.cc:2272] T a0ebc021d56a4e68bf1154f505e082dc P c1c801c5e2ba4c60b1eff73283196afa [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:06.211592 30518 consensus_peers.cc:597] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 -> Peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Couldn't send request to peer 8f9cd366f8ae43a09328075ce5b33c68. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:06.211942 30518 consensus_peers.cc:597] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 -> Peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Couldn't send request to peer 8f9cd366f8ae43a09328075ce5b33c68. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:06.215312 30518 consensus_peers.cc:597] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 -> Peer c1c801c5e2ba4c60b1eff73283196afa (127.19.108.2:46105): Couldn't send request to peer c1c801c5e2ba4c60b1eff73283196afa. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.2:46105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:06.228183 19888 tablet_server.cc:196] TabletServer@127.19.108.2:0 shutdown complete.
I20260709 12:21:06.265983 19888 tablet_server.cc:179] TabletServer@127.19.108.3:0 shutting down...
W20260709 12:21:06.271843 30518 consensus_peers.cc:597] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 -> Peer 8f9cd366f8ae43a09328075ce5b33c68 (127.19.108.1:42561): Couldn't send request to peer 8f9cd366f8ae43a09328075ce5b33c68. Status: Network error: Client connection negotiation failed: client connection to 127.19.108.1:42561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:06.291777 19888 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:06.292626 19888 tablet_replica.cc:333] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.293342 19888 raft_consensus.cc:2243] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.293924 19888 raft_consensus.cc:2272] T 5bdb43fec18544b18712578a0c3fa153 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.296360 19888 tablet_replica.cc:333] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.296916 19888 raft_consensus.cc:2243] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.297457 19888 raft_consensus.cc:2272] T 90a11f6ff29648ce81cd4a605a2e2740 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.299630 19888 tablet_replica.cc:333] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.300190 19888 raft_consensus.cc:2243] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.300684 19888 raft_consensus.cc:2272] T 40aa143e534746f4a20b10777ab7366a P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.302767 19888 tablet_replica.cc:333] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.303354 19888 raft_consensus.cc:2243] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.303824 19888 raft_consensus.cc:2272] T b61212eb05e341c8b6ce0893a7cdf61f P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.305835 19888 tablet_replica.cc:333] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.306430 19888 raft_consensus.cc:2243] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.306947 19888 raft_consensus.cc:2272] T 6ada40eb5c194b68a512c31a6b2b932e P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.309114 19888 tablet_replica.cc:333] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.309655 19888 raft_consensus.cc:2243] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.310132 19888 raft_consensus.cc:2272] T 771637c3e2a24b2bbd4124919214d90b P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.312151 19888 tablet_replica.cc:333] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.312685 19888 raft_consensus.cc:2243] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.313120 19888 raft_consensus.cc:2272] T a0ebc021d56a4e68bf1154f505e082dc P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.315389 19888 tablet_replica.cc:333] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.315943 19888 raft_consensus.cc:2243] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.316359 19888 raft_consensus.cc:2272] T ff7ba666f8cd42769ba75fd1682fba28 P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.318367 19888 tablet_replica.cc:333] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.318895 19888 raft_consensus.cc:2243] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.319327 19888 raft_consensus.cc:2272] T 4654e11a7be44d9eaec7da3f6dad02ca P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.321245 19888 tablet_replica.cc:333] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.321748 19888 raft_consensus.cc:2243] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.322237 19888 raft_consensus.cc:2272] T 95f8a5d12d65452c9ccb26c6b3db350d P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.324169 19888 tablet_replica.cc:333] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.324646 19888 raft_consensus.cc:2243] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.325452 19888 raft_consensus.cc:2272] T e20d73b79d934d4cadab76e175aa2271 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.327423 19888 tablet_replica.cc:333] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.327903 19888 raft_consensus.cc:2243] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.328342 19888 raft_consensus.cc:2272] T bb619ea56cf54693b88ce4baf238029d P 6845868c2cad4fc1a0733b72a1b568c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.330355 19888 tablet_replica.cc:333] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.330834 19888 raft_consensus.cc:2243] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.331656 19888 raft_consensus.cc:2272] T 65ede6aeeca14ca480c93b44f8864819 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.333613 19888 tablet_replica.cc:333] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.334069 19888 raft_consensus.cc:2243] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.334488 19888 raft_consensus.cc:2272] T 15e9b563b23842ef8d1d42aafea0e22c P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.336374 19888 tablet_replica.cc:333] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.336848 19888 raft_consensus.cc:2243] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.337668 19888 raft_consensus.cc:2272] T e59e52afc0014336bf2cf20cab81256f P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.339740 19888 tablet_replica.cc:333] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.340430 19888 raft_consensus.cc:2243] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.341212 19888 raft_consensus.cc:2272] T e8119ed06b1745fea3ce3a45aa3aabb4 P 6845868c2cad4fc1a0733b72a1b568c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.343148 19888 tablet_replica.cc:333] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.343583 19888 raft_consensus.cc:2243] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.343986 19888 raft_consensus.cc:2272] T 132c553b5f2d4ec7b9a77e44c7cb9a72 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.345899 19888 tablet_replica.cc:333] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6: stopping tablet replica
I20260709 12:21:06.346288 19888 raft_consensus.cc:2243] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:06.346705 19888 raft_consensus.cc:2272] T 50f6e0e4ef834d2c97a3ffd51c8acf34 P 6845868c2cad4fc1a0733b72a1b568c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.385847 19888 tablet_server.cc:196] TabletServer@127.19.108.3:0 shutdown complete.
I20260709 12:21:06.422319 19888 master.cc:562] Master@127.19.108.62:34889 shutting down...
I20260709 12:21:06.442171 19888 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.442739 19888 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.443082 19888 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9c2390f5c3d74a789f19b48aa62bbf52: stopping tablet replica
I20260709 12:21:06.462996 19888 master.cc:584] Master@127.19.108.62:34889 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20330 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41909 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (348272 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:21:06.516737 19888 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2263 messages since previous log ~32 seconds ago
I20260709 12:21:06.516997 19888 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2263 messages since previous log ~32 seconds ago
I20260709 12:21:06.517167 19888 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2260 messages since previous log ~32 seconds ago
I20260709 12:21:06.517366 19888 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:21:06.517562 19888 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:21:06.517765 19888 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~153 seconds ago
I20260709 12:21:06.518026 19888 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 12:21:06.518298 19888 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
